havoc
havoc
About
- Username
- havoc
- Joined
- Visits
- 2,594
- Last Active
- Roles
- Member, OG, Content Writer, Senpai
- Thanked
- 1291
Comments
-
Reckon we could see some good price drops on the 9000s & it ends up being a good deal more long term
-
Already have way to many rasp-like things lying around. The Radxa X4 looked interesting though
-
(Quote) Their paid plan includes $5 worth of API credits as well...which is A LOT. Never come close to exhausting that
-
Pretty sure accel networking isn't included in the free btw
-
Nice one! Tried it & works as expected. If you're looking to get additional load for publicity have a look at openrouter...some of the models on there have $0 pricing. Doesn't look like anybody else has free 3.1 on there right now.. You'd need …
-
llama.cpp is probably where I'd start. No idea whether it supports pipes etc though Be sure to install the right cuda/vulkan/rocm/whatever stack you need for your hardware else it'll be slow There is a llama guide somewhere in my submission history
-
Deep-tempest is such a cool name
-
Use openrouter.ai then you can try various. If you need cheap then deepseek is probably your best bet, though don't think it is particularly well suited to translation
-
(Quote) Thanks! No rush on mine
-
41a033760922ee59773dc33631410d4d85859cef Usage will be searx and a http proxy. Low usage & will be secured so that it's not open - just me
-
Instead of pikvm I'd rather look at the upcoming sipeed kvm Same concept but smaller, compact and cheaper cause you don't need a pi
-
(Quote) Thing is serving vast amounts of video b/w ain't cheap. So your options are either the google model (ads, tracking) or paid model. There is no "other"...unless you count ones that are still bootstrapping or using venture cap money…
-
Floatplane? Unsure whether it costs to post there.
-
(Quote) Whoops that should read LESS not more
-
(Quote) Inclined to agree. It's to some extent self-regulating. If a provider wants to launch straight into the bottom end of the market and develop a rep accordingly so be it. I doubt many are buying high end plans off this provider after how the …
-
You'd probably want to require nested virt too if doing proxmox, unless you go LXC only. Also FYI you don't technically need a custom ISO. You can convert debian to proxmox...and most respectable providers will have debian anyway https://pve.proxm…
-
(Quote) oh - didn't know pro is currently free on API too (well outside of europe)! Had just assumed its the lower one. Makes sense to use it then (Quote) Yeah its probably the most trusted leaderboard since it's blind side by side comparisons rat…
-
Can't you just do a simple proxy to bypass the geolock? As a sidenote, Gemma-2-27B will be substantially cheaper (~0.3) than Gemini and ends up about same on leaderboards: https://chat.lmsys.org/?leaderboard
-
LLMs via SSH can be done but isn't really a thing due to limited practicality. It's all either API (openAI format has become industry standard), or via a web UI, or straight into code via a python module etc. For a webUI I'd suggest: https://gith…
-
I thought GFW does DPI so even with a anon location it may not work?
-
You'd effectively be competing against the residential proxy market. The odds are not in your favour
-
(Quote) Why does this feel like it should be presented like this: (Image)