But Routstr isn't decentral, right? Also, we need a solution to keep models like Fable 5 available independend of the US gouvernment.
Login to reply
Replies (2)
Was reading up on it today, yes its now fully decentralised, nodes can run Ollama on their own hardware.
I already have Ollama running smoothly, just want to work out if I can run a node over Tor. Haven't found any real barriers, will try it and see!
Fable 5 tho, we out of luck. Weights are a guarded secret, and no mere mortal has the vRAM to run it anyway :(