👀 View quoted note →

We need a #Nostr-based standard to host #AI models on multiple servers, similar to #Blossom for media files. #grownostr

#routstr is already a thing :)

But Routstr isn't decentral, right? Also, we need a solution to keep models like Fable 5 available independend of the US gouvernment.

Was reading up on it today, yes its now fully decentralised, nodes can run Ollama on their own hardware. I already have Ollama running smoothly, just want to work out if I can run a node over Tor. Haven't found any real barriers, will try it and see!

Fable 5 tho, we out of luck. Weights are a guarded secret, and no mere mortal has the vRAM to run it anyway :(