routstr's avatar
routstr
_@routstr.com
npub130mz...l29s
A Decentralised LLM Routing Marketplace
routstr's avatar
routstr 6 months ago
sorry for the api being broken the last days it’s back now working 🎉
routstr's avatar
routstr 6 months ago
you can now create api keys that are pre filled with a balance (stored at provider side) that can be used in other applications like cursor so you can top up the balance without needing to change the cashu token always image
routstr's avatar
routstr 6 months ago
You can now change the base_url in our chat app to any provider running a openai-api proxy supporting the routstr-cashu protocol image
routstr's avatar
routstr 6 months ago
we just spend 120k SATs to create this new cashu nip60 implementation in python 120k SATs because claude4 opus in cursor costs a lot we needed this internally to improve the proxy implementations so why not publish it as separate library
routstr's avatar
routstr 7 months ago
One single request to Claude 4 Opus can cost $5,4 at context and completion maxed out. (~5k sats) Before the request there is no way to estimate the cost so we are required to implement a minimum balance that you need to put in your cashu token to be able to use the model. This cost varies by model so for example Gemini 2.5 Flash has a maximum cost of $0.2 ~180 sats
routstr's avatar
routstr 7 months ago
Our public onion endpoint: http://mcfftxiqtpwvrsly4..titn3frmf55frcleid.onion If you want to host your own provider and appear in the marketplace just post a nostr message, mention @routstr and add your onion url like in this message. We have a script in our backend that searches nostr for these messages and then includes your provider.