i think we can use routstr as an openai compatible server in inference bridge, but i haven't verified it yet. other than that, i'll need to think about it.
Login to reply
Replies (1)
This is pretty awesome.. can you do me too please? :blobDance:
So if you can use an openai API endpoint... LMStudio/Ollama etc would be capable and we could self-host this whole shindig?