DETERMINISTIC OPTIMISM 🌞's avatar
DETERMINISTIC OPTIMISM 🌞 nvk@primal.net 2 years ago
Unleashed.Chat v0.1.1 is live! Now hit 1k+ users, this release adds more scalable infrastructure -Vector embeddings of nostr notes now stored in Redis–fast again! -Key infra components are now automated - App health monitoring and automatic remediation in case of container crashes or similar image

Replies (19)

siim's avatar
siim siim@nip05.net 2 years ago
Although not immediately visible to the user, this release is a big one and paves the way for adding more cool features. It's been awesome working on this project. So much learning! View quoted note →
Gzuuus's avatar
Gzuuus gzuuus@nostree.me 2 years ago
No for the text generation inference (the server that runs the llms), I was researching the different options available, some cool ones are huggingface tgi, llama.cpp, vllm
↑