Can it run any llama2 fine tuned model?
Login to reply
Replies (1)
Currently it uses the Nous Hermes Llama 2 (7B). If you’re technical, you can customize the Dockerfile to run a different Llama model: 
GitHub
llama-gpt/api/Dockerfile at c76225a6fc26a000fc07b074223a69b0d65b7bcf · getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumb...