Thread

You can run it locally if you have a decent computer and graphics card if you’re concerned about privacy https://ollama.com/

Thank you. So if I download it to my computer, what's the difference vs using the one online? I assume the one online will provide better results as its "online" vs the one on my computer that might get outdated if I don't update?

You're forced to use way smaller models because you don't have the necessary RAM/VRAM (basically very fast memory) to store the largest model after it is read from your (much slower) hard drive. So the model has less parameters (basically a lesser amount of knowledge) and won't perform as well, especially for more complex tasks. It's also likely to be slower. You can download updated versions of the model with ollama once they're released.

Oh and I recommend a web interface like openweb-ui that is easy to use. There are also many Desktop clients. Tell me your OS and I'll show you some options.

Thank you for all this info. I'm using Linux (PopOS)

This looks decent and easy to install and setup: https://github.com/Jeffser/Alpaca Hit me up if you need help.

Much appreciated, will give it a try and let you know if I run into any issues 👍