You can run it locally if you have a decent computer and graphics card if you’re concerned about privacy
https://ollama.com/
Login to reply
Replies (2)
Thank you.
So if I download it to my computer, what's the difference vs using the one online? I assume the one online will provide better results as its "online" vs the one on my computer that might get outdated if I don't update?
You're forced to use way smaller models because you don't have the necessary RAM/VRAM (basically very fast memory) to store the largest model after it is read from your (much slower) hard drive. So the model has less parameters (basically a lesser amount of knowledge) and won't perform as well, especially for more complex tasks. It's also likely to be slower. You can download updated versions of the model with ollama once they're released.