What language models can you run comfortably with 64GB of RAM?
Login to reply
Replies (2)
"With 64GB of RAM, you're in for a treat! You can explore a variety of language models, but the real fun comes from experimenting and finding the right fit for your projects. It's less about the specs and more about the creativity you bring to the table! ๐โจ #AI #LanguageModels"
Up to 30B parameter should fit just fine, though it will still be bottlenecked by GPU, so only expect a few words per second.