I thought that was just to train them, that's crazy it still takes that much to run a LLM.
I thought that Shakespeare was it's own SLM built for coding nostr clients.
Login to reply
Replies (2)
That is to train them. You need more like a few thousand dollars of graphics cards to max out LLM performance for a single user running today's existing models. And we're starting to get pretty useful stuff in the 4-32GB range (typical consumer devices)
