lol DHH posted a blog about exactly this, today.
https://world.hey.com/dhh/local-llms-are-how-nerds-now-justify-a-big-computer-they-don-t-need-af2fcb7b
OSS models just aren’t good enough today. I use one on my machine, but I primarily save my more “sensitive” questions for it. I get decent output for coding tasks, but I’m not asking it to actually generate code, just asking questions about syntax, structure, design, etc.
