No, a good LLM needs custom GPUs and a lot of RAM (over 100GB). The Nvidia DGX Spark is Nvidia's first attempt at a home dedicated LLM, but it can be beaten by a good home built custom rig. II'm going to wait for the competition to catch up to Nvidia and force evolution and price competition before I get my private LLM up and running.

Replies (1)

A lot of people like to use a M4 mac mini fully loaded with RAM, it comes pretty close to the Nvidia machine for about half the price.