Is this a local solution on your PC/Laptop?
Login to reply
Replies (1)
No, a good LLM needs custom GPUs and a lot of RAM (over 100GB). The Nvidia DGX Spark is Nvidia's first attempt at a home dedicated LLM, but it can be beaten by a good home built custom rig.
II'm going to wait for the competition to catch up to Nvidia and force evolution and price competition before I get my private LLM up and running.