16 isn't half bad, is it? What GPU? I got a 3090 but considering adding a second card.
Login to reply
Replies (3)
I would certainly upgrade a 2nd card, but priced out atm. Im running just a 7800XT. Was super cheap when i bought it with 64gb ram, sadly ddr4 :(
What software stack are you running with it? I'm just getting started with local AI. Got a OpenWeb UI set up on top of Ollama but it feels a long way off cloud services
Theres lots of options llama.cpp /hermes /pi/comfy... Im reaearching Picture and video models rn.