Awesome. Partly encouraged by listening to you and Justin talking about the power of local AI for freedom tech, I started on my own local setup.
Currently running Qwen3.6-27B MTP UD-Q4_K_XL on an RTX via llama.cpp on Linux (Pop OS) and Hermes Agent as my local brain. Eye opening how capable it is .
I’ll be setting up a second 3090 as the next step. Onward
Login to reply
Replies (1)
What does mtp ud q4 kxl mean? On which rtx?
I ve got running qwen3.6:35b on rtx 3090, and heard, that it could work on as low as 6gb of vram.