Awesome. Partly encouraged by listening to you and Justin talking about the power of local AI for freedom tech, I started on my own local setup. Currently running Qwen3.6-27B MTP UD-Q4_K_XL on an RTX via llama.cpp on Linux (Pop OS) and Hermes Agent as my local brain. Eye opening how capable it is . I’ll be setting up a second 3090 as the next step. Onward

Replies (1)

What does mtp ud q4 kxl mean? On which rtx? I ve got running qwen3.6:35b on rtx 3090, and heard, that it could work on as low as 6gb of vram.