Unfortunately, it seems too heavy for my modest HW (8GB of VRAM)..
Login to reply
Replies (2)
the popular ablit that size is called (are you ready for this?) DavidAU/Qwen3.5-9B-The-Defiant-Fable-Uncensored-Heretic-NEO-IMATRIX-MAX-MTP-GGUF
wait ... some people are running the 35B MoE on 8GB VRAM 🤣 https://www.reddit.com/r/LocalLLaMA/comments/1vx4k9g/whats_the_best_local_model_youve_found_for_8_gb