I'd like to add that you can run Qwen 3.5 on 128G Mac using @ubergarm smol-IQ2_XS quant, here's my experience trying it locally: https://huggingface.co/ubergarm/Qwen3.5-397B-A17B-GGUF/discussions/2
Thiago de Arruda Padilha
tarruda
AI & ML interests
None yet
Recent Activity
new activity
about 3 hours ago
ubergarm/Qwen3.5-397B-A17B-GGUF:smol-IQ2_XS is a damn good quant!
replied to
danielhanchen's
post
about 5 hours ago
You can now run Qwen3.5 locally! 💜
Qwen3.5-397B-A17B is an open MoE vision reasoning LLM for agentic coding & chat. It performs on par with Gemini 3 Pro, Claude Opus 4.5 & GPT-5.2.
GGUF: https://huggingface.co/unsloth/Qwen3.5-397B-A17B-GGUF
Run Dynamic 3-bit on a 192GB Mac for 20 tokens/s.
Guide: https://unsloth.ai/docs/models/qwen3.5
new activity
3 days ago
ubergarm/MiniMax-M2.5-GGUF:Which quant is best for Mac?
Organizations
None yet