codewithdark/Llama-3.2-3B-4bit
3B • Updated • 17
Edit Models filters
Model Tree
Apps
Inference Providers
Models
19
Active filters: quantllm
codewithdark/Llama-3.2-3B-GGUF-4bit
3B • Updated • 3
codewithdark/Llama-3.2-3B-4bit-mlx
Text Generation • 3B • Updated • 63
QuantLLM/Llama-3.2-3B-4bit-mlx
Text Generation • 3B • Updated • 14
QuantLLM/Llama-3.2-3B-2bit-mlx
Text Generation • 3B • Updated • 10
QuantLLM/Llama-3.2-3B-8bit-mlx
Text Generation • 3B • Updated • 68
QuantLLM/Llama-3.2-3B-5bit-mlx
Text Generation • 3B • Updated • 7
QuantLLM/Llama-3.2-3B-5bit-gguf
3B • Updated • 12
QuantLLM/Llama-3.2-3B-2bit-gguf
3B • Updated • 11
QuantLLM/functiongemma-270m-it-8bit-gguf
0.3B • Updated • 9 • 1
QuantLLM/functiongemma-270m-it-4bit-gguf
0.3B • Updated • 23
QuantLLM/functiongemma-270m-it-4bit-mlx
0.3B • Updated • 8
QuantLLM/Meta-Llama-3-70B-Instruct-4bit-gguf
Text Generation • 71B • Updated • 6 • 1
QuantLLM/Qwen3-0.6B-2bit-gguf
0.6B • Updated • 25
QuantLLM/Qwen3-0.6B-4bit-gguf
0.6B • Updated • 24
QuantLLM/Qwen3-0.6B-8bit-gguf
0.6B • Updated • 16
QuantLLM/TinyLlama-1.1B-Chat-GGUF
1B • Updated • 102
QuantLLM/SmolLM2-135M-QuantLLM
Text Generation • 0.1B • Updated • 188
QuantLLM/SmolLM2-135M-GGUF
0.1B • Updated • 346