Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Main
Tasks
Libraries
Languages
Licenses
Other
1
Apps
llama.cpp
LM Studio
Jan
Draw Things
DiffusionBee
JoyFusion
vLLM
Ollama
MLX LM
Docker Model Runner
Lemonade
SGLang
Unsloth
Pi
Inference Providers
Select all
Groq
Novita
Cerebras
SambaNova
Nscale
fal
Hyperbolic
Together AI
Fireworks
Featherless AI
Zai
Replicate
Cohere
Scaleway
Public AI
OVHcloud AI Endpoints
HF Inference API
WaveSpeed
Misc
Reset Misc
quantization
Inference Endpoints
text-generation-inference
Eval Results (legacy)
text-embeddings-inference
4-bit precision
Merge
custom_code
8-bit precision
Mixture of Experts
Carbon Emissions
Eval Results
Apply filters
Models
1,180
Full-text search
Inference Available
Edit filters
Sort: Trending
Active filters:
quantization
Clear all
cs2764/GLM-5.1-FP8_dq4-mlx
Text Generation
•
744B
•
Updated
9 days ago
•
1.58k
MilyaShams/Qwen3-1.7B-Pipe_SparseGPT24_GPTQ_W8A8
1B
•
Updated
9 days ago
•
177
MilyaShams/Qwen3-1.7B-Pipe_Wanda_AWQ_W4A16
2B
•
Updated
9 days ago
•
102
MilyaShams/Qwen3-1.7B-Pipe_Wanda_AutoRound_W4A16
2B
•
Updated
9 days ago
•
88
MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_GPTQ_W8A8
2B
•
Updated
9 days ago
•
110
MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_W4A16
2B
•
Updated
9 days ago
•
97
MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_ign
2B
•
Updated
9 days ago
•
91
qubitron/LLaDA-8B-Quantized
Text Generation
•
Updated
8 days ago
bbearforever/quantum-Qwen2.5-4-bit
Text Generation
•
Updated
about 9 hours ago
MilyaShams/Qwen3-1.7B-Pipe_SmoothQuant_PTQ_Wanda24
1B
•
Updated
9 days ago
•
182
MilyaShams/Qwen3-1.7B-Pipe_Wanda_PTQ_W8A8
2B
•
Updated
9 days ago
•
106
MilyaShams/Qwen3-1.7B-Pipe_SparseGPT_GPTQ_W4A16
2B
•
Updated
9 days ago
•
115
MilyaShams/Qwen3-1.7B-Pipe_SparseGPT_SmoothQuant_PTQ
2B
•
Updated
9 days ago
•
106
MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_iters200
2B
•
Updated
9 days ago
•
92
rtrevinnoc/penumbra
Updated
9 days ago
MilyaShams/Qwen3-1.7B-SmoothQuant_0.5_AutoRound_W8A8
2B
•
Updated
9 days ago
•
105
Aysunner/gemma-4-31b-it-fp8
Text Generation
•
31B
•
Updated
9 days ago
•
113
vrfai/Qwen3-ASR-1.7B-int8
Automatic Speech Recognition
•
2B
•
Updated
8 days ago
•
3
vrfai/Qwen3-ASR-1.7B-int4
Automatic Speech Recognition
•
2B
•
Updated
8 days ago
•
3
Jamphus/gemma-4-31b-it-fp8
Text Generation
•
31B
•
Updated
6 days ago
•
46
kennedyian94/Llama-3.2-3B-AQLM-OA-EM-2Bit-2x8
Text Generation
•
Updated
4 days ago
•
299
kennedyian94/Qwen-2.5-3B-AQLM-OA-EM-2Bit-2x8
Text Generation
•
Updated
4 days ago
•
51
kennedyian94/Llama-3.1-8B-AQLM-OA-EM-2Bit-2x8
Text Generation
•
Updated
4 days ago
•
296
Lasimeri/MiniMax-M2.7-int4-AutoRound
Text Generation
•
32B
•
Updated
5 days ago
•
1.27k
zhangsq-nju/Qwen3-0.6B-EdgeRazor-2.79bit
Text Generation
•
0.6B
•
Updated
5 days ago
•
393
zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.88bit
Text Generation
•
0.6B
•
Updated
5 days ago
•
376
zhangsq-nju/Qwen3-0.6B-EdgeRazor-1.58bit
Text Generation
•
0.6B
•
Updated
5 days ago
•
385
zhangsq-nju/Qwen3-1.7B-EdgeRazor-4bit
Text Generation
•
2B
•
Updated
5 days ago
•
34
zhangsq-nju/Qwen3-1.7B-EdgeRazor-2.79bit
Text Generation
•
2B
•
Updated
5 days ago
•
340
zhangsq-nju/Qwen3-1.7B-EdgeRazor-1.88bit
Text Generation
•
2B
•
Updated
5 days ago
•
327
Previous
1
...
35
36
37
38
39
40
Next