QuantLLM/functiongemma-270m-it-4bit-mlx
Text Generation
•
0.3B
•
Updated
•
17
QuantLLM
non-profit
AI & ML interests
QuantLLM is an open-source community exploring AI and ML through practical models and real-world applications.
Organization Card
QuantLLM | The Ultra-Fast LLM Quantization
Welcome to QuantLLM — an open-source community focused on building efficient and accessible AI models. This space hosts our quantized and fine-tuned transformer models, designed for real-world applications and ease of deployment.
models
9
QuantLLM/functiongemma-270m-it-4bit-gguf
0.3B
•
Updated
•
6
QuantLLM/functiongemma-270m-it-8bit-gguf
0.3B
•
Updated
•
3
•
1
QuantLLM/Llama-3.2-3B-2bit-gguf
3B
•
Updated
•
7
QuantLLM/Llama-3.2-3B-5bit-gguf
3B
•
Updated
•
4
QuantLLM/Llama-3.2-3B-5bit-mlx
Text Generation
•
3B
•
Updated
•
15
QuantLLM/Llama-3.2-3B-8bit-mlx
Text Generation
•
3B
•
Updated
•
29
QuantLLM/Llama-3.2-3B-2bit-mlx
Text Generation
•
3B
•
Updated
•
8
QuantLLM/Llama-3.2-3B-4bit-mlx
Text Generation
•
3B
•
Updated
•
14
datasets
0
None public yet