MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
mudler
mudler
AI & ML interests
LocalAI Creator ( https://localai.io )
Website: https://mudler.pm
Recent Activity
updated a model about 1 hour ago
mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF published a model about 1 hour ago
mudler/gemma-4-26B-A4B-it-heretic-APEX-GGUF updated a model about 2 hours ago
mudler/Qwen3.5-35B-A3B-Claude-Distilled-APEX-GGUFOrganizations
Italian Models fine-tuned by me
A set of generalist model that are particularly good at function calling with LocalAI
Fine-tuned models for LocalAI finetuned by me
-
mudler/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 7 • 8 -
mudler/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 5 -
mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 3 • 1 -
mudler/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 8 • 10
Models quantized for LocalAI and llama.cpp
-
mudler/Minerva-3B-base-v1.0-Q8_0-GGUF
Text Generation • 3B • Updated • 8 • 1 -
mudler/Minerva-3B-Instruct-v1.0-Q8_0-GGUF
Text Generation • 3B • Updated • 6 -
mudler/Minerva-3B-base-v1.0-Q6_K-GGUF
Text Generation • 3B • Updated • 8 -
mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • 3B • Updated • 6
Datasets that I like or I find particularly useful
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
Fine-tuned models for LocalAI finetuned by me
-
mudler/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 7 • 8 -
mudler/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 5 -
mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 3 • 1 -
mudler/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 8 • 10
Italian Models fine-tuned by me
Models quantized for LocalAI and llama.cpp
-
mudler/Minerva-3B-base-v1.0-Q8_0-GGUF
Text Generation • 3B • Updated • 8 • 1 -
mudler/Minerva-3B-Instruct-v1.0-Q8_0-GGUF
Text Generation • 3B • Updated • 6 -
mudler/Minerva-3B-base-v1.0-Q6_K-GGUF
Text Generation • 3B • Updated • 8 -
mudler/Minerva-3B-Instruct-v1.0-Q6_K-GGUF
Text Generation • 3B • Updated • 6
A set of generalist model that are particularly good at function calling with LocalAI
Datasets that I like or I find particularly useful