Quantized GGUFs for rf-detr.cpp
mudler PRO
mudler
AI & ML interests
APEX quants, LocalAI Creator ( https://localai.io )
Website: https://mudler.pm, llama.cpp fan
Recent Activity
new activity about 10 hours ago
mudler/LFM2.5-8B-A1B-APEX-GGUF:Update the chat_template updated a model about 11 hours ago
mudler/LFM2.5-8B-A1B-APEX-GGUF updated a model about 13 hours ago
mudler/Agents-A1-APEX-GGUFOrganizations
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 15 • 9 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 14 • -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 8 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 12 • 10
Models quantized for LocalAI and llama.cpp
Datasets that I like or I find particularly useful
Quantized GGUFs for rf-detr.cpp
MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant )
Fine-tuned models for LocalAI finetuned by me
-
LocalAI-io/LocalAI-functioncall-phi-4-v0.3
Text Generation • Updated • 15 • 9 -
LocalAI-io/LocalAI-functioncall-llama3.2-1b-v0.4
Text Generation • 1B • Updated • 14 • -
LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1
Text Generation • 8B • Updated • 8 • 1 -
LocalAI-io/LocalAI-Llama3-8b-Function-Call-v0.2
Text Generation • 8B • Updated • 12 • 10
Italian Models fine-tuned by me
Models quantized for LocalAI and llama.cpp
A set of generalist model that are particularly good at function calling with LocalAI
Datasets that I like or I find particularly useful