GGUF-Models 's Collections 🔧Instruct
updated
Triangle104/UwU-7B-Instruct-abliterated-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 21
itlwas/Llama-SmolTalk-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
• 1B • Updated
• 1
• 1
itlwas/Falcon3-1B-Instruct-abliterated-Q4_K_M-GGUF
2B • Updated
• 18
itlwas/stable-code-instruct-3b-Q4_K_M-GGUF
3B • Updated
• 14
itlwas/FastLlama-3.2-1B-Instruct-Q4_K_M-GGUF
1B • Updated
• 17
itlwas/Falcon3-1B-Instruct-Q4_K_M-GGUF
2B • Updated
• 4
itlwas/Mistral-7B-Instruct-v0.2-Q4_K_M-GGUF
Text Generation
• 7B • Updated
• 19
itlwas/Mistral-Small-Instruct-2409-Q4_K_M-GGUF
22B • Updated
• 16
itlwas/granite-3b-code-instruct-128k-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 7
itlwas/granite-3b-code-instruct-2k-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 9
itlwas/granite-3.0-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation
• 1B • Updated
• 3
itlwas/granite-3.1-8b-instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 4
itlwas/granite-3.1-1b-a400m-instruct-Q4_K_M-GGUF
Text Generation
• 1B • Updated
• 3
itlwas/granite-3.1-3b-a800m-instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 3
itlwas/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 5
itlwas/Qwen2.5-Coder-32B-Instruct-Q4_K_M-GGUF
Text Generation
• 33B • Updated
• 11
itlwas/Qwen2.5-Coder-14B-Instruct-Q4_K_M-GGUF
Text Generation
• 15B • Updated
• 56
• 1
itlwas/Qwen2.5-Coder-3B-Instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 61
itlwas/Qwen2.5-Coder-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 12
itlwas/EuroLLM-1.7B-Instruct-Q4_K_M-GGUF
2B • Updated
• 7
itlwas/EuroLLM-9B-Instruct-Q4_K_M-GGUF
9B • Updated
• 7
itlwas/Llama-3.2-3B-Instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 18
itlwas/Llama-3.2-1B-Instruct-Q4_K_M-GGUF
Text Generation
• 1B • Updated
• 3
itlwas/Llama-3.1-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 9
itlwas/Vikhr-Qwen-2.5-1.5B-Instruct-Q4_K_M-GGUF
2B • Updated
• 52
• 1
itlwas/DeepSeek-Coder-V2-Lite-Instruct-Q4_K_M-GGUF
16B • Updated
• 19
itlwas/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
8B • Updated
• 8
itlwas/Mistral-7B-Instruct-v0.1-Q4_K_M-GGUF
Text Generation
• 7B • Updated
• 353
• 4
itlwas/Vikhr-Llama-3.2-1B-Instruct-abliterated-Q4_K_M-GGUF
1B • Updated
• 35
itlwas/Qwen2.5-Coder-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 0.5B • Updated
• 20
itlwas/Vikhr-Gemma-2B-instruct-Q4_K_M-GGUF
3B • Updated
• 112
• 1
itlwas/Vikhr-Qwen-2.5-0.5b-Instruct-Q4_K_M-GGUF
0.5B • Updated
• 17
itlwas/Vikhr-7B-instruct_0.2-Q4_K_M-GGUF
7B • Updated
• 9
itlwas/Mistral-Nemo-Instruct-2407-Q4_K_M-GGUF
12B • Updated
• 10
• 1
itlwas/Mixtral-8x7B-Instruct-v0.1-Q4_K_M-GGUF
47B • Updated
• 10
itlwas/SmolLM2-360M-Instruct-FT-Q4_K_M-GGUF
Text Generation
• 0.4B • Updated
• 17
itlwas/Qwen2.5-Coder-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 18
itlwas/deepseek-math-7b-instruct-Q4_K_M-GGUF
7B • Updated
• 13
itlwas/SmolLM2-360M-Instruct-Q4_K_M-GGUF
Text Generation
• 0.4B • Updated
• 23
Triangle104/UwU-7B-Instruct-abliterated-Q6_K-GGUF
Text Generation
• 8B • Updated
• 9
itlwas/SmolLM2-135M-Instruct-Q4_K_M-GGUF
Text Generation
• 0.1B • Updated
• 17
itlwas/SmolLM2-1.7B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 10
itlwas/SmolLM-135M-Instruct-Q4_K_M-GGUF
0.1B • Updated
• 17
itlwas/SmolLM-360M-Instruct-Q4_K_M-GGUF
0.4B • Updated
• 17
itlwas/SmolLM-1.7B-Instruct-Q4_K_M-GGUF
2B • Updated
• 12
itlwas/QwQ-LCoT-3B-Instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 7
itlwas/QwQ-LCoT-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 14
itlwas/neo_7b_instruct_v0.1-Q4_K_M-GGUF
8B • Updated
• 13
itlwas/OpenCoder-8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 8
itlwas/Falcon3-3B-Instruct-abliterated-Q4_K_M-GGUF
3B • Updated
• 22
itlwas/Falcon3-7B-Instruct-abliterated-Q4_K_M-GGUF
7B • Updated
• 9
itlwas/Vikhr-7B-instruct_0.4-Q4_K_M-GGUF
8B • Updated
• 112
itlwas/Falcon3-10B-Instruct-abliterated-Q4_K_M-GGUF
10B • Updated
• 11
itlwas/Qwen2.5-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 0.5B • Updated
• 35
itlwas/Qwen2.5-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 17
itlwas/Qwen2.5-3B-Instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 22
itlwas/Qwen2.5-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 6
itlwas/Qwen2.5-14B-Instruct-Q4_K_M-GGUF
Text Generation
• 15B • Updated
• 15
itlwas/Qwen2.5-32B-Instruct-Q4_K_M-GGUF
Text Generation
• 33B • Updated
• 9
itlwas/Qwen2-0.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 0.5B • Updated
• 7
itlwas/Qwen2-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 9
itlwas/Qwen2-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 7
itlwas/Qwen2-Math-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 20
itlwas/Qwen2-Math-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 9
itlwas/Qwen2.5-Math-1.5B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 10
itlwas/Qwen2.5-Math-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 7
itlwas/UwU-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 5
itlwas/OLMo-2-1124-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 7B • Updated
• 6
itlwas/OLMo-2-1124-13B-Instruct-Q4_K_M-GGUF
Text Generation
• 14B • Updated
• 7
itlwas/Phi-3.5-mini-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated
• 9
itlwas/Phi-3-mini-4k-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated
• 147
itlwas/Phi-3-mini-128k-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated
• 5
itlwas/Phi-3-medium-4k-instruct-Q4_K_M-GGUF
Text Generation
• 14B • Updated
• 26
itlwas/Phi-3-medium-128k-instruct-Q4_K_M-GGUF
Text Generation
• 14B • Updated
• 33
itlwas/Ahma-7B-Instruct-Q4_K_M-GGUF
Text Generation
• 7B • Updated
• 15
itlwas/Ahma-3B-Instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated
• 12
Triangle104/Llama-3.2-Nemotron-3B-Instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 5
Triangle104/internlm3-8b-instruct-Q4_K_M-GGUF
Text Generation
• 9B • Updated
• 17
Triangle104/internlm3-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
• 9B • Updated
• 6
itlwas/QVikhr-2.5-1.5B-Instruct-r-Q4_K_M-GGUF
2B • Updated
• 8
• 2
itlwas/QVikhr-2.5-1.5B-Instruct-SMPO-Q4_K_M-GGUF
2B • Updated
• 6
Triangle104/AceInstruct-1.5B-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 7
Triangle104/Deep-Reasoning-Llama-3.2-Instruct-uncensored-3B-Q4_K_M-GGUF
3B • Updated
• 33
Triangle104/granite-3.2-8b-instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 3
Triangle104/granite-3.2-2b-instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 4
itlwas/Vikhr-YandexGPT-5-Lite-8B-it-Q4_K_M-GGUF
8B • Updated
• 23
itlwas/EXAONE-3.5-2.4B-Instruct-Q4_K_M-GGUF
Text Generation
• 2B • Updated
• 12
itlwas/EXAONE-3.5-7.8B-Instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 2
itlwas/EXAONE-3.0-7.8B-Instruct-Q4_K_M-GGUF
8B • Updated
• 17
itlwas/YandexGPT-5-Lite-8B-instruct-Q4_K_M-GGUF
8B • Updated
• 21
itlwas/gemma-3-1b-it-Q4_K_M-GGUF
Text Generation
• 1.0B • Updated
• 9
itlwas/gemma-3-4b-it-Q4_K_M-GGUF
Image-Text-to-Text
• 4B • Updated
• 27
itlwas/gemma-3-12b-it-Q4_K_M-GGUF
Image-Text-to-Text
• 12B • Updated
• 4
itlwas/Phi-4-mini-instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated
• 51
itlwas/Llama-3.1-Nemotron-8B-UltraLong-2M-Instruct-Q4_K_M-GGUF
8B • Updated
• 3
itlwas/Llama-3.1-Nemotron-8B-UltraLong-1M-Instruct-Q4_K_M-GGUF
8B • Updated
• 13
itlwas/Llama-3.1-Nemotron-8B-UltraLong-4M-Instruct-Q4_K_M-GGUF
8B • Updated
• 2
• 1
itlwas/Nemotron-4-Mini-Hindi-4B-Instruct-Q4_K_M-GGUF
4B • Updated
• 13
itlwas/Nemotron-Mini-4B-Instruct-Q4_K_M-GGUF
Text Generation
• 4B • Updated
• 6
itlwas/Hiber-Multi-10B-Instruct-Q4_K_M-GGUF
Text Generation
• 11B • Updated
• 2
• 1
Triangle104/granite-3.3-2b-instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 17
Triangle104/granite-3.3-8b-instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 12
Triangle104/granite-3.1-2b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 4
Triangle104/granite-3.1-2b-instruct-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 8
Triangle104/granite-3.1-8b-instruct-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 3
Triangle104/granite-3.1-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 8
Triangle104/granite-3.2-2b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
• 3B • Updated
• 7
Triangle104/granite-3.2-8b-instruct-abliterated-Q4_K_M-GGUF
Text Generation
• 8B • Updated
• 1
Triangle104/InternVL3-1B-Instruct-Q4_K_M-GGUF
Image-Text-to-Text
• 0.6B • Updated
• 2
Triangle104/InternVL3-2B-Instruct-Q5_K_M-GGUF
Image-Text-to-Text
• 2B • Updated
• 10
Triangle104/InternVL3-8B-Instruct-Q4_K_M-GGUF
Image-Text-to-Text
• 8B • Updated
• 1
Triangle104/Mistral-Small-3.2-24B-Instruct-2506-Q4_K_M-GGUF
Image-Text-to-Text
• 24B • Updated
• 23