Technical support for the SmallDoges series models.
AI & ML interests
A Family of Dynamic UltraFast Small Language Models Ready for Embodied Artificial General Intelligence!
Organization Card
SmallDoge
Welcome to SmallDoge, where we pioneer the development of compact, high-performance small language models. Our focus is on creating ultra-fast SLMs using innovative dynamic algorithms. Committed to transparency and collaboration, all our training details and code are openly accessible on the SmallDoge GitHub repository.
Our Mission: To democratize access to advanced AI by developing efficient, open-source small language models that empower a wide range of applications and research.
Join our community on Discord!
Explore Our Projects
We offer a suite of resources and models:
- Small-Doges: A versatile series of SLMs, including pre-trained base models, supervised fine-tuned models, and models enhanced with reinforcement learning.
- Doge-CheckPoints: A collection of model checkpoints designed for seamless continued training on new datasets, ensuring smoother adaptation and minimizing training instability.
- Small-Datasets: Curated, multi-stage, high-quality datasets specifically engineered to effectively train small language models, boosting their capabilities and helpfulness.
- Doge-Downstream-Applications: A selection of SLMs optimized for various downstream tasks and real-world applications.
Doge family of small language models!
-
SmallDoge/Doge-320M-Instruct
Question Answering • 0.3B • Updated • 15 • 4 -
SmallDoge/Doge-160M-Instruct
Question Answering • 0.2B • Updated • 98 • 12 -
SmallDoge/Doge-120M-MoE-Instruct
Question Answering • 0.1B • Updated • 11 • 1 -
SmallDoge/Doge-60M-Instruct
Question Answering • 54.6M • Updated • 125 • 6
Technical support for the SmallDoges series models.
Doge family of small language models!
-
SmallDoge/Doge-320M-Instruct
Question Answering • 0.3B • Updated • 15 • 4 -
SmallDoge/Doge-160M-Instruct
Question Answering • 0.2B • Updated • 98 • 12 -
SmallDoge/Doge-120M-MoE-Instruct
Question Answering • 0.1B • Updated • 11 • 1 -
SmallDoge/Doge-60M-Instruct
Question Answering • 54.6M • Updated • 125 • 6
models 107
SmallDoge/Doge-260M
Text Generation • 0.3B • Updated • 9
SmallDoge/Doge-4B-MoE-checkpoint
Updated
SmallDoge/Doge-1.6B-MoE-checkpoint
Updated
SmallDoge/Doge-2B-checkpoint
Updated
SmallDoge/Doge-0.6B-checkpoint
Updated
SmallDoge/Doge-40M-MoE-checkpoint
Text Generation • 45M • Updated • 6
SmallDoge/Doge-40M-checkpoint
Text Generation • 40.7M • Updated • 4
SmallDoge/Doge-40M-MoE
Text Generation • 45M • Updated • 6
SmallDoge/Doge-40M
Text Generation • 40.7M • Updated • 7
SmallDoge/Doge-tokenizer
Updated • 1
datasets 42
SmallDoge/niah
Viewer • Updated • 8 • 43
SmallDoge/SmallCorpus
Viewer • Updated • 653M • 2.75k • 8
SmallDoge/reasoning-zh-try-run
Viewer • Updated • 54 • 12
SmallDoge/Doge
Viewer • Updated • 16M • 397
SmallDoge/Qwen3-Short-Reasoning
Viewer • Updated • 24.9k • 7
SmallDoge/Qwen3-Long-Reasoning
Viewer • Updated • 24.9k • 8
SmallDoge/Thoughts-Long-25k-try-run
Viewer • Updated • 2 • 23
SmallDoge/SmallThoughts
Viewer • Updated • 102k • 286 • 47
SmallDoge/stack-edu
Viewer • Updated • 26M • 439
SmallDoge/CDMoE_dataset
Viewer • Updated • 40M • 214