inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-hybrid
Image-Text-to-Text • 28B • Updated • 101
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/Gemma4_SWA_DFLASH
4B • Updated • 79
inference-optimization/DSV4-tiny-empty
3B • Updated • 1.76k
inference-optimization/final-ctest-Qwen3-8B-speculator.dflash
2B • Updated • 5
inference-optimization/qwen3-8b-peagle-speculators
Updated
inference-optimization/peagle-gemma4
2B • Updated
inference-optimization/ctest-Qwen3.5-9B-speculator.dflash
2B • Updated • 3
inference-optimization/MiniMax-M2.5-BF16
Text Generation • 229B • Updated • 36
inference-optimization/ctest-Qwen3-8B-speculator.dflash
2B • Updated • 6
inference-optimization/DeepSeek-V4-Flash-bf16-NVFP4-FP8-BLOCK
Updated
inference-optimization/DeepSeek-V4-Flash-bf16
Updated
inference-optimization/DeepSeek-V4-Flash-5layers-nvfp4moe
20B • Updated • 13
inference-optimization/DeepSeek-V4-Flash-bf16-dequantized-5layers
34B • Updated • 3
inference-optimization/Qwen3.6-35B-A3B-NVFP4
Updated • 5
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-gptq
2B • Updated • 2
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-w4a16-qmod
2B • Updated • 2
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-qmod
5B • Updated • 1
inference-optimization/Meta-Llama-3-8B-Instruct-spinquantR1R2R4-nvfp4-gptq
5B • Updated • 1
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-gptq
2B • Updated • 1
inference-optimization/Llama-3.1-8B-Instruct-quip-w4a16-qmod
2B • Updated • 1
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-qmod
5B • Updated • 1
inference-optimization/Llama-3.1-8B-Instruct-quip-nvfp4-gptq
5B • Updated • 1
inference-optimization/Meta-Llama-3-8B-Instruct-W4A16_actorder_group
2B • Updated • 2
inference-optimization/llama3-8b-sharegpt-5k-gen
Updated
inference-optimization/Llama-3.2-3B-Instruct-FP8-Block
3B • Updated • 2
inference-optimization/Llama-3.2-1B-Instruct-FP8-Block
1B • Updated • 2
inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt5-speculator.eagle3
0.9B • Updated • 4
inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt4-speculator.eagle3
0.9B • Updated • 4 • 1
inference-optimization/gpt-oss-120b-from-qwen235b-then-self-ckpt3-speculator.eagle3
0.9B • Updated • 4
inference-optimization/gpt-oss-120b-from-self-ckpt5-speculator.eagle3
0.9B • Updated • 8