Inference Optimization

inference-optimization's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Articles

MeganEFlynn 

updated a dataset about 11 hours ago

inference-optimization/Gemma4-Responses-Nemotron

Viewer • Updated about 11 hours ago • 762k • 5 • 1

MeganEFlynn 

published a dataset about 11 hours ago

inference-optimization/Gemma4-Responses-Nemotron

Viewer • Updated about 11 hours ago • 762k • 5 • 1

ChibuUkachi 

updated a model 1 day ago

inference-optimization/Ministral-3-14B-Instruct-2512-NVFP4

Text Generation • Updated 1 day ago • 163

ChibuUkachi 

updated a model 2 days ago

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated 2 days ago • 63

ChibuUkachi 

published a model 2 days ago

inference-optimization/ctest-Qwen3.5-9B-subset-397-speculator.dflash

2B • Updated 2 days ago • 63

ChibuUkachi 

updated 2 models 2 days ago

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w4a16

Text Generation • 32B • Updated 2 days ago • 162

inference-optimization/Qwen3-235B-A22B-Thinking-2507-quantized.w8a8

Text Generation • 235B • Updated 2 days ago • 155

alexmarques 

updated a model 2 days ago

RedHatAI/Qwen3-235B-A22B-Instruct-2507-quantized.w8a8

Text Generation • 235B • Updated 2 days ago • 83

ChibuUkachi 

updated a model 2 days ago

inference-optimization/Qwen3-235B-A22B-Instruct-2507-quantized.w4a16

Text Generation • 32B • Updated 2 days ago • 140

ChibuUkachi 

updated a model 2 days ago

RedHatAI/Qwen3-235B-A22B-Instruct-2507-quantized.w8a8

Text Generation • 235B • Updated 2 days ago • 83

MeganEFlynn 

updated a dataset 2 days ago

inference-optimization/Longbench_Samples_Specdec

Viewer • Updated 2 days ago • 160 • 35

krishnateja95 

updated 9 models 3 days ago

inference-optimization/Qwen3.6-35B-A3B-7.0-bits-mode-noise

Image-Text-to-Text • 32B • Updated 3 days ago • 128

inference-optimization/Qwen3.6-35B-A3B-7.0-bits-mode-hybrid

Image-Text-to-Text • 32B • Updated 3 days ago • 124

inference-optimization/Qwen3.6-35B-A3B-7.0-bits-mode-heuristic

Image-Text-to-Text • 32B • Updated 3 days ago • 154

inference-optimization/Qwen3.6-35B-A3B-6.5-bits-mode-noise

Image-Text-to-Text • 30B • Updated 3 days ago • 129

inference-optimization/Qwen3.6-35B-A3B-6.5-bits-mode-hybrid

Image-Text-to-Text • 30B • Updated 3 days ago • 114

inference-optimization/Qwen3.6-35B-A3B-6.5-bits-mode-heuristic

Image-Text-to-Text • 30B • Updated 3 days ago • 106

inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-noise

Image-Text-to-Text • 28B • Updated 3 days ago • 111

inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-hybrid

Image-Text-to-Text • 28B • Updated 3 days ago • 287

inference-optimization/Qwen3.6-35B-A3B-6.0-bits-mode-heuristic

Image-Text-to-Text • 28B • Updated 3 days ago • 117