RedHatAI
/

DeepSeek-R1-quantized.w4a16

Text Generation

Model card Files Files and versions

Resources

View closed (0)

Can you provide specific quantification methods and scripts?

#2 opened 10 months ago by

Does vllm 0.8.4 support this quantized model?

#1 opened 11 months ago by