Mobile/Q4_0 supplementary GGUF quants of
Sao10K/Llama-3.1-8B-Stheno-v3.4for Lewdiculous/Llama-3.1-8B-Stheno-v3.4-GGUF-IQ-Imatrix.
- Downloads last month
- 33
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support