RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 download history

RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 is a 70.6B-parameter text generation model by RedHatAI. In the last 30 days it was downloaded 674 times (175 in the last 7 days), and 51,989 times in total.

It ranks #56,337 on the Hub by monthly downloads and #13,488 among text generation models.

It has 6 likes.

It is a quantization of deepseek-ai/DeepSeek-R1-Distill-Llama-70B.

Open RedHatAI/DeepSeek-R1-Distill-Llama-70B-quantized.w4a16 on Hugging Face