RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 download history

RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 is an 8.0B-parameter text generation model by RedHatAI. In the last 30 days it was downloaded 47,749 times (7,574 in the last 7 days), and 1,727,397 times in total.

It ranks #3,888 on the Hub by monthly downloads and #872 among text generation models.

It has 30 likes.

It is a quantization of meta-llama/Llama-3.1-8B-Instruct.

Open RedHatAI/Meta-Llama-3.1-8B-Instruct-quantized.w4a16 on Hugging Face