RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 download history

RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 is a 70.6B-parameter text generation model by RedHatAI. In the last 30 days it was downloaded 9,139 times (2,202 in the last 7 days), and 1,894,538 times in total.

It ranks #8,482 on the Hub by monthly downloads and #2,008 among text generation models.

It has 33 likes.

It is a quantization of meta-llama/Llama-3.1-70B-Instruct.

Open RedHatAI/Meta-Llama-3.1-70B-Instruct-quantized.w4a16 on Hugging Face