RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 download history

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 is a 23.6B-parameter text generation model by RedHatAI. In the last 30 days it was downloaded 3,659 times (923 in the last 7 days), and 160,451 times in total.

It ranks #13,908 on the Hub by monthly downloads and #3,568 among text generation models.

It has 2 likes.

It is a quantization of mistralai/Mistral-Small-24B-Instruct-2501.

Open RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w8a8 on Hugging Face