RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 download history

RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 is a 23.6B-parameter text generation model by RedHatAI. In the last 30 days it was downloaded 597 times (196 in the last 7 days), and 19,725 times in total.

It ranks #62,462 on the Hub by monthly downloads and #14,887 among text generation models.

It has 2 likes.

It is a quantization of mistralai/Mistral-Small-24B-Instruct-2501.

Open RedHatAI/Mistral-Small-24B-Instruct-2501-quantized.w4a16 on Hugging Face