inference-optimization/sarvam-30b-FP8-Dynamic download history

inference-optimization/sarvam-30b-FP8-Dynamic is a 32.2B-parameter text generation model by inference-optimization. In the last 30 days it was downloaded 22 times (4 in the last 7 days), and 266 times in total.

It ranks #383,731 on the Hub by monthly downloads and #112,357 among text generation models.

It has 1 likes.

It is a quantization of sarvamai/sarvam-30b.

Open inference-optimization/sarvam-30b-FP8-Dynamic on Hugging Face