inference-optimization/sarvam-105b-FP8-Dynamic download history

inference-optimization/sarvam-105b-FP8-Dynamic is a 106.1B-parameter text generation model by inference-optimization. In the last 30 days it was downloaded 29 times (6 in the last 7 days), and 163 times in total.

It ranks #320,759 on the Hub by monthly downloads and #88,219 among text generation models.

It has 0 likes.

It is a quantization of sarvamai/sarvam-105b.

Open inference-optimization/sarvam-105b-FP8-Dynamic on Hugging Face