pratikgx/mistral-large-4-1t-m5-pro-mac-mini-bench download history

pratikgx/mistral-large-4-1t-m5-pro-mac-mini-bench is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 69 times (69 in the last 7 days), and 69 times in total. It ranks #177,352 among datasets by monthly downloads.

Mistral Large 4 (1T) on a 64GB Mac mini: quick speed benchmark Headline: a 1 trillion parameter model (52B active) runs on a 64GB M5 Pro Mac mini by streaming the experts straight off the SSD. It works, but it's slow: about 3.0 tok/s prefill, 0.35 tok/s decode, and about 150s to first

Open pratikgx/mistral-large-4-1t-m5-pro-mac-mini-bench on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.