jakeatx/mode-biased-MTP download history
jakeatx/mode-biased-MTP is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 70 times (5 in the last 7 days), and 70 times in total. It ranks #199,574 among datasets by monthly downloads.
Mode-biased MTP: paired accuracy and speed results This dataset holds the paired results behind mode-biased multi-token prediction (mb-MTP): a way to run MTP speculative decoding that finishes answers sooner. In our paired tests, mb-MTP cut total time per answer by about 10% overall (
Open jakeatx/mode-biased-MTP on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.