overthelex/tokenizer-fertility-map download history
overthelex/tokenizer-fertility-map is a text classification dataset on the Hugging Face Hub. In the last 30 days it was downloaded 51 times (18 in the last 7 days), and 284 times in total. It ranks #182,934 among datasets by monthly downloads.
Tokenizer Fertility Map Paper: The Tokenizer Tax Across 25 European Languages: Domain Invariance, Cross-Lingual Few-Shot Effects, and the Ukrainian Penalty Cross-model tokenizer fertility measurements for Ukrainian legal text and subword analysis. Description Fertility
Open overthelex/tokenizer-fertility-map on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.