floatai/TKEval download history
floatai/TKEval is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,975 times (8 in the last 7 days), and 6,604 times in total. It ranks #8,405 among datasets by monthly downloads.
Dataset Card for TKEval Contents Dataset Description Dataset Structure Dataset Splits Citation Dataset Description The curse of tokenization: Language models typically tokenize raw text into sequences of subword identifiers from a predefined vocabulary, a process i