Malikeh1375/code-switching-tokenizer-robustness download history
Malikeh1375/code-switching-tokenizer-robustness is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 202 times (19 in the last 7 days), and 5,924 times in total. It ranks #67,481 among datasets by monthly downloads.
Code-Switching Dataset for Tokenizer Robustness Analysis Dataset Description This dataset is designed for tokenizer robustness testing in multilingual and code-switching contexts. It contains identical content expressed across 16 different language variants, including pure Engl
Open Malikeh1375/code-switching-tokenizer-robustness on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.