toksuitebackup/tokenmonster-englishcode-32000-consistent-v1-toksuite-detokenized download history
toksuitebackup/tokenmonster-englishcode-32000-consistent-v1-toksuite-detokenized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 145 times (106 in the last 7 days), and 1,816 times in total. It ranks #86,468 among datasets by monthly downloads.
Training data of the model detokenized in the exact order seen by the model. The training data is partitioned into 8 chunks (chunk-0 through chunk-7), based on the GPU rank that generated the data. Each chunk contains detokenized text files in JSON Lines format (.jsonl).
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.