Ba2han/long_corpus-0209_tokenized download history

Ba2han/long_corpus-0209_tokenized is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 174 times (21 in the last 7 days), and 243 times in total. It ranks #75,195 among datasets by monthly downloads.

long_corpus-0209_tokenized Exact-deduplicated, tokenized, and shuffled pretraining mix. Processing Tokenizer: /workspace/good_tokenizer (vocab_size=60800) Special tokens: BOS=<bos> (id 2), EOS=<eos> (id 3) bos_eos = True: every example is [BOS] + content + [EOS] min_to

Open Ba2han/long_corpus-0209_tokenized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.