lucadiliello/wikipedia_512_pretraining download history

lucadiliello/wikipedia_512_pretraining is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 297 times (66 in the last 7 days), and 30,550 times in total. It ranks #49,535 among datasets by monthly downloads.

Dataset Card for "wikipedia_512_pretraining" Wikipedia preprocessed for pretraining of models. Each sample in the dataset has an average tokenized length of 512 RoBERTa-Base tokens.

Models trained on wikipedia_512_pretraining

3 models list it as training data.

Open lucadiliello/wikipedia_512_pretraining on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.