parameterlab/scaling_mia_the_pile_00_wiki download history

parameterlab/scaling_mia_the_pile_00_wiki is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 81 times (18 in the last 7 days), and 1,717 times in total. It ranks #132,316 among datasets by monthly downloads.

This dataset includes all Wikipedia documents from the 00.jsonl.zst partition of The Pile. It was created with this script: pile_path = "data/the_pile/train/00.jsonl.zst" with zstd.open(pile_path, 'r') as fr: with open("/tmp/wiki.jsonl", "w") as fw: for i, line in enumerate(tqdm(fr)):

Open parameterlab/scaling_mia_the_pile_00_wiki on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.