parameterlab/scaling_mia_the_pile_00_arxiv download history

parameterlab/scaling_mia_the_pile_00_arxiv is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 86 times (11 in the last 7 days), and 3,976 times in total. It ranks #126,755 among datasets by monthly downloads.

This dataset includes all arxiv documents from the 00.jsonl.zst partition of The Pile. It was created with this script: pile_path = "data/the_pile/train/00.jsonl.zst" with zstd.open(pile_path, 'r') as fr: with open("/tmp/arxiv.jsonl", "w") as fw: for i, line in enumerate(tqdm(fr)):

Open parameterlab/scaling_mia_the_pile_00_arxiv on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.