mlx-community/fineweb-edu-100K download history

mlx-community/fineweb-edu-100K is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 65 times (11 in the last 7 days), and 338 times in total. It ranks #212,091 among datasets by monthly downloads.

Code used to create this: import json from itertools import islice from datasets import load_dataset from tqdm import tqdm DATASET_NAME = "HuggingFaceFW/fineweb-edu" DATASET_CONFIG = "sample-10BT" NUM_SAMPLES = 100_000 BATCH_SIZE = 5_000 OUTPUT_PATH = "pretrain_100k.jsonl" dataset = load_dataset

Models trained on fineweb-edu-100K

1 models list it as training data.

Open mlx-community/fineweb-edu-100K on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.