mlx-community/fineweb-edu-100K download history
mlx-community/fineweb-edu-100K is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 65 times (11 in the last 7 days), and 338 times in total. It ranks #212,091 among datasets by monthly downloads.
Code used to create this: import json from itertools import islice from datasets import load_dataset from tqdm import tqdm DATASET_NAME = "HuggingFaceFW/fineweb-edu" DATASET_CONFIG = "sample-10BT" NUM_SAMPLES = 100_000 BATCH_SIZE = 5_000 OUTPUT_PATH = "pretrain_100k.jsonl" dataset = load_dataset
Models trained on fineweb-edu-100K
1 models list it as training data.
- Goekdeniz-Guelmez/Omoikane-50M-PoC 98 downloads in 30 days
Open mlx-community/fineweb-edu-100K on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.