cerulean-works/fineweb-edu-dev download history

cerulean-works/fineweb-edu-dev is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 142 times (34 in the last 7 days), and 142 times in total. It ranks #115,651 among datasets by monthly downloads.

FineWeb-Edu dev set The evaluation set of the cycle 3 lab ("predictable scaling"): 5000 documents of FineWeb-Edu (Penedo et al. 2024, arXiv 2406.17557). flock eval's fineweb_edu task scores it whole, in windows of 8192 tokens, and reports perplexity, loss per token and bits per byte.

Open cerulean-works/fineweb-edu-dev on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.