cerulean-works/fineweb-edu-dev download history
cerulean-works/fineweb-edu-dev is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 142 times (34 in the last 7 days), and 142 times in total. It ranks #115,651 among datasets by monthly downloads.
FineWeb-Edu dev set The evaluation set of the cycle 3 lab ("predictable scaling"): 5000 documents of FineWeb-Edu (Penedo et al. 2024, arXiv 2406.17557). flock eval's fineweb_edu task scores it whole, in windows of 8192 tokens, and reports perplexity, loss per token and bits per byte.
Open cerulean-works/fineweb-edu-dev on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.