fineweb-retrieval/fineweb-edu-emb download history

fineweb-retrieval/fineweb-edu-emb is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,124 times (116 in the last 7 days), and 12,751 times in total. It ranks #17,686 among datasets by monthly downloads.

This file contains the embeddings for the full fineweb-edu dataset. The dataset has been deduplicated (using only exact deduplication). The emb folder contains for each parquet file a new_{parquet_name}.npy and old_{parquet}.npy file. The old refers to text that has been seen in the smaller 10B/100B

Open fineweb-retrieval/fineweb-edu-emb on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.