AmanPriyanshu/stratified-kmeans-diverse-pretraining-100K-1M download history

AmanPriyanshu/stratified-kmeans-diverse-pretraining-100K-1M is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 324 times (9 in the last 7 days), and 4,946 times in total. It ranks #46,485 among datasets by monthly downloads.

Stratified K-Means Diverse Pre-Training Dataset (100K-1M) A carefully balanced subset combining FineWeb-Edu and Proof-Pile-2, featuring embedding-based k-means sampling to ensure diverse representation across educational and mathematical/scientific content at multiple scales.

Open AmanPriyanshu/stratified-kmeans-diverse-pretraining-100K-1M on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.