mimir-lcm/fineweb-2-sentence-split download history

mimir-lcm/fineweb-2-sentence-split is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 6,378 times (1,466 in the last 7 days), and 28,330 times in total. It ranks #4,610 among datasets by monthly downloads.

Fineweb 2 split into sentences. Instances per languages were sampled by us to balance the data w.r.t. Fineweb-edu. To split the text into sentences we used the sat3-l model from the wtpsplit library. We fix a sentence threshold of 0.02 and a maximum sentence length of 256. If you use this dataset,

Models trained on fineweb-2-sentence-split

1 models list it as training data.

Spaces using fineweb-2-sentence-split

Open mimir-lcm/fineweb-2-sentence-split on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.