jihuny/fineweb-100bt-tokenized download history

jihuny/fineweb-100bt-tokenized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 16 times (4 in the last 7 days), and 294 times in total. It ranks #538,428 among datasets by monthly downloads.

FineWeb 100BT Tokenized This repository contains tokenized FineWeb 100BT binary data used by the sf-muon training code. Files are stored under fineweb-100BT/. train.bin is split into 18 GiB parts to keep each Hub file manageable: cat fineweb-100BT/train.bin.part-* > fineweb-100BT/trai

Open jihuny/fineweb-100bt-tokenized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.