jihuny/fineweb-100bt-tokenized download history
jihuny/fineweb-100bt-tokenized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 16 times (4 in the last 7 days), and 294 times in total. It ranks #538,428 among datasets by monthly downloads.
FineWeb 100BT Tokenized This repository contains tokenized FineWeb 100BT binary data used by the sf-muon training code. Files are stored under fineweb-100BT/. train.bin is split into 18 GiB parts to keep each Hub file manageable: cat fineweb-100BT/train.bin.part-* > fineweb-100BT/trai
Open jihuny/fineweb-100bt-tokenized on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.