snimu/finemath-4plus-tiktokenized download history

snimu/finemath-4plus-tiktokenized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 290 times (36 in the last 7 days), and 5,672 times in total. It ranks #50,437 among datasets by monthly downloads.

snimu/finemath-4plus-tiktokenized This dataset contains GPT-2 tokenized shards of the FineWeb-4plus dataset. Each shard is stored in a binary format with the following structure: First comes a header with 256 int32s The tokens follow, each as uint16 (GPT-2 format) The first shard is the

Open snimu/finemath-4plus-tiktokenized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.