procmarco/fpabl1-arm-a-web-tokens-48k download history

procmarco/fpabl1-arm-a-web-tokens-48k is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 17 times (7 in the last 7 days), and 183 times in total. It ranks #417,311 among datasets by monthly downloads.

fpabl1-arm-a-web-tokens-48k Pre-tokenized bins for the FinePhrase vs FineWeb ablation (fpabl1), arm fpabl1-a-web. Tokenizer: runs/mixed-tokenizer-48k/tokenizer (byte-BPE, 48k vocab; special ids bos=49119, eos=49120, pad=49121). Format: uint16 little-endian, 50 shards x 100,000,000 to

Open procmarco/fpabl1-arm-a-web-tokens-48k on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.