alexkstern/github-code-nanochatbpe-1B download history
alexkstern/github-code-nanochatbpe-1B is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 62 times (9 in the last 7 days), and 822 times in total. It ranks #160,836 among datasets by monthly downloads.
github-code-nanochatbpe-1B GitHub Code (all-all) (from codeparrot/github-code), pre-tokenized with the nanochatbpe tokenizer (vocab 65,536) and packaged as flat uint16 token-id .bin files for fast memmap training. file split tokens train.bin train 1,000,000,000 val.bin va
Open alexkstern/github-code-nanochatbpe-1B on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.