jsun/slimpajama_Llama2_Tokenizer download history

jsun/slimpajama_Llama2_Tokenizer is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,345 times (233 in the last 7 days), and 3,493 times in total. It ranks #15,467 among datasets by monthly downloads.

slimpajama_Llama2_Tokenizer The original slimpajama_Llama2_Tokenizer.tar.gz archive (≈794 GB on Ubuntu) was split into smaller 40 GB chunks for easier upload to Hugging Face. sudo apt install git-lfs pip install -U huggingface_hub # `hf version`==1.1.4 tar cvf - slimpajama_Llama2_Tokeniz

Open jsun/slimpajama_Llama2_Tokenizer on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.