jsun/fineweb-edu_default_Llama2_Tokenizer download history

jsun/fineweb-edu_default_Llama2_Tokenizer is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,900 times (244 in the last 7 days), and 4,516 times in total. It ranks #11,749 among datasets by monthly downloads.

fineweb-edu_default_Llama2_Tokenizer The original fineweb-edu_default_Llama2_Tokenizer.tar.gz archive (≈1.9T on Ubuntu) was split into smaller 40 GB chunks for easier upload to Hugging Face. sudo apt install git-lfs pip install -U huggingface_hub # `hf version`==1.1.4 tar cvf - fineweb-e

Open jsun/fineweb-edu_default_Llama2_Tokenizer on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.