gmongaras/Pile_Llama_Tokenized download history

gmongaras/Pile_Llama_Tokenized is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 9 times (1 in the last 7 days), and 154 times in total. It ranks #601,102 among datasets by monthly downloads.

Tokenized dataset from https://huggingface.co/datasets/gmongaras/EleutherAI_the_pile_deduplicated Using the llama tokenizer from https://huggingface.co/meta-llama/Llama-2-7b-hf which can be loaded with transformers.AutoTokenizer.from_pretrained("meta-llama/Llama-2-7b-hf") Original Pile repo: https:/

Open gmongaras/Pile_Llama_Tokenized on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.