AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B download history
AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 75 times (75 in the last 7 days), and 75 times in total. It ranks #188,946 among datasets by monthly downloads.
Stretch32K Data (TinyLlama 1.1B) Data used to stretch TinyLlama/TinyLlama_v1.1 from 2048 to 16384 tokens of context. ConfigRowsWhat it holds pg19_16384600Packed chunks of 16384 token ids from PG19 train books, shared by every continued pretraining model (9,830,400 tokens) longalpaca_
Models trained on Stretch32K_Data_TinyLlama_1.1B
4 models list it as training data.
- AmareshHebbar/Stretch32K_TinyLlama_1.1B_PI 103 downloads in 30 days
- AmareshHebbar/Stretch32K_TinyLlama_1.1B_YARN 98 downloads in 30 days
- AmareshHebbar/Stretch32K_TinyLlama_1.1B_SFT 96 downloads in 30 days
- AmareshHebbar/Stretch32K_TinyLlama_1.1B_YARN_LONGLORA 89 downloads in 30 days
Open AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.