AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B download history

AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 75 times (75 in the last 7 days), and 75 times in total. It ranks #188,946 among datasets by monthly downloads.

Stretch32K Data (TinyLlama 1.1B) Data used to stretch TinyLlama/TinyLlama_v1.1 from 2048 to 16384 tokens of context. ConfigRowsWhat it holds pg19_16384600Packed chunks of 16384 token ids from PG19 train books, shared by every continued pretraining model (9,830,400 tokens) longalpaca_

Models trained on Stretch32K_Data_TinyLlama_1.1B

4 models list it as training data.

Open AmareshHebbar/Stretch32K_Data_TinyLlama_1.1B on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.