DKYoon/SlimPajama-6B download history

DKYoon/SlimPajama-6B is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 12,114 times (2,991 in the last 7 days), and 345,880 times in total. It ranks #2,549 among datasets by monthly downloads.

Sampled version of cerebras/SlimPajama-627B. Since the original data was shuffled before chunking, I only downloaded train/chunk1 (of 10 total) and further sampled 10%. This should result in roughly 6B tokens, hence SlimPajama-6B. The dataset is 24GBs in storage size when decompressed (original data

Models trained on SlimPajama-6B

6 models list it as training data.

Spaces using SlimPajama-6B

Open DKYoon/SlimPajama-6B on Hugging Face