SpectraSuite/SlimPajama_300B download history
SpectraSuite/SlimPajama_300B is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 686 times (136 in the last 7 days), and 7,047 times in total. It ranks #25,784 among datasets by monthly downloads.
The SlimPajama_300B is a 300B token sample of de-duplicated Slim Pajama dataset tokenized using the EleutherAI/gpt-neox-20b tokenizer Due to file size constraints, C4 and CommonCrawl has been uploaded in multiple chunks, you can use the following commands to merge them back into a single file: cat C