takara-ai/micropajama download history

takara-ai/micropajama is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 23 times (4 in the last 7 days), and 596 times in total. It ranks #444,312 among datasets by monthly downloads.

From the Frontier Research Team at Takara.ai, we present MicroPajama — a dataset made for distillation and feature extraction without wikipedia from the larger SlimPajama. This dataset contains 253,636,240 tokens using the BAAI/bge-large-en-v1.5 wordpiece tokenizer, you can reproduce this resul

Models trained on micropajama

1 models list it as training data.

Open takara-ai/micropajama on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.