malaysia-ai/mosaic-dedup-text-dataset-filtered download history

malaysia-ai/mosaic-dedup-text-dataset-filtered is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 504 times (456 in the last 7 days), and 4,520 times in total. It ranks #32,940 among datasets by monthly downloads.

Mosaic format for filtered dedup text dataset to train Malaysian LLM This repository is to store dataset shards using mosaic format. prepared at https://github.com/malaysia-ai/dedup-text-dataset/blob/main/pretrain-llm/combine-dedup-text-dataset-filtered-4096.ipynb using tokenizer https:/

Open malaysia-ai/mosaic-dedup-text-dataset-filtered on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.