malaysia-ai/mosaic-dedup-text-dataset download history

malaysia-ai/mosaic-dedup-text-dataset is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 400 times (381 in the last 7 days), and 6,041 times in total. It ranks #39,406 among datasets by monthly downloads.

Mosaic format for dedup text dataset to train Malaysian LLM This repository is to store dataset shards using mosaic format. prepared at https://github.com/malaysia-ai/dedup-text-dataset/blob/main/pretrain-llm/combine-dedup-text-dataset-4096.ipynb using tokenizer https://huggingface.co/ma

Open malaysia-ai/mosaic-dedup-text-dataset on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.