CausalNLP/clt-tokenized-control-ar-zh-ko-ja-100m download history

CausalNLP/clt-tokenized-control-ar-zh-ko-ja-100m is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 30 times (10 in the last 7 days), and 131 times in total. It ranks #273,959 among datasets by monthly downloads.

Balanced Arabic-Chinese-Korean-Japanese 4B-token training data Sequential FineWeb-2 documents tokenized with CausalNLP/gpt2-tokenizer-ar-zh-ko-ja. Each language contains at least 100,000,000 tokens in complete documents. Total target: 400,000,000 tokens. Approximately 100,000,000 toke

Open CausalNLP/clt-tokenized-control-ar-zh-ko-ja-100m on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.