ikedachin/CC-news-2024-October-cleaned-cpt-set-250127 download history

ikedachin/CC-news-2024-October-cleaned-cpt-set-250127 is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 29 times (9 in the last 7 days), and 1,859 times in total. It ranks #391,467 among datasets by monthly downloads.

kajuma/CC-news-2024-July-October-cleanedを元に、9月、10月のニュースのみを抜き出したデータセット。 テキストの前にニュースの日付を追加 継続事前学習用 outputトークン数を1024と想定。効率よく学習するために約1000tokensに調整(使用tokenizerはllm-jp/llm-jp-3-13b)

Models trained on CC-news-2024-October-cleaned-cpt-set-250127

1 models list it as training data.

Open ikedachin/CC-news-2024-October-cleaned-cpt-set-250127 on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.