Aratako/iterative-dpo-data-for-ORPO-iter3 download history

Aratako/iterative-dpo-data-for-ORPO-iter3 is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 31 times (6 in the last 7 days), and 893 times in total. It ranks #376,003 among datasets by monthly downloads.

iterative-dpo-data-for-ORPO-iter3 概要 合成instructionデータであるAratako/Self-Instruct-Qwen2.5-72B-Instruct-60kを元に以下のような手順で作成した日本語Preferenceデータセットです。 開発途中のモデルであるAratako/Llama-Gemma-2-27b-CPO_SimPO-iter2を用いて、temperature=1で回答を5回生成 5個の回答それぞれに対して、Qwen/Qwen2.5-72B-Instruct-GPTQ-Int8

Models trained on iterative-dpo-data-for-ORPO-iter3

1 models list it as training data.

Open Aratako/iterative-dpo-data-for-ORPO-iter3 on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.