adamo1139/toxic-dpo-natural-v5 download history

adamo1139/toxic-dpo-natural-v5 is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 45 times (25 in the last 7 days), and 1,959 times in total. It ranks #289,003 among datasets by monthly downloads.

I mixed in toxid-dpo-natural-v4 and rawrr v2-1 stage 2 with chosen field from original no_robots and got myself toxic-dpo-natural-v5. Goal is to avoid overfitting via DPO to a specific type of instruct, and instead just DPO the model to be more open to answering and also answer like a human being. W

Models trained on toxic-dpo-natural-v5

4 models list it as training data.

Open adamo1139/toxic-dpo-natural-v5 on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.