Arkhiveus/unaligner1K_DPO download history
Arkhiveus/unaligner1K_DPO is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 6 times (1 in the last 7 days), and 366 times in total. It ranks #810,702 among datasets by monthly downloads.
DPO only version of unaligner1K A consolidated and cleaned dataset created from toxic-dpo-v0.2, orthogonal-activation-steering-TOXIC, ToxicQAFinal. The datasets were sorted using Llama-Guard-2 and then randomly sampled. New rejections were generated by Llama-3-8B-Instruct, while new c
Open Arkhiveus/unaligner1K_DPO on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.