arcee-ai/OpenHermes2.5-dpo-binarized-alpha download history

arcee-ai/OpenHermes2.5-dpo-binarized-alpha is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 28 times (7 in the last 7 days), and 860 times in total. It ranks #399,493 among datasets by monthly downloads.

OpenHermes-2.5-DPO-binarized-alpha A DPO dataset built with distilabel atop the awesome OpenHermes-2.5 dataset. This is an alpha version with a small sample to collect feedback from the community. It follows a fully OSS approach, using PairRM for preference selection instead of OpenAI models. Refere

Open arcee-ai/OpenHermes2.5-dpo-binarized-alpha on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.