allenai/tulu-2.5-preference-data download history

allenai/tulu-2.5-preference-data is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 1,367 times (87 in the last 7 days), and 30,075 times in total. It ranks #15,275 among datasets by monthly downloads.

Tulu 2.5 Preference Data This dataset contains the preference dataset splits used to train the models described in Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback. We cleaned and formatted all datasets to be in the same format. This means some

Models trained on tulu-2.5-preference-data

55 models list it as training data.

Open allenai/tulu-2.5-preference-data on Hugging Face