danivpv/ml-arxiv-dpo download history
danivpv/ml-arxiv-dpo is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 39 times (2 in the last 7 days), and 350 times in total. It ranks #322,636 among datasets by monthly downloads.
ML ArXiv Preference Dataset (DPO) A preference alignment dataset of instruction/chosen/rejected triples, built for Direct Preference Optimization (DPO) and RLHF-style alignment toward an academic, authoritative Machine Learning tone. Part of the LLM-ArXiv-Domain-Expert pipeline.
Models trained on ml-arxiv-dpo
1 models list it as training data.
- danivpv/Llama-ML-Expert-DPO-1b – downloads in 30 days
Open danivpv/ml-arxiv-dpo on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.