Columbia-NLP/DPO-Nectar download history
Columbia-NLP/DPO-Nectar is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 27 times (6 in the last 7 days), and 1,019 times in total. It ranks #297,781 among datasets by monthly downloads.
Dataset Card for DPO-Nectar Reformatted from berkeley-nest/Nectar dataset. The LION-series are trained using an empirically optimized pipeline that consists of three stages: SFT, DPO, and online preference learning (online DPO). We find simple techniques such as sequence packing, loss mas