sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2 download history

sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2 is a 7.2B-parameter model model by sfulay. In the last 30 days it was downloaded 6 times (2 in the last 7 days), and 28 times in total.

It ranks #1,120,656 on the Hub by monthly downloads.

It has 0 likes.

It is a fine-tune of alignment-handbook/zephyr-7b-sft-full.

Open sfulay/zephyr-7b-dpo-full-gpt_consistent-reward-scale-1-rpo-gamma-2 on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.