sheng22213/pku-safe-rlhf-masked-arm-round4-extreme-v2-training download history

sheng22213/pku-safe-rlhf-masked-arm-round4-extreme-v2-training is a text generation dataset on the Hugging Face Hub. In the last 30 days it was downloaded 17 times (4 in the last 7 days), and 137 times in total. It ranks #417,790 among datasets by monthly downloads.

PKU SafeRLHF Masked ARM Round4 Extreme V2 Training Bundle This bundle contains the training data and code for the masked_round4_extreme_v2 ARM training runs. V2 keeps the original round4 span-based loss mask, and adds a loser-side low-probability filter: Chosen and rejected responses

Open sheng22213/pku-safe-rlhf-masked-arm-round4-extreme-v2-training on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.