PJMixers-Dev/HailMary-v0.2-KTO-Public download history
PJMixers-Dev/HailMary-v0.2-KTO-Public is a reinforcement learning dataset on the Hugging Face Hub. In the last 30 days it was downloaded 86 times (18 in the last 7 days), and 955 times in total. It ranks #169,611 among datasets by monthly downloads.
Details This only contains the sets which are not private. This is also an experiment, so don't expect anything that good. The idea is to just take existing datasets which seem high quality and then generate a bad response for every model turn. If you have suggestions for improving th
Open PJMixers-Dev/HailMary-v0.2-KTO-Public on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.