KikoCis/finetuning-on-the-benchmark-hurts download history
KikoCis/finetuning-on-the-benchmark-hurts is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 13 times (4 in the last 7 days), and 109 times in total. It ranks #491,332 among datasets by monthly downloads.
Fine-tuning on the benchmark hurts — and distilling correct reasoning fixes it A small, fully-reproducible study on a question everyone assumes they know the answer to: does fine-tuning a small model on a benchmark make it better? Short answer: it depends entirely on the training data
Open KikoCis/finetuning-on-the-benchmark-hurts on Hugging Face
Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.