opencompass/SWEBench-Pro-Verified download history
opencompass/SWEBench-Pro-Verified is a dataset on the Hugging Face Hub. In the last 30 days it was downloaded 2,106 times (468 in the last 7 days), and 2,106 times in total. It ranks #10,851 among datasets by monthly downloads.
SWE-Bench Pro Verified: Anti-hacking & Task refinement SWE-Bench Pro has emerged as a standard benchmark for evaluating software engineering agents on challenging repository-level tasks. However, our analysis work show that its evaluation is undermined by two sources of unreliability: