syntaxsynth/swe-bench-opus-logs download history

syntaxsynth/swe-bench-opus-logs is a question answering dataset on the Hugging Face Hub. In the last 30 days it was downloaded 182 times (88 in the last 7 days), and 1,517 times in total. It ranks #73,067 among datasets by monthly downloads.

Claude 3 inference SWE-Bench results Contains prompting responses from SWE-bench on these 2 settings: Oracle retrieval BM25 retrieval Each of the subsets contains an additional log_last_line attributes which is the last line from log files generated during evaluation step. Results:

Open syntaxsynth/swe-bench-opus-logs on Hugging Face

Sister project: Paper Pulse, the upvote history of every Hugging Face Daily Paper.