Ikibazo gihuza ibibazo · Hagati Urwego
SWE-bench and Coding Agent Benchmarks Quiz
Tests how SWE-bench tasks are built, FAIL_TO_PASS and PASS_TO_PASS scoring, the Lite and Verified subsets, and why scaffolds change results.
Ikibazo 1 Bya 8
Ikibazo gihuza ibibazo · Hagati Urwego
Tests how SWE-bench tasks are built, FAIL_TO_PASS and PASS_TO_PASS scoring, the Lite and Verified subsets, and why scaffolds change results.