Maswali yanayounganishwa na mwongozo · Kati Kiwango

SWE-bench and Coding Agent Benchmarks Quiz

Tests how SWE-bench tasks are built, FAIL_TO_PASS and PASS_TO_PASS scoring, the Lite and Verified subsets, and why scaffolds change results.

Njia za mwongozo zinazohusianaSwe Bench And Coding Agent Benchmarks
Swali 1 ya 8

What does a SWE-bench task ask the system to do?