Guide-linked quiz · Medium Level

SWE-bench and Coding Agent Benchmarks Quiz

Tests how SWE-bench tasks are built, FAIL_TO_PASS and PASS_TO_PASS scoring, the Lite and Verified subsets, and why scaffolds change results.

Related guide pathsSwe Bench And Coding Agent Benchmarks
Question 1 of 8

What does a SWE-bench task ask the system to do?

Keep testing yourself

More quizzes picked for your level.

View all quizzes
Hard · 8 questionsHow to Become an AI Engineer QuizTake quizEasy · 8 questionsGetting Into AI Without Coding QuizTake quizEasy · 8 questionsHow to Remove Image Backgrounds with AI QuizTake quiz