Guide-linked quiz · Medium Level
Debugging a Prompt That Isn't Working Quiz
Diagnose a prompt failure with a baseline, targeted changes, representative test cases, and checks for regressions across versions.
Question 1 of 8
How should a developer begin investigating a poor prompt result?
Preview every question8 questions
Answers and explanations appear as you take the quiz.
- How should a developer begin investigating a poor prompt result?
- Describe the specific failure mode, such as missing fields or unsupported claims
- Rewrite every instruction at once
- Change models without testing
- Ask for a higher confidence score
- Why change one prompt component at a time during debugging?
- It guarantees perfect results
- It avoids the need for examples
- It helps identify which change affected the output
- It makes model versions identical
- What should a prompt experiment preserve as a baseline?
- Only the newest response
- The original prompt and a fixed set of representative test cases
- A different test set for every version
- No records of prompt changes
- Why include edge cases in prompt tests?
- They guarantee every prompt is safe
- They make the test set larger without purpose
- Only edge cases matter
- A change may help common cases but fail on unusual inputs
- What can help make prompt success measurable?
- Concrete checks such as required fields, supported citations, or task completion
- A general request for a better answer
- The answer’s length alone
- A model’s self-rating
- If a prompt fix does not solve missing citations, what else should be inspected?
- Only the prompt’s punctuation
- The user’s screen brightness
- The folder name
- Retrieved context, tools, schema validation, and model version
- Why keep some evaluation examples separate from prompt tuning?
- To increase prompt length
- To hide prompt versions
- To check whether improvements generalize beyond examples used to revise the prompt
- To ensure all outputs are identical
- Does a prompt that passes several examples guarantee success on all inputs?
- Yes, if it is specific
- No; test results apply to the examples and conditions evaluated
- Yes, if a model wrote it
- No, because prompts cannot be tested
Keep testing yourself
More quizzes picked for your level.