Guide-linked quiz · Hard Level

LLM Vulnerability Scanners: garak and PyRIT Quiz

Tests garak’s documented security-scan flow, PyRIT’s selected security scenarios, test configuration, and the limits of a clean scan.

Question 1 of 8

How does garak describe its primary testing purpose?

Preview every question8 questions

Answers and explanations appear as you take the quiz.

  1. How does garak describe its primary testing purpose?
    • Certifying an entire application as secure after one scan
    • Benchmarking model quality without sending prompts to a configured target
    • Testing the security of systems that take prompts and return text
    • Measuring broad AI safety and fairness across all model uses
  2. What does a garak probe do in a security scan?
    • Attempts to elicit a defined weakness from the configured target
    • Managing the generator connection and returning model output
    • Inspecting an output for a specific failure signal
    • Aggregating detector judgments for a probe-detector pair
  3. What does a garak detector report?
    • An attempt stores the unique prompt-response interaction
    • An evaluator summarizes judgments for a probe-detector pair
    • A generator connects to the configured model or dialogue system
    • A signal for a particular failure mode in recorded output
  4. Which record helps a reviewer understand why a garak probe was flagged?
    • A copy of the target’s model weights
    • The detailed attempt with its test interaction and response
    • The final overall score without the underlying prompts or responses
    • The evaluator’s pass/fail summary alone
  5. Which PyRIT component can package datasets with attack techniques for a run?
    • An attack technique configures an executor, converters, data, or strategy
    • A target provides the interface to the tested system
    • A scorer assesses the result against its configured criterion
    • A scenario
  6. How should PyRIT be used for a security review?
    • Use only default scores without checking the selected target
    • Treat every built-in scenario as a complete test of the application
    • Select security-relevant scenarios and scoring that fit the target and objective
    • Treat all non-toxic output as evidence of an application security review
  7. What does a garak run with no detector hits establish?
    • The selected tests did not trigger those detectors in that run
    • The scan proves the application passed all security requirements
    • The target has no vulnerabilities in any configuration
    • The detector set has been proven complete for future attacks
  8. What should follow an important scanner finding?
    • Ignore the target workflow because the scanner already marked a hit
    • Reproduce it in the relevant application path and assess actual impact
    • Assume the detector result proves impact and patch without reproducing it
    • Report the scan summary as confirmed exploitability

Keep testing yourself

More quizzes picked for your level.

View all quizzes