Quiz lié à un guide · Difficile Niveau

Quiz sur l'étalonnage de la confiance dans l'IA

Teste l'étalonnage des probabilités, les différences de précision, les données décalées, l'affichage des preuves, la fiabilité des utilisateurs et les conseils révisables.

Chemins de guidage associésCalibrage de la confiance de l'IA
Question 1 de 8

What does statistical calibration describe?

Prévisualisez chaque question8 des questions

Les réponses et les explications apparaissent au fur et à mesure que vous répondez au quiz.

  1. What does statistical calibration describe?
    • Whether users like the interface
    • Whether the model ranks every example correctly
    • How often the model explains itself
    • Whether predicted probabilities match observed frequencies across comparable cases
  2. Can a statistically calibrated model still perform poorly?
    • No, calibration guarantees high accuracy
    • Yes; calibration and task quality are different properties
    • Only if users distrust it
    • No, if its confidence is displayed
  3. What does a model’s verbal statement “I am 95% sure” establish?
    • Only that it produced those words; the confidence needs empirical evaluation
    • That its output is calibrated
    • That the source evidence is correct
    • That a human should not review it
  4. A model is calibrated on one dataset. What remains uncertain after a domain shift?
    • Whether its old test score exists
    • Whether all users agree with the system
    • Whether the calibration still holds under changed language, domain, or task
    • Whether the interface color is accessible
  5. Which interface feature can support independent checking?
    • Use a decorative confidence badge without measurement
    • Show sources and relevant limitations beside the answer
    • Hide the source to reduce clutter
    • State that the model is always reliable
  6. How should teams evaluate human trust in the system?
    • Measure only whether users click “accept”
    • Assume explanations always improve trust
    • Count the model’s confident words
    • Test whether people notice errors and use overrides appropriately
  7. Why distinguish accuracy from calibration?
    • Accuracy and calibration are synonyms
    • Calibration only measures latency
    • A model may rank cases correctly while its probabilities are systematically too high or low
    • A calibrated score cannot be wrong
  8. What should happen when measured calibration changes over time?
    • Update user guidance and keep a route to report errors or complete the task another way
    • Leave the interface unchanged indefinitely
    • Remove all sources
    • Display a more precise confidence value