Ikibazo gihuza ibibazo · Hagati Urwego

Nigute Ukora Ikibazo Cyubugenzuzi bwa AI

Tegura ubugenzuzi bubogamye uhereye kubipimo byafashwe na metrics ukoresheje isesengura ryitsinda, inyandiko, gukosora, hamwe nibisabwa byihariye.

Inzira zijyanye no kuyoboraNigute Wakora Igenzura rya AI Bias
Ikibazo 1 Bya 8

What should an audit define before calculating metrics?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. What should an audit define before calculating metrics?
    • Only the model’s parameter count
    • A single fairness ratio
    • The decision, system boundary, affected population, and harm of concern
    • The vendor’s preferred benchmark
  2. Why should an audit report subgroup counts and uncertainty?
    • Small samples can make estimates unstable
    • Percentages are meaningless in every case
    • It replaces legal analysis
    • It makes every metric comparable
  3. What did the Obermeyer study illustrate for auditing health algorithms?
    • Removing all race data guarantees fairness
    • Health data cannot be audited
    • Algorithms always improve care
    • Cost can be a biased proxy for need
  4. Which New York City Local Law 144 requirement applies to covered AEDTs?
    • A federal license
    • An independent bias audit within one year before use and a public summary
    • A ban on all resume ranking
    • A guarantee of equal outcomes
  5. Does a passing fairness metric prove a system is fair and lawful?
    • No; it is evidence limited to chosen metrics, scope, and data
    • Yego, burigihe
    • Only if the tool is open source
    • Yes, when an auditor signs
  6. Why examine labels and target definitions?
    • They control only display colors
    • They are unrelated to audit results
    • They may measure a proxy rather than the intended construct
    • They reveal source code
  7. What should happen after an audit identifies a problem?
    • Publish only the overall score
    • Assign remediation, change the system or process, and retest
    • Ignore it if the model is accurate
    • Delete the report
  8. Which items should an audit report include?
    • Only the final fairness score
    • Only the model vendor
    • The names of all applicants
    • Scope, data limitations, metrics, and whether test conditions match actual use