Викторина, связанная с руководством · Средний Уровень
Как провести тест по аудиту предвзятости ИИ
Спланируйте аудит предвзятости, исходя из объема решений и показателей, посредством анализа подгрупп, документации, исправлений и требований, специфичных для юрисдикции.
Вопрос 1 из 8
What should an audit define before calculating metrics?
Предварительный просмотр каждого вопроса8 вопросы
Ответы и пояснения появляются по мере прохождения теста.
- What should an audit define before calculating metrics?
- Только количество параметров модели
- A single fairness ratio
- The decision, system boundary, affected population, and harm of concern
- The vendor’s preferred benchmark
- Why should an audit report subgroup counts and uncertainty?
- Small samples can make estimates unstable
- Percentages are meaningless in every case
- It replaces legal analysis
- It makes every metric comparable
- What did the Obermeyer study illustrate for auditing health algorithms?
- Removing all race data guarantees fairness
- Health data cannot be audited
- Algorithms always improve care
- Cost can be a biased proxy for need
- Which New York City Local Law 144 requirement applies to covered AEDTs?
- A federal license
- An independent bias audit within one year before use and a public summary
- A ban on all resume ranking
- A guarantee of equal outcomes
- Does a passing fairness metric prove a system is fair and lawful?
- No; it is evidence limited to chosen metrics, scope, and data
- Да, всегда
- Only if the tool is open source
- Yes, when an auditor signs
- Why examine labels and target definitions?
- They control only display colors
- They are unrelated to audit results
- They may measure a proxy rather than the intended construct
- They reveal source code
- What should happen after an audit identifies a problem?
- Publish only the overall score
- Assign remediation, change the system or process, and retest
- Ignore it if the model is accurate
- Delete the report
- Which items should an audit report include?
- Only the final fairness score
- Только поставщик модели
- The names of all applicants
- Scope, data limitations, metrics, and whether test conditions match actual use