Ikibazo gihuza ibibazo · Hagati Urwego

Bias Bounties and Algorithmic Bug Bounties Quiz

Covers Twitter’s bounded 2021 crop-model challenge, bounty design, reproducibility, incentives and limits as a voluntary audit method.

Ikibazo 1 Bya 8

What model did Twitter’s 2021 algorithmic bias bounty challenge target?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. What model did Twitter’s 2021 algorithmic bias bounty challenge target?
    • Every post recommendation system on Twitter
    • Its image saliency and automatic-cropping model
    • A facial-recognition system
    • A bank credit model
  2. What did participants receive access to for the announced challenge?
    • A public demo API that returned example crops without exposing the model.
    • Generated image examples and evaluation labels without access to the generation code.
    • The saliency model and crop-generation code
    • A small set of saliency scores without the crop-generation code.
  3. Why is a bias bounty not equivalent to a security vulnerability bounty?
    • Security reports never need evidence
    • A bias bounty is always a software exploit test
    • A bias bounty automatically changes the law
    • Potential social harms need context, affected-population evidence and choices about fairness criteria
  4. If no researcher reports a bias during a bounty, what limitation remains?
    • It certifies legal compliance
    • It proves every group is treated equally
    • It shows no one used the system
    • The result does not prove the model is free of bias or harm
  5. Which detail makes a submitted bias finding more reproducible?
    • A conclusion without test data
    • A screenshot with no context
    • Model version, test population, metric, comparison and limitations
    • A list of protected groups only
  6. Why might a prize contest overrepresent easy-to-demonstrate harms?
    • Igihe, kugerwaho nibihembo birashobora gushimangira ibisubizo byoroshye kugerageza hejuru yibibi bitagaragara
    • Ibihembo bikuraho amakimbirane yose yinyungu
    • Ibibi byose birapimwa kimwe
    • Icyitegererezo cyamahugurwa yicyitegererezo burigihe
  7. Ni ubuhe buryo bufasha kurinda abantu bagizweho ingaruka n'abashakashatsi bafite kwizera?
    • Shishikariza abitabiriye gusiba konti zabo bwite
    • Sobanura urwego rwemewe, kurinda ubuzima bwite, gutangaza ibanga hamwe nigisubizo
    • Tangaza amakuru yibanze hamwe na buri raporo
    • Emera kwemerwa biterwa no kumenyekanisha gusa
  8. Nigute ishyirahamwe ryakagombye gusobanura kubogama kubogamye?
    • Nibimenyetso bifatika byo gucunga ibyago, ntabwo ari icyemezo cyuburinganire
    • Nkumusimbura wubujurire no kwipimisha imbere
    • Nkikimenyetso cyuko moderi zose zamasosiyete zitabogamye
    • Nkicyemezo cyemewe nababishinzwe