Ikibazo gihuza ibibazo · Hagati Urwego
Bias Bounties and Algorithmic Bug Bounties Quiz
Covers Twitter’s bounded 2021 crop-model challenge, bounty design, reproducibility, incentives and limits as a voluntary audit method.
Ikibazo 1 Bya 8
What model did Twitter’s 2021 algorithmic bias bounty challenge target?
Reba buri kibazo8 ibibazo
Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.
- What model did Twitter’s 2021 algorithmic bias bounty challenge target?
- Every post recommendation system on Twitter
- Its image saliency and automatic-cropping model
- A facial-recognition system
- A bank credit model
- What did participants receive access to for the announced challenge?
- A public demo API that returned example crops without exposing the model.
- Generated image examples and evaluation labels without access to the generation code.
- The saliency model and crop-generation code
- A small set of saliency scores without the crop-generation code.
- Why is a bias bounty not equivalent to a security vulnerability bounty?
- Security reports never need evidence
- A bias bounty is always a software exploit test
- A bias bounty automatically changes the law
- Potential social harms need context, affected-population evidence and choices about fairness criteria
- If no researcher reports a bias during a bounty, what limitation remains?
- It certifies legal compliance
- It proves every group is treated equally
- It shows no one used the system
- The result does not prove the model is free of bias or harm
- Which detail makes a submitted bias finding more reproducible?
- A conclusion without test data
- A screenshot with no context
- Model version, test population, metric, comparison and limitations
- A list of protected groups only
- Why might a prize contest overrepresent easy-to-demonstrate harms?
- Igihe, kugerwaho nibihembo birashobora gushimangira ibisubizo byoroshye kugerageza hejuru yibibi bitagaragara
- Ibihembo bikuraho amakimbirane yose yinyungu
- Ibibi byose birapimwa kimwe
- Icyitegererezo cyamahugurwa yicyitegererezo burigihe
- Ni ubuhe buryo bufasha kurinda abantu bagizweho ingaruka n'abashakashatsi bafite kwizera?
- Shishikariza abitabiriye gusiba konti zabo bwite
- Sobanura urwego rwemewe, kurinda ubuzima bwite, gutangaza ibanga hamwe nigisubizo
- Tangaza amakuru yibanze hamwe na buri raporo
- Emera kwemerwa biterwa no kumenyekanisha gusa
- Nigute ishyirahamwe ryakagombye gusobanura kubogama kubogamye?
- Nibimenyetso bifatika byo gucunga ibyago, ntabwo ari icyemezo cyuburinganire
- Nkumusimbura wubujurire no kwipimisha imbere
- Nkikimenyetso cyuko moderi zose zamasosiyete zitabogamye
- Nkicyemezo cyemewe nababishinzwe