InoteveraGaidhi rinotevera
Bias Mitigation Techniques: Pre-, In- uye Post-Processing
Tekinoroji
Nhungamiro yehunyanzvi
Label bias inomuka kana mavara akakodha fungidziro, mirairo, mitemo yemasangano, kana maproxies asina kukwana kwete chokwadi chine chinangwa.
Teerera kugwaro iriAI-yakarondedzerwa · ~3 min
Inonyanya kuoneka mumabasa ekuita senge toxicity kana emotion classification, apo vanhu vanogona kusabvumirana. Kutora zita rimwe chete rakaunganidzwa sechokwadi chisingapokaneki kunogona kudzidzisa muenzaniso kuberekazve kutonga kwakarongeka.
Mamodheru anotariswa anodzidza kubva kune zvinyorwa, asi mavara anogona kunge ari matongerwo pane kuona kwechokwadi chakanangana. Label bias inoitika kana zviziviso, mirairo, zvikamu zvemasangano, kana mhedzisiro yevamiriri inokodha maonero akarongeka. Mumabasa ekuzvimiririra, kusawirirana kunogona kuratidza kusajeka chaiko kana maonero akasiyana emagariro, kwete kungotaura zvisina hanya. Kana boka rikapidigura mitongo yese kuita rekuti "goridhe" rimwe chete, rinogona kudzima musiyano iwoyo uye kuita kuti dudziro yeboka riratidzike sepasi rose. Tsvagiridzo yakaitwa neSap nevamwe vaanoshanda navo pakuona kutaura-ruvengo kwakawana hukama pakati pekuzivikanwa kweanoti kana zvinotendwa uye zviyero zvehupfu, kusanganisira yeAfrican American English. Ongororo yavo yepakutanga yakawana kuti mamodheru akadzidziswa pane akati wandei anoshandiswa zvakanyanya datasets anogona kunyora maAAE matweets uye mameseji nevanozvizivisa vashandisi veVatema seanogumbura pamitengo yakakwira. Vakaona zvakare kuti kuita kuti vadzivisi vazive nezvemutauro wemutauro kunogona kuderedza zvinyorwa zvinogumbura muchidzidzo ichocho. Izvi zvakawanikwa zvakanangana nedataset uye mabasa; havareve kuti mutsigiri wese ane rusaruro rwakafanana kana kuti kutaura kwese kwemutauro hakuna kunyorwa zvisizvo. Labels anogonawo kunge ari maproxies emasangano kwete mitongo yeannotator. Obermeyer nevamwe vaaishanda navo vakaratidza kuti kushandisa mari yekutarisira hutano semumiriri wevanoda hutano vanotambura varwere Vatema nekuti hurwere hwakafanana hwakamboita mari shoma. Iyo nyaya inowanzotsanangurwa seyero kana kurerekera kwainonangwa, kwete kungokanganisa zvirevo, asi inoratidza kuti sei zvikwata zvichifanira kubvunza kuti zita rinomiririrei. Natsiridza manyorerwo nekutsanangura chivakwa, uchipa mirairo inoenderana nezviri kutaurwa, tsvaga zvakafanira zvirevo zvakasiyana-siyana, nekuchengetedza mitongo yakawanda apo kusawirirana kunenge kuine musoro. Ongorora kusabvumirana neboka diki uye muenzaniso mhando. Vhoti yakawanda inogona kubatsira kune mamwe mabasa ekushanda, asi haifanire kudzima kusajeka chinyararire. Sarudza kana basa racho richida kubvumirana, kugoverwa kwemaonero, kukwira, kana kurega, uye kunyora kuti mavara akagadzirwa sei.
Vanyoridzi vasina kujairana neAfrican American English vanogona kutara mamaki ayo seane muchetura; Sap uye vaaishanda navo vakawana mapatani ezvinyorwa ayo mamodheru akadzidziswa pane data anogona kubereka.
Mareta haabvumirani nezve kutsvinya kana majee emuboka mumashoko mapfupi, saka mugadziri wemanzwiro anodzidza dudziro yeruzhinji.
Chirevo chekutarisira-chekutarisira chinoshandisa mashandisirwo ehutano hwekare semumiriri wezvinodiwa zvekurapa, kunyangwe kushandisa mari kuchigona kuratidza zvipingamupinyi zvekusvika.
Chikwata chinogadzirisa kupatsanurwa kwese kwevhoti nevazhinji uye chinorasa mitongo midiki yevanhu vanoziva mutauro uri kuongororwa.
Mazita anoshanduka nemutauro, mutemo, uye tsika dzenharaunda. Dzokorora madhairekitori uye dhata rekudzidzisa kana chirevo chemagariro chetemu kana chiyero chekusimudzira chachinja. Chengetedza provenence kune yega yega label sosi uye ipa nzira yekururamisa kune vanhu vanobatwa nesarudzo. Usatsanangure ruzhinji rwe annotator sechokwadi chaicho pasina humbowo. Kuongorora zvakare kana mutauro, mutemo, kana tsika dzenharaunda dzichichinja; chengetedza nhoroondo uye usambopa kubvumirana sechokwadi chaicho pasina humbowo. Gadzirisa rubriki neruzivo rwenharaunda kana tsananguro dzachinja. Ongorora rubrics nguva nenguva.
Tsamba yemahara
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Label bias inomuka kana mavara akakodha fungidziro, mirairo, mitemo yemasangano, kana maproxies asina kukwana kwete chokwadi chine chinangwa. Inonyanya kuoneka mumabasa ekuita senge toxicity kana emotion classification, apo vanhu vanogona kusabvumirana. Kutora zita rimwe chete rakaunganidzwa sechokwadi chisingapokaneki kunogona kudzidzisa muenzaniso kuberekazve kutonga kwakarongeka.
Mabhii anogona kukodha fungidziro yeannotator, iyo inotariswa modhi inozodzidza.
Zvidzidzo zvavo zvakawana hukama pakati pekuzivikanwa kweannotator kana zvitendero uye kutonga kwehupfu, kusanganisira yeAAE.
Kusabvumirana kunogona kuratidza kusajeka kana maonero akasiyana pane basa rakashata.
Kubatanidza muzita rimwe chete kunogona kuvanza misiyano ine revo mukutonga.
Obermeyer nevamwe vaaishanda navo vakaratidza kuti mari-yakatarisana nenjodzi yakaderera kudiwa kwevarwere veBlack nekuti kushandisa kwairatidza kusaenzana kutarisirwa.
Ramba uchidzidza
Mamwe madhairekitori akasarudzirwa nyaya iyi
InoteveraGaidhi rinotevera
Bias Mitigation Techniques: Pre-, In- uye Post-Processing
Tekinoroji