HejuruUbuyobozi bukurikira
Data Flywheels: Guhindura amakuru yumusaruro mumahugurwa yamakuru
Tekiniki
Ubuyobozi bwa tekiniki
Imikorere yingirakamaro igereranya uko buri rugero rwamahugurwa rwashizeho uburyo bwo guhanura icyitegererezo, bikagufasha gukurikirana ibisohoka inyuma kumakuru yabiteye.
Umva iki gitaboAI-byavuzwe · ~2 min
Bifite akamaro kuko bahindura icyitegererezo kidasobanutse mubintu byunvikana kuburenganzira, gukemura, no kwizera.
Influence functions come from robust statistics and were adapted to deep learning by Koh and Liang in 2017. The core question is counterfactual: how would the model's loss on a test point change if a particular training example were removed or up-weighted? Rather than actually retraining (which is hopelessly expensive), influence functions approximate that change using calculus. They compute the gradient of the loss for the training point and the test point, then connect them through the inverse Hessian of the loss, which captures the curvature of the model's parameter space. Under Koh and Liang’s standard upweighting-on-test-loss convention, I_up,loss measures how infinitesimally increasing a training point’s weight changes the loss on a chosen test point. A positive value means upweighting raises test loss (a harmful influence); a negative value means it lowers test loss (a helpful influence). Removing a point reverses the sign of the first-order estimated change. Other influence scores may target predictions or use a different sign convention, so define the quantity before interpreting its sign. The result is a ranked list of the most responsible training examples.
Gukurikirana ibitabo byemewe byemewe cyane igice cyururimi rwakozwe, kubisesengura byemewe n'amategeko
Gukemura ikibazo kitari cyo mugushushanya amashusho yimyitozo yanditse nabi yasunitse icyitegererezo kubisubizo bitari byo
Gutahura ingero zamahugurwa yuburozi cyangwa anomal zidasanzwe zigira uruhare runini mubuhanuzi bwihariye
Kugenzura inguzanyo cyangwa gutanga akazi kugirango werekane amateka yamateka yatumye icyemezo kiburanwa
Tegereza ingaruka zishingiye kubikorwa kugirango bibe ibikorwa remezo kubazwa AI. Abagenzuzi ninkiko bagenzura niba inyandiko yemewe ifite uburenganzira bwo gusohora bazashaka urugero-urwego rwerekana, kandi abashinzwe iterambere bazabukoresha kugirango babone amakuru yanditse nabi cyangwa uburozi. Ibigereranyo bihendutse nka TRAK hamwe na gradient-igishushanyo ni ugusunika ibiranga mugihe nyacyo, kandi kubihuza nibidasobanutse bishobora gutuma amakipe akuraho inyandiko zidafite imyitozo yuzuye.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Imikorere yingirakamaro igereranya uko buri rugero rwamahugurwa rwashizeho uburyo bwo guhanura icyitegererezo, bikagufasha gukurikirana ibisohoka inyuma kumakuru yabiteye. Bifite akamaro kuko bahindura moderi idasobanutse mubintu byunvikana kuburenganzira, gukemura, no kwizera.
Imikorere yingirakamaro igereranya ingaruka zo guhagarika uburemere bwurugero rwamahugurwa kubihombo mugihe cyikizamini, ugereranije imyitozo-imwe-imwe yo kongera imyitozo utabikora.
Inzira ya classique yingirakamaro isaba guhinduranya Hessian hejuru yibipimo byose, bikaba bidashoboka kuri moderi hamwe na miliyari y'ibipimo.
Pang Wei Koh na Percy Liang impapuro zo muri 2017 'Sobanukirwa n'umukara-agasanduku kavuzwe hakoreshejwe Imikorere Inshingano' yazanye tekinike mu myigire yimbitse.
Kuri I_up, gutakaza, inkomoko mbi bivuze kongera ibiro byamahugurwa bigabanya gutakaza ikizamini cyatoranijwe; kuyikuraho bifite ingaruka zinyuranye-zambere.
__AIU_PROTECTED_4 __ '2023 ubushakashatsi bwakoresheje EK-FAC kugirango ugereranye Hessian ihindagurika, ituma isesengura ryingaruka ku ndimi nini.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Data Flywheels: Guhindura amakuru yumusaruro mumahugurwa yamakuru
Tekiniki