Ubuyobozi bwa tekiniki

Ingaruka Imikorere yo Guhugura Ibyatanzwe

Imikorere yingirakamaro igereranya uko buri rugero rwamahugurwa rwashizeho uburyo bwo guhanura icyitegererezo, bikagufasha gukurikirana ibisohoka inyuma kumakuru yabiteye.

2 min somaIbiherutse kuvugururwa

Incamake

They matter because they turn an opaque model into something auditable for copyright, debugging, and trust.

Kwibira cyane

Imikorere y'ingirakamaro ituruka ku mibare ihamye kandi yahujwe no kwiga byimbitse na Koh na Liang muri 2017. Ikibazo nyamukuru ni ikinyuranyo: gutakaza icyitegererezo cyikigereranyo cyahinduka gute niba urugero rwamahugurwa rwakuweho cyangwa ruremereye? Aho kwitoza mubyukuri (bikaba bihenze cyane), guhindura imikorere igereranya iyo mpinduka ukoresheje kubara. Barabara igipimo cyigihombo kumwanya wamahugurwa hamwe nikizamini, hanyuma ubihuze binyuze muri Hessian ihindagurika yigihombo, ifata ubugororangingo bwikibanza cyerekana icyitegererezo. Ingaruka nini nziza isobanura urugero rwamahugurwa rwasunitse icyitegererezo kubyo ruhanura; agaciro kanini keza bivuze ko yasunitse kuyirwanya. Igisubizo ni urutonde rwingero zamahugurwa ashinzwe cyane.

Ubushishozi

Inzira nyayo ikenera Hessian ihindagurika yigihombo hejuru yibipimo byose, bidashobora gukoreshwa kuri miliyari-ibipimo byerekana. Abimenyereza babigereranya nuburyo nka LiSSA (stochastic iterative inversion), Kronecker-yakozwe na curvature (EK-FAC), cyangwa ibishushanyo mbonera nka TRAK. __AIU_PROTECTED_4 __ '2023 umurimo wapimye ibikorwa byingirakamaro kubikorwa byururimi runini ukoresheje EK-FAC, ugaragaza ko ingero zikomeye zikunze gusangira ibintu bidafatika aho kuvuga neza neza.

Ingaruka z'Ingamba

Igiciro na bije

Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.

Ibyemezo bisobanutse

Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.

Kugenzura ubuziranenge

Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.

Kazoza k'Imikorere Imikorere yo Guhugura Ibyatanzwe

Tegereza ingaruka zishingiye kubikorwa kugirango bibe ibikorwa remezo kubazwa AI. Abagenzuzi ninkiko bagenzura niba inyandiko yemewe ifite uburenganzira bwo gusohora bazashaka urugero-urwego rwerekana, kandi abashinzwe iterambere bazabukoresha kugirango babone amakuru yanditse nabi cyangwa uburozi. Ibigereranyo bihendutse nka TRAK hamwe na gradient-igishushanyo ni ugusunika ibiranga mugihe nyacyo, kandi kubihuza nibidasobanutse bishobora gutuma amakipe akuraho inyandiko zidafite imyitozo yuzuye.

Gushyira mu bikorwa Isi

Gukurikirana ibitabo byemewe byemewe cyane igice cyururimi rwakozwe, kubisesengura byemewe n'amategeko

Gukemura ikibazo kitari cyo mugushushanya amashusho yimyitozo yanditse nabi yasunitse icyitegererezo kubisubizo bitari byo

Gutahura ingero zamahugurwa yuburozi cyangwa anomal zidasanzwe zigira uruhare runini mubuhanuzi bwihariye

Kugenzura inguzanyo cyangwa gutanga akazi kugirango werekane amateka yamateka yatumye icyemezo kiburanwa

Ingaruka & Kurinda

Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.

Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.

Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.

Igishushanyo mbonera

1

Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.

2

Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.

3

Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.

4

Tegura inzira yo gusubiza ibyabaye mbere yo gupima.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Influence Functions for Training Data Attribution quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Byuzuye Byuzuye Ibyatanzwe

Ibibazo bikunze kubazwa

What is Influence Functions for Training Data Attribution?

Imikorere yingirakamaro igereranya uko buri rugero rwamahugurwa rwashizeho uburyo bwo guhanura icyitegererezo, bikagufasha gukurikirana ibisohoka inyuma kumakuru yabiteye. Bifite akamaro kuko bahindura moderi idasobanutse mubintu byunvikana kuburenganzira, gukemura, no kwizera.

Ni ikihe kibazo kinyuranyo kigira ingaruka kumikorere?

Imikorere yingirakamaro igereranya ingaruka zo guhagarika uburemere bwurugero rwamahugurwa kubihombo mugihe cyikizamini, ugereranije imyitozo-imwe-imwe yo kongera imyitozo utabikora.

Ni ikihe kintu cy'imibare cyerekana impinduka zifatika zidashobora gukoreshwa kuri moderi nini?

Inzira ya classique yingirakamaro isaba guhinduranya Hessian hejuru yibipimo byose, bikaba bidashoboka kuri moderi hamwe na miliyari y'ibipimo.

Ninde wahinduye imikorere yingirakamaro mukwiga bigezweho mu mpapuro zizwi muri 2017?

Pang Wei Koh na Percy Liang impapuro zo muri 2017 'Sobanukirwa n'umukara-agasanduku kavuzwe hakoreshejwe Imikorere Inshingano' yazanye tekinike mu myigire yimbitse.

Ni ubuhe butumwa bunini bwa NEGATIVE bwerekana agaciro?

Ingaruka mbi isobanura uburemere uburemere urugero rwamahugurwa rwaba rwaragabanije ikizere cyicyitegererezo mubyahanuwe, ni ukuvuga ko cyarwanyaga ibisohoka.

Ni ikihe kigereranyo Anthropic yakoresheje mu gupima ibikorwa bigira uruhare runini rwururimi?

__AIU_PROTECTED_4 __ '2023 ubushakashatsi bwakoresheje EK-FAC kugirango ugereranye Hessian ihindagurika, ituma isesengura ryingaruka ku ndimi nini.