Gukomeza Kwiga no Kwibagirwa Catastrophique
Kwiga guhoraho nintego yo guhugura AI kumurongo wimirimo mishya mugihe utahanaguye ibyo isanzwe izi.
Incamake
Its central obstacle is catastrophic forgetting: when a neural network learns a new task, gradient updates overwrite the weights that encoded earlier tasks, and old skills collapse.
Kwibira cyane
Imiyoboro isanzwe itekereza ko amakuru yose aboneka icyarimwe. Mu isi isanzwe, amakuru agera ku buryo bukurikiranye, kandi mu buryo bworoshye guhuza neza imirimo mishya bitera kwibagirwa ibyago - imikorere ku mirimo yabanjirije iyi igabanuka kuko uburemere busangiwe bwongeye kwandikwa. Kwiga ubudahwema gushakisha kuringaniza ituze (kugumana ubumenyi bwa kera) kurwanya plastike (gukuramo ubumenyi bushya), ikibazo gihamye-gihamye cya plastike. Imiryango itatu yingenzi yibisubizo irahari: uburyo busanzwe burigihe nka Elastic Weight Consolidation ihana impinduka kubiro bifatwa nkibyingenzi kubikorwa bishaje; gusubiramo uburyo bubika cyangwa butanga ingero kubikorwa byashize no kubihuza mugihe cy'amahugurwa; nuburyo bwububiko butanga ibipimo bishya cyangwa modul kuri buri gikorwa. Nta buryo bumwe bwakemuye byimazeyo, kandi isuzuma ririmo umurimo-, indangarubuga-, hamwe n-ibyiciro-byiyongera.
Ubushishozi
Kwibagirwa Catastrophique bivuka kuberako kumanuka gahoro gahoro kumurimo mushya wimura uburemere busangiwe kugana ku kintu gishya nta mbogamizi yo kuguma hafi yakarere keza kubikorwa bishaje. Elastic Weight Consolidation igereranya uburemere bwa buri buremere (binyuze muri matrix yamakuru ya Fisher) kandi ikongeramo igihano cya kane cyerekana uburemere bukomeye hafi yindangagaciro zabo za kera. Gusubiramo bigereranya umwimerere uhuriweho mukuvanga ingero zabitswe cyangwa zabyaye ingero zishaje mubice bishya, bityo gradients zigaragaza imirimo ishaje nishya, kugabanya kwandika byangiza.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza Kukomeza Kwiga no Kwibagirwa Catastrophique
Kwiga gukomeza birakomeye cyane kugirango bigumane moderi nini zigezweho zuzuye zuzuye, imyitozo ihenze. Ubushakashatsi burimo gusunika ibintu-bikomeza kuvugururwa (adapteri, moderi ya LoRA yongewe kumurimo), gusubiramo neza ukoresheje imiterere ibyara inyungu, hamwe nuburyo buvugurura ubumenyi mubyitegererezo mugihe wirinze kwibagirwa no gutwarwa udashaka. Tegereza amahuza akomeye kubakozi ubuzima bwabo bwose biga kubikoresho, gusubiramo-ubuzima bwibanga birinda kubika amakuru yibanze, hamwe nibipimo byerekana neza amakuru afatika, adahagaze aho kuba imbibi zakazi.
Gushyira mu bikorwa Isi
Ishusho yoherejwe yoherejwe igomba kwiga ibicuruzwa bishya buri kwezi utibagiwe nibyambere.
Kwimenyekanisha ku bikoresho (clavier cyangwa umufasha wijwi) bihuza numukoresha mugihe ntatakaze neza muri rusange.
Imashini zifite ubumenyi bushya bwa manipulation zikurikiranye mugihe zigumana ubuhanga.
Kuvugurura icyitegererezo cyururimi hamwe nibintu bishya cyangwa domaine ukoresheje adapteri kugirango ubushobozi bwambere burabitswe.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Kwiga Kwikomeza no Kwibagirwa Catastrophique Ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Continual Learning and Catastrophic Forgetting quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kwibagirwa
Ibibazo bikunze kubazwa
What is Continual Learning and Catastrophic Forgetting?
Kwiga guhoraho nintego yo guhugura AI kumurongo wimirimo mishya mugihe utahanaguye ibyo isanzwe izi. Inzitizi nyamukuru yibanze ni kwibagirwa ibyago: iyo urusobe rw'imitsi rwize umurimo mushya, ivugurura rya gradient rirenga uburemere bwarimo imirimo yabanje, kandi ubuhanga bukera burasenyuka.
'Kwibagirwa ibyago' ni iki?
Kwibagirwa Catastrophique nugutakaza gukabije kwimikorere-ishaje mugihe urwego rusangiwe uburemere bwurwego rwanditse mugihe wiga ikintu gishya.
Niki Elastic Weight Consolidation (EWC) ikora?
EWC yongeyeho ibihano (ukoresheje amakuru ya Fisher) uburemere bwa ankeri bufatwa nkibyingenzi kubikorwa bishaje, kugabanya kwibagirwa.
Nigute uburyo bushingiye kubisubiramo burwanya kwibagirwa?
Gusubiramo bivanga ingero zashize mubice bishya bityo gradients zigaragaza imirimo ishaje niyindi mishya, ugereranije namakuru yambere ahuriweho.
Ninde utari umwe mumiryango itatu yingenzi yuburyo bukomeza bwo kwiga?
Imiryango itatu yingenzi nuburyo busanzwe, gusubiramo, nuburyo bwububiko; kwikuramo ntabwo arimwe muribi.
Ni ukubera iki naive-gutunganya neza umurimo mushya bitera kwibagirwa?
Ivugurura rya gradient ridasubirwaho wongere wandike uburemere bushyashya bushya, usize uturere twari twiza kubikorwa byambere.