Kwibagirwa
Kwibagirwa Catastrophique ni mugihe urusobe rw'imitsi rwiga umurimo mushya rugatakaza ubushobozi butunguranye bwo gukora imirimo yari imaze kumenya.
Incamake
It is a central obstacle to building AI that learns continually without retraining from scratch.
Kwibira cyane
Imiyoboro ya Neural ibika ubumenyi mubipimo bisangiwe. Iyo uhuguye icyitegererezo kumurimo mushya, ivugurura rya gradient yandika hejuru yibipimo byashizemo ubuhanga bwambere, bityo imikorere ishaje irashobora gusenyuka. Ibi ni kwibagirwa ibyago, byitwa kandi kwivanga kw’ibiza, byanditswe bwa mbere na McCloskey na Cohen mu 1989. Birakaze mu myigire ikurikiranye cyangwa ikomeza, aho amakuru agera mu byiciro aho kuba byose bivanze hamwe. Kurugero, gutunganya neza chatbot cyane kumyandiko yemewe birashobora gutesha agaciro ubushobozi bwayo bwo kuganira. Igipimo gisanzwe cya brute-imbaraga nugutoza imirimo yose hamwe, ariko ibyo bihenze kandi ukeka ko ugifite amakuru ashaje. Abashakashatsi ahubwo bakoresha tekinike zirinda uburemere bwingenzi, gusubiramo ingero zashize, cyangwa kongeramo ibipimo byihariye, byose bigamije kureka moderi ikusanya ubumenyi nkuko abantu babikora.
Ubushishozi
Kwibagirwa bibaho kuko uburemere bumwe bwongeye gukoreshwa mumirimo, hamwe no kugabanuka kwa gradient kumanuka kumakuru mashya abimura mubuntu. Mitiwasi zirimo Elastic Weight Consolidation, yongeraho igihano kigabanya umuvuduko wibipimo bifatwa nkibyingenzi kubikorwa bishaje (byagereranijwe hakoreshejwe amakuru ya Fisher). Ubundi buryo ni repetition cyangwa uburambe bwo gusubiramo (guhuza kubika cyangwa kubyara ingero zishaje), hamwe nuburyo bwo gutandukanya ibintu nka adapteri cyangwa LoRA ihagarika icyitegererezo cyibanze kandi ikongeramo modul nshya.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Ejo hazaza ho Kwibagirwa
Mugihe icyitegererezo kiva mumyitozo imwe igana ubuzima bwawe bwose, burigihe sisitemu igezweho, kugenzura kwibagirwa biba ngombwa. Uburyo bukoresha ibipimo nkibikoresho bya LoRA bireka amakipe akongerera ubumenyi atabangamiye icyitegererezo cyibanze, hamwe na sisitemu yo kugarura ibintu yongereye ikibazo ikomeza ubumenyi bushya mububiko bwo hanze aho kuba uburemere. Witege ibipimo-biga-bipimo, ubwubatsi bwa modular, hamwe nubuhanga bwahujwe nubwonko bwo guhuza imbaraga kugirango bikure, bitwereke kuri moderi ivugurura namakuru mashya mugihe ugumana neza ibyo basanzwe bazi.
Gushyira mu bikorwa Isi
Ikiganiro rusange gisanzwe neza cyane kumyandiko yubuvuzi itakaza kuvuga neza mubiganiro bisanzwe.
Elastic Weight Consolidation ireka umukozi ukina umukino wiga imikino mishya ya Atari utibagiwe nishaje.
Amakipe akoresha adapteri ya LoRA kugirango yongere ubuhanga bushya bwa domaine mugihe asize ubushobozi bwibanze bwa moderi yahagaritswe.
Ubunararibonye busubiramo bubika ingero zashize kandi bugahuza mugihe cyamahugurwa mashya yo kubungabunga imikorere ishaje.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Catastrophic Forgetting quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gukomeza Kwiga no Kwibagirwa Catastrophique
Ibibazo bikunze kubazwa
What is Catastrophic Forgetting?
Kwibagirwa Catastrophique ni mugihe urusobe rw'imitsi rwiga umurimo mushya rugatakaza ubushobozi butunguranye bwo gukora imirimo yari imaze kumenya. Nimbogamizi nyamukuru yo kubaka AI yiga ubudahwema itarinze kwisubiraho.
Kwibagirwa ibiza ni iki?
Kwibagirwa Catastrophique ni ugutakaza gutunguranye kubushobozi bwa kera mugihe umuyoboro watojwe kumurimo mushya, kuko uburemere busangiwe burenga hejuru.
Ni ukubera iki kwibagirwa ibyago bibaho mumiyoboro mitsi?
Ubumenyi butuye mubintu bisangiwe, bityo imyitozo kumakuru mashya ihindura ibyo bipimo bimwe kandi igahanagura imyigire mbere.
Niki Elastic Weight Consolidation (EWC) ikora kugirango igabanye kwibagirwa?
EWC yongeyeho igihano gisanzwe gitinda kuvugurura ibipimo bifatwa nkibyingenzi kubikorwa bishaje, byagereranijwe hakoreshejwe amakuru ya Fisher.
Nigute uburambe bwo gusubiramo (repetition) kurwana kwibagirwa?
Imyitozo ivanze mu ngero zashize (zabitswe cyangwa zabyaye) mugihe wiga imirimo mishya bityo imikorere ishaje irashimangirwa.
Kuki adapteri ya LoRA ari ingirakamaro mu kwirinda kwibagirwa ibiza?
LoRA ituma icyitegererezo fatizo gikonjeshwa kandi yiga ibintu bito byongeweho, bityo ubuhanga bushya ntibuhungabanya ubushobozi buriho.