Catastrophic Kukanganwa
Kukanganwa kunotyisa ndeye apo neural network inodzidza basa idzva uye kamwe kamwe inorasikirwa nekugona kwayo kuita mabasa yayanga yatogona.
Pfupiso
It is a central obstacle to building AI that learns continually without retraining from scratch.
Kudzika Kwakadzika
Neural network inochengeta ruzivo mumaremu akagovaniswa. Paunodzidzisa modhi pane rimwe basa idzva, gradient inogadziridza inonyora pamusoro iwo chaiwo maparamita akakodha hunyanzvi hwekare, kuitira kuti kuita kwekare kudonha. Uku kukanganwa kunotyisa, kunonziwo kukanganisa kunokanganisa, kwakatanga kunyorwa naMcCloskey naCohen muna 1989. Zvakanyanya mukutevedzana kana kuramba uchidzidza, uko data rinosvika muzvikamu kwete zvese zvakasanganiswa pamwechete. Semuyenzaniso, kugadzirisa chatbot zvakanyanya pane zviri pamutemo zvinogona kudzikisira kugona kwayo kutaura. Iyo yakajairwa brute-force kugadzirisa ndeye kudzokorora pamabasa ese pamwe chete, asi izvo zvinodhura uye zvinofungidzira kuti uchine data rekare. Vatsvagiri panzvimbo pacho vanoshandisa hunyanzvi hunodzivirira huremu hwakakosha, kudzokorora mienzaniso yakapfuura, kana kuwedzera basa-rimwe paramita, zvese zvichivavarira kurega mamodheru aunganidze ruzivo sezvinoita vanhu.
Technical Insight
Kukanganwa kunoitika nekuti huremu hwakafanana hunoshandiswazve pamabasa ese, uye kudzika kusingadzoreki kudzika pane data idzva kunoafambisa zvakasununguka. Mitigations inosanganisira Elastic Weight Consolidation, iyo inowedzera chirango chinononoka shanduko kumaparamita anoonekwa akakosha kumabasa ekare (anofungidzirwa kuburikidza neruzivo rweFisher). Dzimwe nzira dzekudzokorora kana ruzivo rwekudzokorora (kupindirana kwakachengetwa kana kugadzirwa kwemienzaniso yekare), uye nzira dzekuzviparadzanisa nevamwe senge adapter kana LoRA inoomesa modhi yepasi uye kuwedzera madiki module.
Strategic Impact
Kumhanya uye chiyero
Mutauro workflows inogona kufamba nekukurumidza pasina kupira kuenderana.
Svika uye svika
Inopamhidzira kupinda mumitauro yese nemataera ekutaurirana.
Sarudzo dzakajeka
Zvikwata zvinogona kupedza nguva yakawanda pakutonga uku otomatiki ichibata kudzokorora.
Ramangwana Renjodzi Kukanganwa
Sezvo mamodheru achifamba kubva pakudzidziswa kwepfuti kuenda kwehupenyu hwese, anogara achigadziridzwa masisitimu, kudzora kukanganwa kunova kwakakosha. Parameter-inoshanda nzira dzakaita seLoRA adapter dzinoita kuti zvikwata zviwedzere hunyanzvi pasina kukanganisa base modhi, uye kudzoreredza-yakawedzera masisitimu inobvisa dambudziko nekuchengeta ruzivo rutsva muchitoro chekunze kwete huremu. Tarisira kuramba uchidzidza mabhenji, modular architecture, uye huropi-dzakafemerwa nzira dzekubatanidza kuti dzikure, zvichitiendesa kumamodeli anogadziridza neruzivo rutsva tichichengeta nekuvimbika izvo zvavanotoziva.
Real-World Implementation
A general chatbot yakanyatsorongedzerwa zvakanyanya pamashoko ezvekurapa inorasikirwa nekutsetseka muhurukuro yakajairika.
Elastic Weight Consolidation inoita kuti mutambi-anotamba adzidze mitambo mitsva yeAtari pasina kukanganwa yekare.
Matimu anoshandisa LoRA maadapter kuwedzera hunyanzvi hwedomendi uku uchisiya kugona kweiyo chando base modhi yakasimba.
Zvakaitika kudzokorodza zvitoro zvakapfuura mienzaniso uye inoipindira panguva yekudzidziswa kutsva kuchengetedza kuita kwekare.
Njodzi & Guardrails
Chokwadi chehuroyi chinogona kupinda chinyararire mishumo, kuyerera kwetsigiro, kana tsvakiridzo.
Kunzwa nekukasira kunogona kugadzira mhedzisiro isingaenderane pane zvikumbiro zvakafanana.
Sensitive text data inogona kuburitswa kana zvidhiraivho zvisina kusimba.
Implementation Roadmap
Tsanangura chimiro chekubuda, toni, uye mhando zviyero usati waburitsa.
Mhinduro dzepasi neakavimbika masosi pese pazvine basa.
Chengetedza ongororo yekuongorora yemunhu kune yakakwira-stake zvinobuda.
Tevera maitiro ekutadza uye dzidzisazve kukurudzira kana mafambiro ebasa nguva nenguva.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Catastrophic Forgetting quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Kuramba Kudzidza uye Njodzi Kukanganwa
Mibvunzo inowanzo bvunzwa
What is Catastrophic Forgetting?
Kukanganwa kunotyisa ndeye apo neural network inodzidza basa idzva uye kamwe kamwe inorasikirwa nekugona kwayo kuita mabasa yayanga yatogona. Icho chipingamupinyi chepakati pakuvaka AI iyo inodzidza nguva dzose pasina kudzidzira kubva pakutanga.
Chii chinonzi kukanganwa njodzi?
Kukanganwa kwakashata ndiko kurasikirwa nekukasira kwehunyanzvi hwekare kana network ichidzidziswa basa idzva, nekuti uremu hwakagovaniswa hunowedzera kunyorwa.
Sei kukanganwa kwenjodzi kuchiitika mumaneural network?
Zivo inogara muzvikamu zvakagovaniswa, saka kudzidziswa padata idzva kunochinja iwo uremu humwe uye kudzima kudzidza kwekutanga.
Chii chinoitwa neElastic Weight Consolidation (EWC) kuderedza kukanganwa?
EWC inowedzera chirango chenguva dzose chinononoka kugadziridza kune paramita anoonekwa akakosha kumabasa ekare, anofungidzirwa kuburikidza neFisher ruzivo.
Chiitiko chinodzokorora (rehearsal) kurwisa kukanganwa sei?
Rehearsal musanganiswa mumienzaniso yapfuura (yakachengetwa kana kugadzirwa) uchidzidza mabasa matsva kuti kuita kwekare kusimbiswe.
Sei maadapta eLoRA achibatsira kudzivirira kukanganwa njodzi?
LoRA inochengeta iyo base modhi yakaomeswa uye inodzidza madiki ekuwedzera-pama paramita, saka hunyanzvi hutsva haukanganise hunyanzvi huripo.