Ci gaba da Koyo da Mantawar Bala'i
Ci gaba da koyo shine makasudin horar da AI akan sabbin ayyuka akan lokaci ba tare da goge abin da ya riga ya sani ba.
Dubawa
Its central obstacle is catastrophic forgetting: when a neural network learns a new task, gradient updates overwrite the weights that encoded earlier tasks, and old skills collapse.
Zurfafa nutsewa
Madaidaitan hanyoyin sadarwa na jijiyoyi suna ɗauka cewa ana samun duk bayanai lokaci ɗaya. A cikin duniyar gaske, bayanai suna zuwa a jere, kuma a hankali daidaitawa kan sabbin ayyuka yana haifar da mantawa da bala'i - aiki akan ayyukan da suka gabata yana raguwa saboda ana sake rubuta ma'aunin nauyi. Ci gaba da koyo yana neman daidaita kwanciyar hankali (riƙewa tsohon ilimi) da robobi (shar da sabon ilimi), ƙaƙƙarfan kwanciyar hankali-plasticity dilemma. Manyan iyalai guda uku na mafita sun wanzu: hanyoyin daidaitawa kamar Ƙarfafa Nauyin Nauyin Nauyi waɗanda ke hukunta canje-canje zuwa ma'aunin nauyi da aka ɗauka yana da mahimmanci ga tsoffin ayyuka; sake kunna hanyoyin da ke adanawa ko samar da samfurori daga ayyukan da suka gabata kuma suna shiga tsakani yayin horo; da hanyoyin gine-gine waɗanda ke keɓance sabbin sigogi ko kayayyaki kowane ɗawainiya. Babu wata hanya ɗaya da za ta warware ta sosai, kuma ƙima ta ƙunshi ɗawainiya-, yanki-, da saitunan ƙara-aji.
Fahimtar Fasaha
Mantawar bala'i ya taso saboda saukowa a kan sabon ɗawainiya yana motsa ma'aunin nauyi zuwa sabon mafi kyawu ba tare da wani hani na zama kusa da yankuna masu kyau ga tsofaffin ayyuka ba. Ƙirƙirar Nauyin Nauyin Ƙaƙwalwa yana ƙididdige mahimmancin kowane ma'aunin nauyi (ta hanyar matrix ɗin bayanai na Fisher) kuma yana ƙara hukunci huɗu wanda ke ƙulla ma'auni masu mahimmanci kusa da tsoffin dabi'u. Sake kunnawa yana ƙayyadad da ainihin rarraba haɗin gwiwa ta hanyar haɗa tsoffin misalai da aka adana ko ƙirƙira zuwa sabbin batches, don haka gradients suna nuna tsofaffi da sabbin ayyuka, rage rubutowa mai lalacewa.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Cigaban Ilmantarwa da Mantawar Bala'i
Ci gaba da ilmantarwa yana ƙara mahimmanci don kiyaye manyan samfura a halin yanzu ba tare da cikakken, sake horarwa mai tsada ba. Bincike yana turawa zuwa ga sabuntawa na ci gaba mai inganci (masu adaftan, Modulolin LoRA da aka ƙara kowane ɗawainiya), mafi kyawun sake kunnawa ta amfani da ƙirar ƙira, da hanyoyin haɓaka ilimi a cikin ƙirar tushe yayin guje wa mantawa da faɗuwar da ba a so. Yi tsammanin ƙarin hanyoyin haɗin kai zuwa wakilai na rayuwa waɗanda ke koyan kan na'urar, sake kunnawa-tsare sirri wanda ke nisantar adana ɗanyen bayanai, da maƙamai waɗanda mafi kyawun nuna haƙiƙa, rafukan bayanan da ba na tsaye ba maimakon ingantattun iyakoki.
Aiwatar da Gaskiyar Duniya
Mai rarraba hoto da aka tura wanda dole ne ya koyi sabbin nau'ikan samfura kowane wata ba tare da mantawa da waɗanda suka gabata ba.
Keɓance kan na'urar (allon madannai ko mataimakin murya) wanda ya dace da mai amfani akan lokaci ba tare da rasa daidaito na gaba ɗaya ba.
Robots waɗanda ke samun sabbin fasahohin magudi a jere yayin da suke riƙe waɗanda aka ƙware a baya.
Ana ɗaukaka samfurin harshe tare da sabbin bayanai ko yanki ta amfani da adaftar don haka ana kiyaye iyawar da ta gabata.
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Daftarin aiki inda Ci gaba da Koyo da Mancewar Bala'i ke taimakawa kuma inda mafi sauƙi hanyoyin suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Continual Learning and Catastrophic Forgetting quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Mantawar Bala'i
Tambayoyin da ake yawan yi
What is Continual Learning and Catastrophic Forgetting?
Ci gaba da koyo shine makasudin horar da AI akan sabbin ayyuka akan lokaci ba tare da goge abin da ya riga ya sani ba. Babban cikas ɗinta shine mantawa da bala'i: lokacin da hanyar sadarwa ta jijiyoyi ta koyi sabon ɗawainiya, sabuntawar gradient suna sake rubuta ma'aunin nauyi waɗanda ke ɓoye ayyukan da suka gabata, kuma tsoffin ƙwarewa ta rushe.
Menene 'mantuwar bala'i'?
Babban mantuwa shine babban hasara na tsohuwar aiki lokacin da aka sake rubuta ma'aunin ma'auni na hanyar sadarwa yayin koyon sabon abu.
Menene Ƙarfafa Nauyin Nauyi (EWC) ke yi?
EWC yana ƙara hukunci (ta yin amfani da bayanin Fisher) wanda ke ɗaukar ma'aunin nauyi da ake ganin yana da mahimmanci ga tsofaffin ɗawainiya, yana rage mantuwa.
Ta yaya hanyoyin sake kunnawa suke yaƙi mantuwa?
Sake kunnawa yana haɗa misalan da suka gabata zuwa sabbin batches don haka gradients su nuna tsofaffi da sababbin ayyuka, suna ƙayyadaddun bayanan haɗin gwiwa na asali.
Wanene BA ɗaya daga cikin manyan iyalai uku na hanyoyin koyo na ci gaba ba?
Manyan iyalai guda uku sune daidaitawa, sake kunnawa, da hanyoyin gine-gine; matsawa baya cikin su.
Me yasa gyara butulci akan sabon ɗawainiya ke haifar da mantuwa?
Sabunta gradient mara ƙarfi suna sake rubuta ma'auni ɗaya zuwa sabon mafi kyawu, watsar da yankuna waɗanda ke da kyau ga ayyukan da suka gabata.