Ayyukan Kunnawa
Ayyukan kunnawa su ne ƙananan ƙofofin da ba na kan layi a cikin kowane neuron waɗanda ke barin hanyoyin sadarwa na jijiyoyi su koyi hadaddun tsarin, lanƙwasa maimakon layi madaidaiciya.
Dubawa
Without them, a deep network would collapse into a single linear equation.
Zurfafa nutsewa
Kowane neuron yana ƙididdige jimlar ma'auni na abubuwan shigarsa, amma jimlar ita kaɗai ce madaidaiciya. Tari yadudduka masu layi da yawa kuma, a lissafin, har yanzu kuna da babban aikin layi ɗaya kawai, komai zurfinsa. Ayyukan kunnawa suna karya wannan ta hanyar amfani da canji mara kyau ga kowane kayan aikin neuron, yana ba cibiyoyin sadarwa ikon kusantar kowane aiki. Mafi mashahuri shine ReLU, wanda kawai ke fitar da shigarwar idan tabbatacce kuma sifili in ba haka ba; yana da sauri kuma yana guje wa wasu matsalolin horo na tsofaffin ayyuka. Sigmoid da tanh squash dabi'u cikin iyakoki masu iyaka kuma sun kasance gama gari a tarihi amma suna iya wahala daga ɓarna gradients a cikin hanyoyin sadarwa masu zurfi. Aikin softmax, wanda aka yi amfani da shi a wurin fitarwa, yana jujjuya maki mai kyau zuwa rarraba yuwuwar akan azuzuwan.
Fahimtar Fasaha
Roko na ReLU wani bangare ne na gradient: daidai yake 1 don ingantattun bayanai, don haka baya rage siginar kuskure yayin yaɗa baya, yana taimakawa hanyoyin horarwa mai zurfi. Sigmoid da tanh, akasin haka, sun miƙe a iyakarsu, inda gradient ɗinsu ke fuskantar sifili, yana haifar da matsalar ɓata-girma wanda ke hana koyo cikin zurfafan tari. Ragewar ReLU shine batun mutuwa-ReLU, inda neurons suka makale a abubuwan da ba su da kyau suna fitar da sifili har abada; bambance-bambancen karatu kamar Leaky ReLU da GELU suna magance wannan ta hanyar ƙyale ƙaramin ko santsi maras nauyi.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Ayyukan Kunnawa
ReLU da santsin dan uwan sa GELU sun mamaye yau, tare da GELU ya fi so a cikin masu canza wuta saboda santsin lankwasa yana da kyau tare da yanayin horon su. Bincike yana bincika abubuwan da aka koya da gated kamar SwiGLU, yanzu gama gari a cikin manyan nau'ikan harshe, waɗanda ke amfani da gating mai yawa don haɓaka bayyanawa. Faɗin yanayin shine zuwa santsi, ayyuka masu gated waɗanda ke haɓaka kwararar gradient da ingancin ƙira a sikeli. Yayin da ƙwaƙƙwaran kunnawa suna fitowa akai-akai a cikin takardu, ayyuka masu sauƙi, kyawawan halaye suna yin nasara a aikace saboda suna horar da dogaron kan manyan samfura.
Aiwatar da Gaskiyar Duniya
Amfani da ReLU a cikin ɓoyayyun hanyoyin sadarwa na juyin juya hali ta yadda zai iya koyon iyakokin yanke shawara mai lanƙwasa don gane hoto
Aiwatar da softmax a layi na ƙarshe don juya ɗanyen makin mai rarrabawa zuwa yuwuwar aji wanda ya kai ɗaya.
Zaɓin kunnawa GELU a cikin ƙirar yare mai canzawa don ƙwanƙolin gradient
Canjawa zuwa Leaky ReLU lokacin da yawa neurons a cikin hanyar sadarwa sun mutu kuma sun daina amsawa
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Daftarin aiki inda Ayyukan kunnawa ke taimakawa kuma inda mafi sauƙi hanyoyin suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Activation Functions quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ayyukan Asara
Tambayoyin da ake yawan yi
What is Activation Functions?
Ayyukan kunnawa su ne ƙananan ƙofofin da ba na kan layi a cikin kowane neuron waɗanda ke barin hanyoyin sadarwa na jijiyoyi su koyi hadaddun tsarin, lanƙwasa maimakon layi madaidaiciya. Idan ba tare da su ba, hanyar sadarwa mai zurfi za ta ruguje zuwa ma'auni guda ɗaya.
Menene zai faru da hanyar sadarwa mai zurfi ba tare da ayyukan kunnawa ba?
Matsakaicin yadudduka na layi ba tare da rashin layi ba yana rugujewa ta hanyar lissafi zuwa canjin layi ɗaya, don haka hanyar sadarwar ba zata iya koyon sarƙaƙƙiya alamu ba.
Menene fitowar aikin ReLU na kunnawa don shigarwa mara kyau?
ReLU yana fitar da shigarwar lokacin tabbatacce kuma sifili lokacin da mara kyau, wanda ya sa ya zama mai sauƙi da sauri don ƙididdige shi.
Menene matsalar bacewa-gradient mai alaƙa da sigmoid da tanh?
Sigmoid da tanh sun daidaita a iyakarsu, don haka gradient ɗin su yana raguwa zuwa sifili, yana raunana siginar kuskure a cikin hanyoyin sadarwa masu zurfi.
Wanne aikin kunnawa yawanci ana amfani dashi a layin fitarwa na mai rarraba aji da yawa?
Softmax yana jujjuya danyen maki zuwa rabe-raben yuwuwar akan azuzuwan da suka taru zuwa daya, manufa don fitar da rarrabuwa.
Menene matsalar 'ReLU' mai mutuwa?
Idan ReLU neuron koyaushe yana karɓar shigarwar mara kyau, yana fitar da sifili tare da gradient sifili kuma yana dakatar da sabuntawa yadda yakamata, saboda haka 'mutuwa'.