Imikorere
Imikorere yo gukora ni amarembo mato adafite umurongo imbere muri buri neuron ireka imiyoboro yimitsi yiga ibintu bigoye, bigoramye aho kuba imirongo igororotse gusa.
Incamake
Without them, a deep network would collapse into a single linear equation.
Kwibira cyane
Buri neuron ibara umubare uremereye winjiza, ariko ayo mafaranga yonyine ni umurongo. Shyira kumurongo umwe kumurongo kandi, mubiharuro, uracyafite gusa umurongo umwe munini wumurongo, nubwo byimbitse. Imikorere yibikorwa isenya ibi ukoresheje impinduka zidafite umurongo kuri buri neuron isohoka, biha imiyoboro imbaraga zo kugereranya ibikorwa hafi ya byose. Icyamamare cyane ni ReLU, isohora gusa ibyinjijwe niba ari byiza na zeru ukundi; birihuta kandi birinda ibibazo bimwe byamahugurwa yimikorere ishaje. Sigmoid na tanh squash indangagaciro zingana kandi byari bisanzwe mumateka ariko birashobora kubabazwa na gradients zishira mumurongo wimbitse. Imikorere ya softmax, ikoreshwa kubisohoka, ihindura amanota mbisi muburyo bwo gukwirakwiza amasomo.
Ubushishozi
Ubujurire bwa ReLU ni igice cyacyo: ni 1 rwose kubintu byiza byinjira, ntabwo rero bigabanya ibimenyetso byamakosa mugihe cyo gusubira inyuma, bifasha imiyoboro yimbitse kwitoza. Sigmoid na tanh, bitandukanye nibyo, barambuye hejuru, aho gradient yabo yegera zeru, bigatera ikibazo cyo kubura-buhoro buhoro gihagarika imyigire mubice byimbitse. Ikibi cya ReLU nikibazo cyo gupfa-ReLU, aho neuron yagumye kumasoko mabi asohoka zeru iteka; ibitandukanye nka Leaky ReLU na GELU bikemura ibi nukwemerera igisubizo gito cyangwa cyoroshye nonzero.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Igihe kizaza cyo gukora
ReLU na mubyara wacyo mwiza GELU yiganje uyumunsi, hamwe na GELU itoneshwa na transformateur kuko umurongo ucuramye uhuza neza hamwe namahugurwa yabo. Ubushakashatsi bugaragaza ibikorwa byize kandi byakinguwe nka SwiGLU, ubu bikunze kugaragara mururimi runini rwururimi, rukoresha amarembo menshi kugirango yongere ibitekerezo. Inzira yagutse ireba imikorere yoroshye, yuguruye imikorere itezimbere gahoro gahoro nubwiza bwikitegererezo. Mugihe ibikorwa bidasanzwe bigaragara buri gihe mubipapuro, byoroshye, imyitwarire yitwaye neza ikunda gutsinda mubikorwa kuko bitoza kwizerwa muburyo bukomeye.
Gushyira mu bikorwa Isi
Gukoresha ReLU muburyo bwihishe bwurusobekerane rwihishwa kugirango rushobore kwiga imipaka ifatirwa ibyemezo kugirango tumenye amashusho
Koresha softmax kumurongo wanyuma kugirango uhindure urutonde rwibanze rwamanota mubyiciro byashoboka byose hamwe
Guhitamo ibikorwa bya GELU imbere yimiterere yururimi rwimikorere ya gradient igenda neza
Guhindukira kuri Leaky ReLU mugihe neuron nyinshi murusobe zapfuye zikareka kwitabira
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Imikorere yo Gufasha ifasha nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Activation Functions quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gutakaza Imikorere
Ibibazo bikunze kubazwa
What is Activation Functions?
Imikorere yo gukora ni amarembo mato adafite umurongo imbere muri buri neuron ireka imiyoboro yimitsi yiga ibintu bigoye, bigoramye aho kuba imirongo igororotse gusa. Bitabaye ibyo, umuyoboro wimbitse wasenyuka muburyo bumwe.
Byagenda bite kumurongo wimbitse udafite ibikorwa byo gukora?
Gutondekanya umurongo utarimo umurongo ugwa mubiharuro muburyo bumwe, bityo umuyoboro ntushobora kwiga ibintu bigoye.
Niki ibikorwa byo gukora ReLU bisohoka kugirango byinjizwe nabi?
ReLU isohora ibyinjijwe iyo byiza na zeru iyo ari bibi, bigatuma byoroha kandi byihuse kubara.
Ni ikihe kibazo cyo kubura-buhoro buhoro gifitanye isano na sigmoid na tanh?
Sigmoid na tanh biringaniye bikabije, bityo gradient yabo igabanuka yerekeza kuri zeru, bigabanya ibimenyetso byamakosa mumiyoboro yimbitse.
Ni ubuhe buryo bwo gukora bukoreshwa muburyo busanzwe bwo gusohora ibyiciro byinshi?
Softmax ihindura amanota mbisi muburyo bwo gukwirakwiza ibyiciro byose hamwe, byiza kubisohoka.
Ni ikihe kibazo 'gupfa ReLU'?
Niba neuron ya ReLU ihora yakira ibitekerezo bibi, isohora zeru hamwe na zeru ya zero kandi igahagarika kuvugurura, bityo 'gupfa.'