Tilmaamaha aasaasiga ah
Hawlaha firfircoonida
Hawlaha firfircoonidu waa albaabada yaryar ee aan tooska ahayn ee ku dhex jira neuron kasta oo u oggolaanaya shabakadaha neural inay bartaan qaabab adag, qaloocan halkii ay ka ahaan lahaayeen khadadka toosan.
Dhageyso hagahanAI-waa laga sheekeeyay · ~2 min
Boggaan2 daqiiqo akhri
Dulmar
Without them, a deep network would collapse into a single linear equation.
quusid qoto dheer
Neuron kastaa wuxuu xisaabiyaa wadar miisaan leh oo ka mid ah agabkiisa, laakiin wadartaas oo keliya ayaa toosan. Isku dheji lakabyo toosan oo badan oo, xisaab ahaan, waxaad weli haysataa hal shaqo oo toosan oo keliya, iyada oo aan loo eegin inta uu qoto dheer yahay. Hawlaha firfircoonidu waxay jebiyaan tan iyadoo lagu dabaqayo isbeddel aan toos ahayn wax soo saarka neuron kasta, taasoo siinaya shabakadaha awoodda ay ku qiyaasaan ku dhawaad shaqo kasta. Kuwa ugu caansan waa ReLU, taas oo si fudud u soo saarta gelinta haddii ay wanaagsan tahay iyo eber haddii kale; waa dhakhso waxayna ka fogaataa dhibaatooyinka tababarka qaar ka mid ah hawlaha hore. Sigmoid iyo tanh squash qiimuhu waxay u kala qaybsan yihiin xuduudo waxayna ahaayeen wax caadi ah taariikh ahaan laakiin waxay la ildaran karaan jaangooyooyin luminaya shabakadaha qoto dheer. Shaqada softmax, ee loo isticmaalo wax soo saarka, waxay u badashaa buundooyinka cayriin ee qaybinta ixtimaalka ee fasalada.
Dhaqangelinta Adduunka-dhabta ah
Isticmaalka ReLU ee lakabyada qarsoon ee shabakada convolutional si ay u barato xudduudaha go'aanka ee aqoonsiga sawirka
Codsashada softmax ee lakabka ugu dambeeya si loogu beddelo buundooyinka cayriin ee kala soocida ixtimaalka fasalka oo dhan
Doorashada firfircoonida GELU gudaha qaabka luqadda beddelka ee socodka qulqulka fudud
U beddelashada Leaky ReLU marka neuron-yada badan ee shabakada ay dhinteen oo ay joojiyeen wax ka qabashada
Mustaqbalka Hawlaha Hawlgelinta
ReLU iyo ina-adeerkeed siman ee GELU ayaa maanta xukuma, iyadoo GELU laga door biday transformers sababta oo ah qalooceeda siman waxay si fiican ula mid tahay dhaqdhaqaaqooda tababarka. Cilmi baaristu waxay sahamisaa hawlihii la bartay iyo kuwa la daboolay sida SwiGLU, oo hadda caan ku ah moodooyinka luqadaha waaweyn, kuwaas oo adeegsada gating isku dhufashada si kor loogu qaado muujinta. Isbeddelka ballaadhani waxa uu ku wajahan yahay hawlo siman, oo daboolan kuwaas oo hagaajiya socodka qulqulka iyo qaabka tayada cabbirka. Iyadoo dhaqdhaqaaqyada qalaad ay si joogto ah uga soo muuqdaan waraaqaha, hawlo fudud oo si wanaagsan loo dhaqmay waxay u janjeeraan inay ku guuleystaan ficil ahaan sababtoo ah waxay u tababaraan si la isku halleyn karo oo ku saabsan moodooyinka waaweyn.
Ku dhaqangelinta
Maxay muhiim u tahay
- Go'aamo cad. Waxay kaa caawinaysaa inaad kala saartid sheegashooyinka farsamada cad iyo luqadda suuq-geynta.
- Qiimaha iyo miisaaniyada. Waxaad waydiin kartaa su'aalo fulineed oo wanaagsan ka hor inta aadan lacag ama waqti bixin.
- Kooxda iyo socodka shaqada. Kooxaha fahamka la wadaago waxay sameeyaan wax soo saar, siyaasad, iyo go'aano waxbarasho oo wanaagsan.
Iska ilaali
- Kooxo kala duwan ayaa laga yaabaa inay isla erey u isticmaalaan si kala duwan, marka hore u qeex baaxadda.
- Tilmaamaha ayaa u ekaan kara kuwo xooggan halka waxqabadka dhabta ah ee dunidu aanu sinnayn.
- In la iska indho tiro tayada xogta iyo qorshayaasha qiimayntu waxay inta badan abuurtaa natiijooyin jilicsan.
Tallaabooyinka xiga
- Ka bilow qeexidda luqadda cad ee natiijada aad u baahan tahay.
- Dooro hal cabbir guusha iyo hal xaalad guuldarro ka hor tijaabada.
- Ku orod duuliye yar oo wata xogta matale, ee ma aha bandhig muuqaal ah.
- Dukumeenti meesha ay hawlaha firfircoonida ku caawiyaan iyo meelaha hababka fudud ay ka fiican yihiin.
Sii wad Sahaminta
Warqad bilaash ah
Hel warbixinta maalinlaha ah ee AI
Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.
Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.
Is tijaabi
Take the Activation Functions quiz
Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.
Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq
Su'aalaha soo noqnoqda
What is Activation Functions?
Hawlaha firfircoonidu waa albaabada yaryar ee aan tooska ahayn ee ku dhex jira neuron kasta oo u oggolaanaya shabakadaha neural inay bartaan qaabab adag, qaloocan halkii ay ka ahaan lahaayeen khadadka toosan. Iyaga la'aantood, shabakad qoto dheer ayaa u burburi doonta isla'eg toosan.
Why can stacking only linear layers not learn a curved decision boundary?
Without nonlinear activations, multiple linear layers compose to another linear mapping.
Why can sigmoid and tanh stall learning in deep networks when inputs reach their extremes?
At their flat extremes, their near-zero gradients weaken the backpropagated signal.
A multiclass classifier needs output values that sum to one across classes. Which function does the guide use?
Softmax turns raw class scores into a probability distribution over classes.
What does the “dying ReLU” problem mean in the guide?
A ReLU stuck receiving negative inputs can keep outputting zero, preventing useful updates through that unit.
Which variant is suggested when many ReLU units stay inactive?
The guide names Leaky ReLU as a response to dead units because its negative side is not flat at zero.
Sii wad waxbarashada
Tilmaamaha la xidhiidha
Tilmaamayaal badan ayaa loo doortay mawduucan