Hawlaha firfircoonida
Hawlaha firfircoonidu waa albaabada yaryar ee aan tooska ahayn ee ku dhex jira neuron kasta oo u oggolaanaya shabakadaha neural inay bartaan qaabab adag, qaloocan halkii ay ka ahaan lahaayeen khadadka toosan.
Dulmar
Without them, a deep network would collapse into a single linear equation.
quusid qoto dheer
Neuron kastaa wuxuu xisaabiyaa wadar miisaan leh oo ka mid ah agabkiisa, laakiin wadartaas oo keliya ayaa toosan. Isku dheji lakabyo toosan oo badan oo, xisaab ahaan, waxaad weli haysataa hal shaqo oo toosan oo keliya, iyada oo aan loo eegin inta uu qoto dheer yahay. Hawlaha firfircoonidu waxay jebiyaan tan iyadoo lagu dabaqayo isbeddel aan toos ahayn wax soo saarka neuron kasta, taasoo siinaya shabakadaha awoodda ay ku qiyaasaan ku dhawaad shaqo kasta. Kuwa ugu caansan waa ReLU, taas oo si fudud u soo saarta gelinta haddii ay wanaagsan tahay iyo eber haddii kale; waa dhakhso waxayna ka fogaataa dhibaatooyinka tababarka qaar ka mid ah hawlaha hore. Sigmoid iyo tanh squash qiimuhu waxay u kala qaybsan yihiin xuduudo waxayna ahaayeen wax caadi ah taariikh ahaan laakiin waxay la ildaran karaan jaangooyooyin luminaya shabakadaha qoto dheer. Shaqada softmax, ee loo isticmaalo wax soo saarka, waxay u badashaa buundooyinka cayriin ee qaybinta ixtimaalka ee fasalada.
Aragtida Farsamada
Racfaanka ReLU waa qayb ka mid ah gradientkiisa: waa sida saxda ah 1 wax gelinta togan, sidaa darteed ma dhimi doonto calaamada qaladka inta lagu jiro faafinta, caawinta shabakadaha qoto dheer tababarka. Sigmoid iyo tanh, marka la barbardhigo, way siman yihiin xagga darafyadooda, halkaas oo jaangooyooyinkoodu u dhawaado eber, taas oo keenaysa dhibaatada lumay-sii-jiidhka ah ee joojisa waxbarashada xidhmooyin qoto dheer. Hoos-u-dhaca ReLU waa arrinta dhimanaysa-ReLU, halkaas oo neurons-ku ay ku dhegeen wax-soo-saarka taban ee eber weligood; Kala duwanaanshaha sida Leaky ReLU iyo GELU ayaa tan wax ka qabta iyagoo u oggolaanaya jawaab yar ama siman oo aan eber ahayn.
Saamaynta Istiraatijiyadeed
Go'aamo cad
Waxay kaa caawinaysaa inaad kala saartid sheegashooyinka farsamada cad iyo luqadda suuq-geynta.
Qiimaha iyo miisaaniyada
Waxaad waydiin kartaa su'aalo fulineed oo wanaagsan ka hor inta aadan lacag ama waqti bixin.
Kooxda iyo socodka shaqada
Kooxaha fahamka la wadaago waxay sameeyaan wax soo saar, siyaasad, iyo go'aano waxbarasho oo wanaagsan.
Mustaqbalka Hawlaha Hawlgelinta
ReLU iyo ina-adeerkeed siman ee GELU ayaa maanta xukuma, iyadoo GELU laga door biday transformers sababta oo ah qalooceeda siman waxay si fiican ula mid tahay dhaqdhaqaaqooda tababarka. Cilmi baaristu waxay sahamisaa hawlihii la bartay iyo kuwa la daboolay sida SwiGLU, oo hadda caan ku ah moodooyinka luqadaha waaweyn, kuwaas oo adeegsada gating isku dhufashada si kor loogu qaado muujinta. Isbeddelka ballaadhani waxa uu ku wajahan yahay hawlo siman, oo daboolan kuwaas oo hagaajiya socodka qulqulka iyo qaabka tayada cabbirka. Iyadoo dhaqdhaqaaqyada qalaad ay si joogto ah uga soo muuqdaan waraaqaha, hawlo fudud oo si wanaagsan loo dhaqmay waxay u janjeeraan inay ku guuleystaan ficil ahaan sababtoo ah waxay u tababaraan si la isku halleyn karo oo ku saabsan moodooyinka waaweyn.
Dhaqangelinta Adduunka-dhabta ah
Isticmaalka ReLU ee lakabyada qarsoon ee shabakada convolutional si ay u barato xudduudaha go'aanka ee aqoonsiga sawirka
Codsashada softmax ee lakabka ugu dambeeya si loogu beddelo buundooyinka cayriin ee kala soocida ixtimaalka fasalka oo dhan
Doorashada firfircoonida GELU gudaha qaabka luqadda beddelka ee socodka qulqulka fudud
U beddelashada Leaky ReLU marka neuron-yada badan ee shabakada ay dhinteen oo ay joojiyeen wax ka qabashada
Khatarta & Dariiqyada Ilaalada
Kooxo kala duwan ayaa laga yaabaa inay isla erey u isticmaalaan si kala duwan, marka hore u qeex baaxadda.
Tilmaamaha ayaa u ekaan kara kuwo xooggan halka waxqabadka dhabta ah ee dunidu aanu sinnayn.
In la iska indho tiro tayada xogta iyo qorshayaasha qiimayntu waxay inta badan abuurtaa natiijooyin jilicsan.
Qorshe Hawleedka Dhaqangelinta
Ka bilow qeexidda luqadda cad ee natiijada aad u baahan tahay.
Dooro hal cabbir guusha iyo hal xaalad guuldarro ka hor tijaabada.
Ku orod duuliye yar oo wata xogta matale, ee ma aha bandhig muuqaal ah.
Dukumeenti meesha ay hawlaha firfircoonida ku caawiyaan iyo meelaha hababka fudud ay ka fiican yihiin.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Activation Functions quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Hawlaha Luminta
Su'aalaha soo noqnoqda
What is Activation Functions?
Hawlaha firfircoonidu waa albaabada yaryar ee aan tooska ahayn ee ku dhex jira neuron kasta oo u oggolaanaya shabakadaha neural inay bartaan qaabab adag, qaloocan halkii ay ka ahaan lahaayeen khadadka toosan. Iyaga la'aantood, shabakad qoto dheer ayaa u burburi doonta isla'eg toosan.
Maxaa ku dhici doona shabakad qoto dheer oo aan lahayn hawlqabadyo?
Isku dhufashada lakabyada toosan ee aan toosnayn waxay u burburaan xisaab ahaan hal isbeddel toos ah, markaa shabakadu ma baran karto qaabab adag.
Waa maxay shaqo-abuurka ReLU ee soo-saarka taban?
ReLU waxay soo saartaa gelinta marka togan iyo eber marka taban, taas oo ka dhigaysa mid fudud oo degdeg ah in la xisaabiyo.
Waa maxay dhibaatada lunsiga-jilicsan ee la xidhiidha sigmoid iyo tanh?
Sigmoid iyo tanh waxay ku fidsan yihiin darafyadooda, sidaa darteed jaangooyooyinkoodu wuxuu u sii yaraanayaa eber, isagoo daciifinaya calaamadda qaladka ee shabakadaha qoto dheer.
Waa kuwee shaqada firfircoonida ee sida caadiga ah loo isticmaalo lakabka wax soo saarka ee kala-soocida dabaqadaha badan?
Softmax waxay u beddeshaa buundooyinka cayriin qaybinta itimaalka ee fasallada taas oo ku habboon soo saarista kala saarista.
Waa maxay dhibaatada 'ReLU' ee dhimanaysa?
Haddii ReLU neuron had iyo jeer helo talo taban, waxay soo saartaa eber leh gradient eber oo si wax ku ool ah u joojiya cusboonaysiinta, markaa 'dhimanaysa'.