Caadiyan Dufcaddii
Caadi ahaan Dufcaddii waa farsamo dib u cabbiraysa gelinta lakab kasta oo ka mid ah shabakada neerfaha inta lagu jiro tababarka, taasoo ka dhigaysa shabakadaha qoto dheer inay u tababaraan si dhakhso leh oo la isku halleyn karo.
Dulmar
It became one of the most widely used tricks in deep learning.
quusid qoto dheer
Sida xogtu u dhex socoto shabakad qoto dheer, qaybinta qiyamka quudinta lakab kasta waxay ku sii socotaa isbeddelka sida lakabyada hore loo cusbooneysiiyo, taas oo hoos u dhigta oo xasilisa tababarka. Dufcaddii caadiga ahayd, oo ay soo bandhigeen Ioffe iyo Szegedy sannadkii 2015, ayaa tan wax ka qabanaysa iyada oo caadi ka dhigaysa wax-soo-saarka lakab kasta ee dufcadda yar-yar ee hadda jirta si ay u yeeshaan qiyaas celcelis ahaan eber iyo farqi unug. Kadib waxay khusaysaa laba cabbir oo la baran karo, gamma iyo beta, kuwaas oo u oggolaanaya cabbirka shabakadda oo dib u beddelaan qiyamka caadiga ah haddii ay taasi caawiso, markaa ma luminayso awood matalid. Lacag-bixintu waa weyn tahay: shabakaduhu waxay u dulqaataan heerarka waxbarashada sare, waxay ku kulmaan wakhtiyo yar, aad bay u nuglaadaan bilawga miisaanka, oo inta badan way ka sii fiicnaadaan. Qabashada ayaa ah in hab-dhaqanku uu ku xidhan yahay tirakoobka dufcaddii, sidaa darteed dufcooyin aad u yar ayaa ka dhigi kara mid aan degganayn.
Aragtida Farsamada
Sifo kasta oo ka mid ah dufcad-yar, heerka dufcadda waxa ay xisaabisaa celceliska dufcadda iyo faraqa, ka gooya celceliska, oo u qaybiya jaangooyada jaangooyo (oo lagu daray epsilon yar oo xasilloonida). Kadib waxay soo saartaa waqtiyada gamma qiimaha caadiga ah iyo beta, halkaasoo gamma iyo beta lagu barto. Inta lagu jiro tababarka waxay isticmaashaa tirakoobyada dufcada tooska ah iyadoo sidoo kale ilaalinaysa celceliska socodka; Waqtiga la qiyaasi karo waxay u wareegtaa celceliska orodka ee kaydsan markaa saadaasha kuma xirna tusaalooyinka kale ee dhaca si loo wadaago dufcada. Caadi ahaan waxa la geliyo inta u dhaxaysa tallabada toosan ee lakabka iyo hawsheeda firfircoonida.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Caadiga Dufcadda
Dufcaddii caadiga ahayd waxay ahaanaysaa faras-shaqaale moodooyinka aragga is-bedbeddelka leh, laakiin ku-tiirsanaanta tirakoobka dufcadda ayaa dhib ku ah shabakadaha soo noqnoqda, dufcadaha yaryar, iyo tababarka la qaybiyey. Taasi waxay keentay qaadashada beddelka sida caadiga ah lakabka, kaas oo caadi ka dhigaya dhammaan sifooyinka hal tusaale oo hadda xukuma qaab-dhismeedka beddelka, oo lagu daray kooxda iyo tusaale ahaan caadiyeynta qaybaha gaarka ah. Cilmi-baadhistu waxay ku sii socotaa shabakadaha-caadiga ah ee xorta ah ee ku habboon faa'iidooyinkeeda iyada oo loo marayo bilawga taxaddar leh iyo miisaan. Filo in caadi ahaan ay u ahaato lama huraan, oo leh kala duwanaansho gaar ah oo la doortay si ay ugu habboonaato dhismaha.
Dhaqangelinta Adduunka-dhabta ah
Gelida lakabyada caadiga ah ee kala soocida sawirka ResNet si ay ugu tababarto heer waxbarasho sare oo ay isugu timaado waayihii aad uga yar.
Xasilinta tababbarka shabakad qotodheer oo kacaan ah oo loogu talagalay sawir-qaadista caafimaadka oo markii hore kala duwanaa iyada oo aan caadi ahayn.
Yaraynta dareenka bilawga miisaanka ee CNN caadadii, sidaa darteed injineeradu waxay ku qaataan wakhti yar inay gacanta ku hagaajiyaan qiyamka bilawga ah.
Ka beddelashada tirooyinka dufcadda qaab-tababarka una beddelo celceliska socodsiinta kaydsan marka la hawlgelinayo moodal si saadaasha hal-muuqaal ahi u ahaato mid joogto ah.
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Batch Normalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
RMSNorm iyo Caadiyeynta Lakabka Kahor
Su'aalaha soo noqnoqda
What is Batch Normalization?
Caadi ahaan Dufcaddii waa farsamo dib u cabbiraysa gelinta lakab kasta oo ka mid ah shabakada neerfaha inta lagu jiro tababarka, taasoo ka dhigaysa shabakadaha qoto dheer inay u tababaraan si dhakhso leh oo la isku halleyn karo. Waxay noqotay mid ka mid ah xeeladaha ugu badan ee loo isticmaalo barashada qoto dheer.
Maxay caadi ka dhigtaa dufcadda?
Dufcaddii caadiga ahayd waxa ay habaynaysaa agabka lakabka iyada oo la isticmaalayo celceliska iyo kala duwanaanshiyaha lagu xisaabiyay dufcada yar-yar ee hadda jirta, iyada oo hawlgelinta ku ilaalinaysa meel deggan marka uu tababarku socdo.
Waa maxay sababta caadiga ah ee dufcadda ay ugu jiraan cabbirrada la baran karo gamma iyo beta?
Ka dib markii la caadaystay celceliska eber iyo kala duwanaanshaha unugga, gamma iyo beta ha shabakadaha dib u cabbiraan oo dib u beddelaan qiyamka haddii taasi faa'iido leedahay, markaa caadiyaynta ma xaddidayso waxa lakabku matali karo.
Waa maxay faa'iidada wax ku oolka ah ee caadiga ah ee dufcadda?
Iyada oo la ilaalinayo agabka lakabka si fiican loo qiyaaso, heerka dufcadda ayaa u ogolaanaysa shabakadaha in ay ku tababartaan heerar waxbarasho oo waaweyn, si dhakhsa leh isugu yimaadaan, oo ay u nugul yihiin bilaabista.
Waqtiga go'aaminta (saadaalinta xogta cusub), waa maxay statistics ee caadiga ah ee dufcadda adeegsato?
Isticmaalka tirakoobka dufcada tooska ah marka la tixraaco waxay samaynaysaa saadaal ku xiran tahay tusaalooyinka kale ee wadaaga dufcada. Taa baddalkeeda, heerka caadiga ah wuxuu isticmaalaa celceliska orodka go'an ee la kaydiyay inta lagu jiro tababarka.
Waa maxay sababta caadiga ah ee dufcadu ay u dhaqmi karto si liidata iyada oo leh cabbirro yar oo aad u yar?
Dufcaddii caadiga ahayd waxay ku xidhan tahay qiyaasida celceliska iyo kala duwanaanshaha dufcadda. Tusaalayaal aad u yar, qiyaasahaasi waa buuq, taas oo wax u dhimi karta tababarka.