Bilowga Miisaanka
Sida aad u dejiso miisaanka bilowga shabakada neerfaha ka hor inta aan tababarka bilaabin, kaas oo si adag u qaabeeya in calaamadaha iyo gradients ay caafimaad qabaan iyada oo loo marayo lakabyo qoto dheer.
Dulmar
Good initialization is the difference between fast convergence and a model that never learns.
quusid qoto dheer
Tababarka ka hor, miisaan kastaa wuxuu u baahan yahay qiime bilow ah. In dhamaantood eber laga dhigo waa dilaa: miisaan isku mid ah ayaa soo saara jaanisyo isku mid ah, sidaa darteed neerfayaasha waligood ma kala soocaan - tani waa dhibaatada jebinta summadaha. Bilawga random-ka ayaa jebiya summaynta, laakiin miisaanku aad buu muhiim u yahay. Aad u weyn oo firfircooni iyo gradients ayaa qarxay; aad u yaryar wayna libdhaan. Nidaamyada mabda'a ah waxay doortaan kala duwanaanshaha ku salaysan cabbirka lakabka si ay u ilaaliyaan kala duwanaanshiyaha calaamaduhu qiyaas ahaan joogto ah dhammaan lakabyada. Xavier (Glorot) bilawga miisaanku wuxuu cabbiraa kala duwanaanshiyaha tirada gelinta iyo unugyada wax soo saarka iyo ku habboon shabakadaha tanh iyo sigmoid. Isaga (Kaiming) bilawga wuxuu cabbirayaa tirada agabka iyo xisaabaadka ReLU inay tuurto kala badh agabkeeda, taasoo ka dhigaysa halbeega shabaqyada qoto dheer ee ku salaysan ReLU iyo CNN-yada. Bilawga wanaagsani waxa uu ilaaliyaa tababarka hore mid xasiloon ilaa inta caadiga ah iyo kuwa wax hagaajinaya la qabsanayo ay la wareegayaan.
Aragtida Farsamada
Hadafku waa in la ilaaliyo kala duwanaanshaha firfircoonida iyo gradients joogto ah lakab ilaa lakab. Xavier wuxuu dejiyaa kala duwanaanshaha miisaanka 2 / (fan_in + fan_out), isu dheellitirnaanta baasasyada hore iyo kuwa dambe ee hawlgelinta summadaha. Bilawga wuxuu isticmaalaa 2 / fan_in sababtoo ah ReLU waxay meesha ka saaraysaa qiyaastii kala badh wax soo saarkeeda, markaa labanlaabida kala duwanaanshiyaha ayaa magdhow u ah calaamadaas luntay. Eexdu waxay caadi ahaan ku bilaabataa ebe eber mar haddii summetry ay horeba u jebiyeen miisaannada aan tooska ahayn.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Bilowga Miisaanka
Lakabyada caadiga ah iyo isku xirka hadhaaga ayaa ka dhigay tababarka xoogaa xasaasi u ah bilaabista saxda ah, laakiin wali waxay muhiim u tahay shabakadaha aan caadiga ahayn ee aadka u qoto dheer. Cilmi-baarista firfircoon waxaa ka mid ah qorshayaal loo habeeyey beddelkayaal iyo feejignaan, habab u oggolaanaya shabakaduhu inay tababaraan iyada oo aan wax lakabyo caadi ah lahayn, iyo aragti sida isometry firfircoon iyo kernel tangent neural oo saadaalisa tabobarnimada bilowga kaligiis. Ku-tiirsanaanta xog-ururinta, kaas oo cabbiraya miisaanka dufcaddii muunada, waa jihada kale ee sii kordheysa.
Dhaqangelinta Adduunka-dhabta ah
CNN-ka oo adeegsata hawl-qabadyada ReLU waxa lagu bilaabaa iyada oo la bilaabayo si qoto dheer oo isugeyn ah oo tareen ah oo aan calaamado lumayn.
Shabakad leh firfircoonida tanh waxay isticmaashaa bilowga Xavier si ay u ilaaliso kala duwanaanshaha firfircoonida ee lakabyada oo dhan.
Injineer si lama filaan ah ugu bilaaba dhammaan miisaannada eber ayaa arka in shabakadu ay ku guuldareysatay inay wax barato sababtoo ah neuron kasta ayaa isku mid ah.
Qalabaynta qaab-dhismeedka (PyTorch's Kaiming, Lebiska Glorot ee Keras) ayaa si toos ah u dabaqa bilowga mabda'a leh marka lakab la sameeyo.
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Weight Initialization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Celceliska Miisaanka Stochastic
Su'aalaha soo noqnoqda
What is Weight Initialization?
Sida aad u dejiso miisaanka bilowga shabakada neerfaha ka hor inta aan tababarka bilaabin, kaas oo si adag u qaabeeya in calaamadaha iyo gradients ay caafimaad qabaan iyada oo loo marayo lakabyo qoto dheer. Bilawga wanaagsani waa faraqa u dhexeeya isku xidhka degdega ah iyo qaabka aan waligiis baran.
Waa maxay sababta dhammaan miisaanka oo dhan eber loogu dhigay khalad dilaa ah?
Miisaannada isku midka ah, neuron kastaa wuxuu xisaabiyaa isla wax soo saar iyo gradient, si ay si isku mid ah u cusboonaysiiyaan lakabkuna waligiis ma baran karo astaamo kala duwan.
He (Kaiming) bilawga si gaar ah ayaa loogu talagalay shaqada hawlgelinta?
Waxa uu bilawga u miisaamayaa kala duwanaanshaha 2 / fan_in si uu u magdhabo ReLU eberitaanka kala badh ka mid ah agabkeeda.
Waa maxay hadafka ugu weyn ee qorshayaasha bilowga miisaanka mabda'a leh?
Qorshayaasha sida Xavier iyo Isagu wuxuu ka doortaa kala duwanaanshaha miisaanka marka loo eego cabbirrada lakabka si ay calaamaduhu aanay u lumin ama u qarxin markay faafinayaan.
Xavier (Glorot) bilawga ugu fiican ayaa ku habboon shabakadaha isticmaalaya firfircoonidee?
Xavier wuxuu dheellitirayaa kala duwanaanshiyaha hore iyo gadaalba ee summeeyayaasha, dhaqdhaqaajinta dheellitiran sida tanh iyo sigmoid.
Waa maxay sababta uu bilaabista u isticmaalo kala duwanaanshiyaha 2 / fan_in halkii uu ka isticmaali lahaa 1 / fan_in?
ReLU waxay dhaaftaa wax-soo-saarka togan oo kaliya, iyadoo iska tuuraysa kala badh calaamadda, markaa laba-laabashada kala duwanaanshiyaha waxay soo celisaa kala duwanaanshaha firfircoonida ee la filayo.