Heerarka Barashada Wareegga
Heerarka waxbarashada meertadu waxay si isdaba joog ah u wareegaan heerka waxbarashada kor iyo hoos inta u dhaxaysa xadka hoose iyo kan sare halkii ay ka qudhmi lahaayeen oo kaliya.
Dulmar
This counterintuitive bouncing can speed up convergence and helps the optimizer escape sharp local minima and saddle points.
quusid qoto dheer
Waxaa soo jeedisay Leslie Smith sanadka 2015, heerarka barashada meertada ah (CLR) waxay caqabad ku tahay malo-awaalka ah in sicirku waligii hoos u dhaco. Taa beddelkeeda, waxay u kala wareegtaa inta u dhaxaysa ugu yaraan iyo ugu badnaan iyada oo ku xidhan tiro go'an oo ku celcelin ah ('wareeg'), oo badanaa leh qaab saddex xagal ah. Dareenka: kor u qaadida sicirka xilliyada qaar ayaa bixisa tamarta dilaaca taas oo u ogolaanaysa moodelku in uu ka boodo masaakiinta, minima fiiqan iyo dhibcooyinka kooraha la maro, halka wejiyada hoose ay u ogolaadaan inuu dejiyo. Smith waxa kale oo uu soo bandhigay 'tijaabada kala duwan ee LR' - orod gaaban oo kor u qaadaya heerka kor u kaca marka la daawanayo khasaaraha - si loo helo xuduud wanaagsan si toos ah. Saddex-xagal, saddex-xagal-leh-dalool, iyo siyaasadda caanka ah ee hal-wareeg ah dhammaan waxay dhisaan fikradan.
Aragtida Farsamada
Siyaasadda saddex-geesoodka ah waxay si toos ah u kordhisaa heerka saldhigga ilaa ugu badnaan badhkii wareegtada, ka dibna si toos ah ayay hoos ugu dhigtaa qaybta kale. Dhererka meertadu inta badan waxa loo dejiyaa dhawr wakhti oo qiimahoodu ku cel celinayo. Siyaasadda hal-wareegga ah waxay isticmaashaa hal wareeg oo dheer: sicirku wuu kor u kacaa ka dibna wuxuu hoos u dhacayaa barta bilawga ah, halka xawaalku u socdo rogaal-celin - sare marka sicirku hooseeyo iyo lid ku ah - kaas oo u shaqeeya sidii nidaamiye oo awood u siinaya 'isku-dhafka' hawlaha qaarkood.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Heerarka Waxbarashada Wareega
Jadwalka wareegtada iyo siyaasadda hal-wareeg ah ayaa weli caan ku ah tababarka degdega ah ee ku saabsan aragga iyo hawlaha shaxda, iyo imtixaanka kala duwan ee LR waa khiyaamo habayn caadi ah. Moodooyinka luqadaha aadka u weyn, jadwallada kululaynta-iyo-cosine-ka siman waxay u muuqdaan inay xukumaan, laakiin fahamka hoose - korodhka istaraatiijiyadeed wuxuu caawinayaa inuu ka baxsado gobollada xun ee muuqaalka lumitaanka - wuxuu ogeysiiyaa dib-u-bilaabida diiran (SGDR) iyo habab isku dhafan kuwaas oo sawir-qaadista moodooyinka ku jira meertada meerto kasta. Filo sii socoshada isdhaafsiga pollination ee u dhexeeya fikradaha meertada iyo la qabsiga, jadwalayaasha is-habaynta.
Dhaqangelinta Adduunka-dhabta ah
fast.ai waxa ay faafisay siyaasadda hal-wareeg ah iyada oo ah mid u qalanta in si degdeg ah loogu tababaro kala-saareyaasha sawirka si ay u saxan yihiin wakhtiyo kooban.
Tijaabada kala duwan ee LR ayaa kor u qaadaysa heerka kor u kaca dhawr boqol oo dufcadood si loo doorto min iyo xadka ugu badan ka hor orod dhab ah.
Isku-dubbarididda sawir-qaadista waxay badbaadisaa isbaarada moodeelka ee dhammaadka wareeg kasta, iyada oo soo saarta koox bilaash ah oo ka socota hal tababar oo socod ah.
Hoos-u-dhaca Stochastic Gradient oo leh Dib-u-bilaabid Diiran (SGDR) ayaa si xilliyo ah dib ugu dejisa heerka qiime sare si uu uga baxsado ugu yaraan fiiqan.
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Cyclical Learning Rates quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Jadwalka Heerka Waxbarashada
Su'aalaha soo noqnoqda
What is Cyclical Learning Rates?
Heerarka waxbarashada meertadu waxay si isdaba joog ah u wareegaan heerka waxbarashada kor iyo hoos inta u dhaxaysa xadka hoose iyo kan sare halkii ay ka qudhmi lahaayeen oo kaliya. Soo kabashadan ka-hortagga leh waxay soo dedejin kartaa isu-tagga oo waxay ka caawisaa wax- hagaajiye inuu ka baxsado meelaha ugu yar ee gudaha iyo kooraha.
Waa maxay malo-awaalka muhiimka ah ee heerarka waxbarashada meertadu ay caqabad ku yihiin?
CLR waxay si ula kac ah kor ugu qaadaysaa heerka mar kale iyo mar kale, iyada oo diidaysa aragtida soo jireenka ah ee ah inay tahay inay si keli ah u qudhunto.
Waa maxay sababta laga yaabo inay kordhiso heerka waxbarashadu si xilliyo ah?
Burburka heerka sare wuxuu ka saari karaa hagaajinta saboolka, minima fiiqan ama ka baxsan dhibcaha kooraha si ay u hesho gobollo ka fiican.
Muxuu sameeyaa 'tijaabada kala duwan ee LR'?
Waxa ay si kooban u socotaa iyada oo si joogto ah u kordhaysa; qalooca luminta ayaa muujinaya ugu yaraan macquul ah iyo ugu badnaan si loo isticmaalo wareegyada.
Siyaasadda hal wareeg, sidee buu dardargelinta caadi ahaan u dhaqmaa marka loo eego heerka waxbarashada?
Siyaasadda hal wareeg ah waxay hoos u dhigtaa xawliga inta uu heerku sarreeyo oo kor u qaado marka uu hoos u dhaco, kaas oo ku daraya saameyn joogto ah.
Waa maxay 'isku-darka sawir-qaadista' ee macnaha guud ee jadwalka meertada?
Sababtoo ah wareeg kastaa wuxuu u dego ugu yaraan kala duwan, badbaadinta isbaarooyinkaas waxay soo saartaa noocyo kala duwan oo kala duwan oo hal orod ah oo la isku dari karo.