Jadwalka Heerka Waxbarashada
Jadwalka heerka wax-barashadu waxa uu beddelaa cabbirka tillaabada inta lagu jiro tababarka halkii uu ku hayn lahaa mid go'an.
Dulmar
Getting it right is often the single biggest lever for whether a model converges quickly and reaches high accuracy.
quusid qoto dheer
Heerka wax-barashadu waxa uu xakameeyaa sida weyn ee ay u qaaddo tillaabada hagaajinuhu u qaado cusboonaysiin kasta. Aad u sarreeya iyo tababarka kala duwan; aad u hooseeya oo gurguurta ama ku dhegto. Jadwalku wuxuu hagaajiyaa qiimahan waqti ka dib. Cunto karinta casriga ah ee caadiga ah waa diirimaad oo ay raacdo qudhun: ka bilow eber oo kor u kac dhawrka boqol ama kun ee tillaabo ee ugu horreeya (sidaa darteed goor hore, jilbaha buuqa badan ma qarxiyaan miisaan aan degganayn), ka dibna si tartiib tartiib ah hoos u dhacaya. Qaababka qudhunka ee caanka ah waxaa ka mid ah suuska talaabada (hoos u dhac ku yimaada xilliyada go'an), suuska jibbaarada, iyo ciribtirka cosine, kaas oo si habsami leh u raacaya qalooca kosine nus ilaa eber u dhow. Jadwalka Cosine-ka ee kululaynta tooska ah ayaa hadda ah heerka tababarka qaababka luqadaha waaweyn, halka siyaasadaha meerto iyo hal-wareeg ah ay soo dedejin karaan tababarka qaab-yar.
Aragtida Farsamada
Arrimaha diirran sababtoo ah hagaajinta la-qabsiga sida Adam waxay leeyihiin qiyaaso daqiiqad-dabaad ah oo aan la isku halayn karin ee tallaabooyinka ugu horreeya; heerka waxbarashada yar ayaa ka fogaanaya xasiloonidarada miisaanka ka hor inta aan tirakoobyadaas la dejin. Cosine annealing sets lr = lr_min + 0.5 * (lr_max - lr_min) * (1 + cos(pi * t / T)), siinta horumar degdeg ah goor hore oo yar, tillaabooyin hagaajin ah oo ku dhow dhamaadka. Jadwallada qaarkood waxay ku daraan dib-u-bilaabid diiran, iyagoo heerka dib ugu boodaya si ay uga baxsadaan wax yar oo fiiqan.
Saamaynta Istiraatijiyadeed
Qiimaha iyo miisaaniyada
Go'aamada qaab-dhismeedku waxay horseedaan waxqabadka iyo kharashka hawlgalka sannadaha.
Go'aamo cad
Waxbarashada farsamada waxay ka caawisaa kooxaha inay doortaan xidhmo sax ah, ma aha oo kaliya kan ugu cusub.
Xakamaynta tayada
Doorashooyinka injineernimada ee wanaagsan waxay yareeyaan shilalka la isku halleyn karo ee wax soo saarka.
Mustaqbalka Jadwalka Heerka Waxbarashada
Maaddaama uu tabobarku sii socdo uu aad qaali u yahay, jadwallada waxaa si wadajir ah loo nashqadeeyaa naqshadeeyayaasha iyo cabbirrada dufcadaha, cilmi-baarayaashuna waxay daraasad ku sameeyaan sharciyada cabbirka si ay u saadaaliyaan heerka ugu sarreeya ee ugu sarreeya tababarka ka hor. Jadwalka bilaashka ah ee wax hagaajiya ee meesha ka saaraya baahida loo qabo in horay loo sii qaado qalooca qudhunka ah ayaa helaya jadwal, iyo la qabsi, jadwal jawaab celin ah oo ka jawaabaya qaloocyada khasaaraha nool waxay yareyn karaan tijaabinta-iyo-qallada taas oo weli ka sarreysa tababarka ballaaran.
Dhaqangelinta Adduunka-dhabta ah
Kuleyl toosan oo lagu daray suuska cosine-ka ee la isticmaalo marka la sii diyaarinayo moodooyinka luqadda beddelka.
Talaabada qudhuntay ee hoos u dhigaysa heerka barashada 10x xilliyadii 30, 60, iyo 90 marka la tababarayo kala soocida sawirka ImageNet.
Siyaasadda hal wareeg ee fast.ai si loogu tababaro moodal si sax ah loo helo wakhtiyo aad u yar.
Cosine annealing oo leh dib u bilow diiran si ay xilliyada qaar uga baxsadaan khasaaraha aadka u yar oo ay horumariyaan guud ahaan.
Khatarta & Dariiqyada Ilaalada
Hagaajinta hal bartilmaameed waxay qarin kartaa daciifnimada nidaamka ballaaran.
Kaabayaasha dhaqaalaha iyo dayactirka inta badan waa la dhayalsadaa.
Nabadgelyada iyo daldaloolada u fiirsashada ayaa kori kara marka nidaamyadu noqdaan kuwo aad u adag.
Qorshe Hawleedka Dhaqangelinta
Qeex daahida, tayada, iyo bartilmaameedyada qiimaha ka hor inta aan la hirgelin.
Benchmark marka la eego culeyska dhabta ah iyo xaaladaha xogta.
La socodka qalabka khaladaadka, leexashada, iyo saamaynta isticmaalaha.
U diyaari dib-u-noqoshada iyo dariiqyada jawaab-celinta dhacdada ka hor inta aanad miisaan.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Learning Rate Scheduling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Heerarka Barashada Wareegga
Su'aalaha soo noqnoqda
What is Learning Rate Scheduling?
Jadwalka heerka wax-barashadu waxa uu beddelaa cabbirka tillaabada inta lagu jiro tababarka halkii uu ku hayn lahaa mid go'an. Sixitaanku inta badan waa kabaalka kaliya ee ugu weyn haddii moodelku si dhakhso ah isugu keeno oo uu gaadho saxsanaan sare.
Waa maxay ujeedada marxaladda 'kulanka' ee jadwalka heerka waxbarashada?
Diirintu waxay ku bilaabataa meel eber u dhow waxayna kordhisaa heerka si aanay cusboonaysiinta hore ee aan xasiloonayn aanay u dejin moodeelka ka hor inta aanay degin tirakoobka wax hagaajinaya.
Jadwalkee ayaa si habsami leh u raacaya qalooca cosine-ka bar ee hoos ugu socda heerka ugu hooseeya?
Xididdada Cosine-ku waxay kharribtaa heerka barashada iyadoo la socota qaab nus-cosine ah, taasoo siinaysa tillaabooyin waaweyn hore iyo tillaabooyin yar yar oo dhammaadka u dhow.
Maxaa dhacaya haddii heerka waxbarashadu aad u sarreeyo?
Sicirka xad dhaafka ah wuxuu keenaa toogasho xad dhaaf ah, markaa khasaaruhu wuxuu soo boodboodi karaa ama wuu qarxi karaa halkii la dejin lahaa.
Muxuu suusku ku sameeyaa heerka waxbarashada?
Qulqulka tallabada waxa uu ku dhuftaa heerka halbeeg (tusaale, 0.1) marxaladaha la doortay, isaga oo abuuraya qaab jaranjaro.
Waa maxay sababta 'dib u bilaabashada diiran' mararka qaarkood loogu daro jadwal?
Dib u bilaabashada diirimaadku waxay kor ugu boodaan heerka waxbarashada dib u dhexeeya, iyagoo ka caawinaya hagaajinta inuu ka baxo minima cidhiidhi ah oo sahamiyo xalal wanaagsan.