Igipimo cyo Kwiga Cycle
Ibipimo byo kwiga byikurikiranya bizunguruka inshuro nyinshi igipimo cyo kwiga hejuru no hepfo hagati yumupaka wo hasi no hejuru aho kubora gusa.
Incamake
This counterintuitive bouncing can speed up convergence and helps the optimizer escape sharp local minima and saddle points.
Kwibira cyane
Byasabwe na Leslie Smith mu 2015, ibipimo byo kwiga byikurikiranya (CLR) birwanya igitekerezo kivuga ko igipimo kigomba kugabanuka gusa. Ahubwo, iranyeganyega hagati yumubare ntarengwa ninshi ntarengwa hejuru yumubare uteganijwe wo gusubiramo ('cycle'), akenshi ifite ishusho ya mpandeshatu. Ubushishozi: rimwe na rimwe kuzamura igipimo gitanga ingufu zituma icyitegererezo gisimbuka kiva mu mibare ikennye, minima ityaye kandi ikanyura mu matandiko, mu gihe ibyiciro bito bireka bikemuka. Smith kandi yerekanye 'LR range test' - kwiruka gato kuzamura igipimo hejuru mugihe ureba igihombo - kugirango ubone imipaka myiza mu buryo bwikora. Inyabutatu, inyabutatu-hamwe-kubora, hamwe na politiki izwi cyane ya cycle imwe yubaka kuri iki gitekerezo.
Ubushishozi
Politiki ya mpandeshatu yongerera umurongo igipimo kuva kuri base kugeza kuri max hejuru ya kimwe cya kabiri cyizengurutsa, hanyuma bikagabanuka bikagaruka hejuru yikindi gice. Uburebure bwumuzenguruko busanzwe bushyirwa mubihe bike byingirakamaro. Politiki imwe yumuzingi ikoresha uruziga rurerure: igipimo kizamuka noneho kigwa munsi yintangiriro, mugihe umuvuduko ugenda uhindagurika - hejuru iyo igipimo kiri hasi naho ubundi - ikora nkibisanzwe kandi igafasha 'super-guhuza' kumirimo imwe n'imwe.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Ejo hazaza h'ibiciro byo Kwiga Cyclical
Ingengabihe ya cycle hamwe na politiki imwe yumuzingi bikomeza gukundwa cyane mumahugurwa yihuse kubyerekezo n'imirimo ya mbonerahamwe, kandi ikizamini cya LR ni uburyo busanzwe bwo guhuza. Kuri moderi nini cyane yindimi, gahunda yo gushyushya-yongeyeho-cosine gahunda ikunda kuganza, ariko ubushishozi bwibanze - ubwo bwiyongere bwingenzi bufasha guhunga uturere tw’ahantu h’igihombo - buramenyesha uburyo bushya bwo gutangira (SGDR) hamwe nuburyo bukoreshwa bwerekana amashusho kuri buri cyiciro cyo hasi. Tegereza gukomeza gutambuka hagati yibitekerezo byikurikiranya hamwe no guhuza n'imikorere, kwishyiriraho gahunda.
Gushyira mu bikorwa Isi
byihuse.
Ikizamini cya LR gikuraho igipimo hejuru hejuru yamajana make kugirango uhitemo min na max imipaka mbere yo gukora nyabyo.
Snapshot ensembling ibika igenzura ryikitegererezo nyuma ya buri cyiciro, itanga itsinda ryubuntu kuva mumahugurwa amwe.
Stochastic Gradient Kumanuka hamwe na Warm Restarts (SGDR) burigihe igarura igipimo cyagaciro keza kugirango uhunge minima ikarishye.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Cyclical Learning Rates quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gahunda yo Kwiga Igipimo
Ibibazo bikunze kubazwa
What is Cyclical Learning Rates?
Ibipimo byo kwiga byikurikiranya bizunguruka inshuro nyinshi igipimo cyo kwiga hejuru no hepfo hagati yumupaka wo hasi no hejuru aho kubora gusa. Uku gusebanya gushobora kwihuta guhuza kandi bigafasha optimizer guhunga minima ikarishye ya minima hamwe nintambwe.
Ni ubuhe buryo bw'ibanze ibipimo byo kwiga byikurikiranya bigora?
CLR izamura nkana igipimo inshuro nyinshi, yanga igitekerezo gakondo ko kigomba kubora kimwe gusa.
Ni ukubera iki rimwe na rimwe kongera igipimo cyo kwiga bifasha?
Igipimo cyinshi gishobora gusunika optimizer ikava mubukene, minima ityaye cyangwa kuruhande rwintebe kugirango ibone uturere twiza.
'Ikizamini cya LR' ikora iki?
Irakora muri make hamwe nigipimo cyiyongera gahoro gahoro; igihombo cyo guta kigaragaza byibuze byumvikana kandi ntarengwa byo gukoresha kubizunguruka.
Muri politiki yumuzingi umwe, ni gute imbaraga zisanzwe zitwara ugereranije nigipimo cyo kwiga?
Politiki yumuzingi umwe igabanya umuvuduko mugihe igipimo kiri hejuru kandi kikazamura uko igipimo kigabanuka, ibyo bikaba byongera ingaruka zisanzwe.
Niki 'snapshot ensemble' mu rwego rwa gahunda ya cycle?
Kuberako buri cyiciro gitura byibuze bitandukanye, kubika izo bariyeri zitanga moderi zitandukanye zitandukanye uhereye kumurongo umwe ushobora guhuzwa.