Gahunda yo Kwiga Igipimo
Ingengabihe yo kwiga ihindura ingano yintambwe mugihe cyamahugurwa aho kuyifata neza.
Incamake
Getting it right is often the single biggest lever for whether a model converges quickly and reaches high accuracy.
Kwibira cyane
Igipimo cyo kwiga kigenzura uburyo intambwe optimizer itera buri vugurura. Byinshi cyane kandi bitandukanya amahugurwa; hasi cyane kandi iranyerera cyangwa igahagarara. Gahunda ihindura agaciro mugihe runaka. Uburyo busanzwe bwa kijyambere ni ubushyuhe bukurikirwa no kubora: tangira hafi ya zeru hanyuma uzamuke hejuru yintambwe magana cyangwa ibihumbi byambere (bityo hakiri kare, urusaku rw urusaku ntiruturika uburemere butajegajega), hanyuma bigabanuka buhoro buhoro. Imiterere yangirika izwi harimo kubora intambwe (kugabanuka kubintu byagenwe mugihe cyagenwe), kubora kwangirika, hamwe na cosine annealing, bikurikirana neza igice cya cosine kumurongo kugeza kuri zeru. Gahunda ya Cosine hamwe no gushyushya umurongo ubu birasanzwe mugutoza imvugo nini yindimi, mugihe politiki yikurikiranya na cycle imwe ishobora kwihutisha amahugurwa mato mato.
Ubushishozi
Warmup ifite akamaro kuko optimizateur adaptive nka Adamu ifite igereranyo cyumwanya wa kabiri wizewe mubyiciro byambere; igipimo gito cyo kwiga kirinda guhungabanya ibiro mbere yuko iyo mibare ikemuka. Cosine annealing yashyizeho lr = lr_min + 0.5 * (lr_max - lr_min) * (1 + cos (pi * t / T)), itanga iterambere ryihuse kare kandi rito, intambwe nziza yo guhuza hafi yimpera. Gahunda zimwe zongeramo ubushyuhe bushya, gusimbuka igipimo hejuru kugirango uhunge minima ityaye.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Igihe kizaza cyo Kwiga Igipimo
Mugihe imyitozo igenda ikura ihenze, gahunda zirimo gutegurwa hamwe na optimizers hamwe nubunini bwicyiciro, kandi abashakashatsi biga amategeko yo gupima kugirango bamenye igipimo cyiza mbere yo guhugurwa. Gahunda itagira gahunda ikuraho ibikenewe byo gutoranya umurongo ubora mbere bigenda byiyongera, kandi guhuza n'imikorere, guhuza ibitekerezo na gahunda isubiza umurongo wigihombo kizima bishobora kugabanya ikigeragezo-nikosa bikiganza mumahugurwa manini.
Gushyira mu bikorwa Isi
Gushyushya kumurongo wongeyeho cosine yangirika ikoreshwa mugihe cyo kwerekana imiterere yindimi.
Kubora intambwe igabanya igipimo cyo kwiga 10x mugihe cya 30, 60, na 90 mugihe uhugura ibyiciro byamashusho kuri ImageNet.
Politiki yumuzingi umwe byihuse.ai gutoza icyitegererezo kubwukuri neza mubihe bike cyane.
Cosine annealing hamwe nubushyuhe bushyashya kugirango burigihe uhunge igihombo gikabije minima no kunoza rusange.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Learning Rate Scheduling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Igipimo cyo Kwiga Cycle
Ibibazo bikunze kubazwa
What is Learning Rate Scheduling?
Ingengabihe yo kwiga ihindura ingano yintambwe mugihe cyamahugurwa aho kuyifata neza. Kubyumva neza akenshi nimwe murwego runini rwo kumenya niba icyitegererezo gihinduka vuba kandi kigera kubwukuri.
Niyihe ntego yicyiciro cya 'hotup' muri gahunda yo kwiga?
Warmup itangirira hafi ya zeru kandi ikongera igipimo kugirango ivugurura ryambere ridahungabana ntiruhungabanye icyitegererezo mbere yo guhuza imibare.
Niyihe gahunda ikurikira neza igice cya cosine kumurongo ugana ku gipimo gito?
Cosine annealing igabanya igipimo cyo kwiga ukurikije igice cya cosine, itanga intambwe nini hakiri kare nintambwe nto hafi yimpera.
Bigenda bite iyo igipimo cyo kwiga gishyizwe hejuru cyane?
Igipimo kiri hejuru cyane gitera kurasa, igihombo rero gishobora guturika cyangwa guturika aho gutuza.
Kwangirika kwintambwe gukora iki ku gipimo cyo kwiga?
Kwangirika kwintambwe kugwiza igipimo kubintu (urugero, 0.1) kubintu byatoranijwe, bikora ingazi.
Kuki 'restarts zishyushye' rimwe na rimwe zongerwa kuri gahunda?
Ubushyuhe butangiye gusimbuka igipimo cyo kwiga hejuru mugihe gito, gifasha optimizer kuva muri minima ntoya no gushakisha ibisubizo byiza.