Kumanuka
Ibimanuka bya Gradient nuburyo bwiza bwo kwimura ibintu byerekana uburemere bwikitegererezo kumanuka ugana ku ikosa ryo hasi, intambwe imwe icyarimwe.
Incamake
It is how learning happens once backpropagation has computed the gradients.
Kwibira cyane
Tekereza uhagaze kumusozi wijimye urimo ugerageza kugera mukibaya mugihe wumva gusa ahahanamye munsi yamaguru yawe. Gradient descente ikora neza kubwikosa ryikitegererezo. Icyiciro cya gradient mu cyerekezo cyo kwiyongera cyane mu gihombo, bityo algorithm ikandagira muburyo bunyuranye kugirango igabanye amakosa. Ingano ya buri ntambwe igenzurwa nigipimo cyo kwiga, hyperparameter yingenzi: nini cyane hamwe nicyitegererezo kirenga kandi gitandukana, gito cyane kandi gikurura imyitozo. Mu myitozo, moderi gake ikoresha imibare yuzuye kuri buri ntambwe. Stochastic gradient descente (SGD) hamwe na mini-batch variant igereranya gradient kuva ku ngero ntoya zidasanzwe, bigatuma imyitozo yihuta kandi ifasha icyitegererezo guhunga imitego idakabije hejuru yigihombo.
Ubushishozi
Buri vugurura rikurikiza amategeko yoroshye: uburemere bushya bungana nuburemere bwakera ukuyemo igipimo cyo kwiga inshuro. Mini-batch gradient descente ibara iyo gradient ku gice gito cyamakuru aho kuba yose uko yakabaye, gucuruza neza neza umuvuduko nijwi ryingirakamaro. Ibyiza bya kijyambere nka Adam byubaka kuri ibi muguhuza igipimo cyiza cyo kwiga kuri parameter no kongeramo imbaraga, ikusanya gradients zashize kugirango ihindure ihungabana kandi yihutishe iterambere binyuze mukarere kegeranye cyangwa kameze nk'imigezi y'ahantu nyaburanga.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza hamanuka
Ikibaya cya gradient descente gikoreshwa gake muri iki gihe; guhuza n'imihindagurikire y'ikirere nka Adam na AdamW biganje mu myitozo nini. Ubushakashatsi burakomeza kuri gahunda yo kwiga-igipimo, ingamba zo gushyushya, hamwe nuburyo bwa kabiri bukoresha amakuru yo kugabanuka kugirango bihuze vuba. Mugihe icyitegererezo gikura, gukwirakwizwa no kugabanwa gahoro gahoro kumanuka ibihumbi bya GPU biba ngombwa, kandi tekinike yo guhagarika ayo makuru manini ni imipaka ikora. Igitekerezo cyibanze, kurikiza icyiciro cya gradient, kizakomeza, ariko imashini zizenguruka intambwe ikomeza guhinduka.
Gushyira mu bikorwa Isi
Kugabanya ikosa ryururimi rwo guhanura miriyari zamahugurwa yerekana ibimenyetso ukoresheje mini-batch ivugururwa
Guhuza igipimo cyo kwiga kugirango moderi yishusho ihure vuba nta gihombo giturika
Gukoresha imbaraga kugirango wihutishe imyitozo y'urusobe rwo kumenyekanisha imvugo rwagumye mu kibaya kirekire, kigufi
Gushyira Adamu guhuza neza icyitegererezo kuri dataset ntoya aho ibipimo byo kwiga bifasha gutekana
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Gradient descente ifasha nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Gradient Descent quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Stochastic Gradient Kumanuka hamwe na Momentum
Ibibazo bikunze kubazwa
What is Gradient Descent?
Ibimanuka bya Gradient nuburyo bwiza bwo kwimura ibintu byerekana uburemere bwikitegererezo kumanuka ugana ku ikosa ryo hasi, intambwe imwe icyarimwe. Nukuntu kwiga bibaho iyo backpropagation imaze kubara gradients.
Ni kihe cyerekezo kumanuka bigenda byimura uburemere?
Ikigereranyo cyerekana icyerekezo cyiyongera cyane mubihombo, kugirango ugabanye igihombo intambwe ya algorithm muburyo bunyuranye (bubi).
Igipimo cyo kwiga kigenzura iki?
Igipimo cyo kwiga gipima intera ibipimo bigenda kuri buri vugurura; binini cyane, bito cyane bituma imyitozo itinda kubabaza.
Nigute itandukaniro rikomeye cyangwa mini-batch igenda itandukana no gukoresha imibare yuzuye?
Mini-batch na stochastic gradient descente igereranya gradient ukoresheje ingero ntoya, byihutisha imyitozo kandi byongera urusaku rufasha.
Ni ikihe kibazo igipimo cyo kwiga ari kinini cyane?
Intambwe nini zirashobora gusimbuka kurenza byibuze hanyuma zigaturika cyangwa zigaturika, bigatuma igihombo cyiyongera aho gutuza.
Niki imbaraga ziyongera kumanuka gahoro gahoro?
Momentum itwara impuzandengo yikigereranyo cya gradients zashize, ifasha optimizer kugenda byihuse binyuze mumigezi no kugabanya ihungabana.