Nesterov Yihuta
Nesterov yihuta ya Gradient (NAG) nuburyo bwubwenge bwimbaraga zireba imbere mbere yo kubara gradient, ikayiha gukosora-imbere.
Incamake
It often converges faster and more stably than classical momentum.
Kwibira cyane
Umuvuduko wa classique ubara gradient kumwanya uriho, hanyuma ukongeraho umuvuduko wuzuye. Ubushishozi bwa Nesterov, buva mu bikorwa bya Yurii Nesterov mu 1983 ku bijyanye no kwihutisha imiyoboro ya convex, ni ukubanza gutera intambwe yihuta kugera ku kureba imbere no gusuzuma icyiciro kiriho. Ibi bituma optimizer iteganya aho umuvuduko uyitwara hanyuma ugashyiraho ikosora mbere yo kurasa, nkuwiruka ubona umurongo imbere kandi ugahindura hakiri kare kuruta nyuma. Kubibazo byoroshye convex uburyo bwa Nesterov bugera ku gipimo cyiza cyo guhuza gahunda ya 1 / k ^ 2 mu mubare wintambwe, iterambere ryagaragaye hejuru yikigereranyo cya 1 / k. Mu myigire yimbitse itangwa nkuburyo bworoshye mubice byinshi kandi akenshi bitanga umusaruro byihuse, imyitozo idahungabana kuruta imbaraga zisanzwe kuri coefficient imwe.
Ubushishozi
Itandukaniro ryibanze niho hasuzumwa icyiciro. Umuvuduko usanzwe ukoresha igipimo cyibipimo bigezweho; Nesterov arabisuzuma kubireba-imbere imyanya ibice ukuyemo igipimo cyo kwiga inshuro beta inshuro umuvuduko. Iri gereranya ryateganijwe ryongeramo neza ikosora rijyanye nimpinduka ya gradient, igabanuka hejuru ya minima yagoramye. Mubikorwa byimyitozo ishyira mubikorwa ivugururwa rya algebraically kuburyo igiciro cyinyongera hejuru yumuvuduko usanzwe ari gito.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza ka Nesterov Kwihuta Gradient
Umuvuduko wa Nesterov ni ibendera ryubatswe muri optimizers hakurya ya PyTorch, TensorFlow, nizindi, hamwe na Nesterov ya Adam (Nadam) ihuza kureba imbere hamwe no gupima imiterere. Igitekerezo cyihuta cyacyo gikomeje gushishikariza ubushakashatsi muburyo bwihuse, gutangira gahunda, no gusesengura impamvu kwihuta bifasha mumiyoboro yimbitse idahuza. Witege-Nesterov-reba-imbere kugirango ikomeze guceceka bisanzwe kubimenyereza biruka byihuse, bihamye.
Gushyira mu bikorwa Isi
Gushoboza nesterov = Ibendera ryukuri muri PyTorch cyangwa TensorFlow SGD kugirango imyitozo yihuse, yoroshye.
Kwihutisha guhuza ibibazo byoroshye convex nkibinini binini byo gusubira inyuma.
Kugabanya kurenza urugero no kunyeganyega mugihe uhugura imiyoboro yimbitse hafi ya minima ityaye.
Guha imbaraga Nadam optimizer, yongeraho Nesterov kureba-imbere kuri Adam.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Nesterov yihuta Gradient ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Nesterov Accelerated Gradient quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kumanuka
Ibibazo bikunze kubazwa
What is Nesterov Accelerated Gradient?
Nesterov yihuta ya Gradient (NAG) nuburyo bwubwenge bwimbaraga zireba imbere mbere yo kubara gradient, ikayiha gukosora-imbere. Bikunze guhuza byihuse kandi bihamye kuruta imbaraga za kera.
Niki gitekerezo gisobanura Nesterov yihuta Gradient ugereranije nimbaraga za kera?
Nesterov yabanje gukoresha intambwe yihuta kugirango agere kumwanya-ureba imbere, hanyuma abare icyiciro kiriho, atanga ikosora riteganijwe.
Ni ubuhe buryo bugaragara bwo guhuza uburyo Nesterov ageraho kubibazo byoroshye?
Uburyo bwihuse bwa Nesterov bugera ku gipimo cyiza cya 1 / k ^ 2 ku ntego za convex zoroshye, byihuse kuruta icyiciro cya 1 / k.
Ninde watangije ubu buryo bwihuse bwa gradient?
Yurii Nesterov yasohoye uburyo bwihuse bwa gradient mu 1983 kugirango optime nziza.
Ni ukubera iki kureba-imbere bigenda bifasha hafi ya minima yagoramye?
Mugusuzuma icyiciro aho umuvuduko ugana, Nesterov arashobora gukosora igicucu cyegereje kare kuruta imbaraga za kera.
Mubimenyerezo, nigute ibiciro byo kubara imbaraga za Nesterov bigereranywa nimbaraga za kera?
Frameworks ishyira mubikorwa uburyo bwahinduwe kuburyo Nesterov yongeraho igiciro cyinyongera kirenze imbaraga zisanzwe.