AMABWIRIZA Yibanze
Nesterov Yihuta
Nesterov yihuta ya Gradient (NAG) nuburyo bwubwenge bwimbaraga zireba imbere mbere yo kubara gradient, ikayiha gukosora-imbere.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
Bikunze guhuza byihuse kandi bihamye kuruta imbaraga za kera.
Kwibira cyane
Umuvuduko wa classique ubara gradient kumwanya uriho, hanyuma ukongeraho umuvuduko wuzuye. Ubushishozi bwa Nesterov, buva mu bikorwa bya Yurii Nesterov mu 1983 ku bijyanye no kwihutisha imiyoboro ya convex, ni ukubanza gutera intambwe yihuta kugera ku kureba imbere no gusuzuma icyiciro kiriho. Ibi bituma optimizer iteganya aho umuvuduko uyitwara hanyuma ugashyiraho ikosora mbere yo kurasa, nkuwiruka ubona umurongo imbere kandi ugahindura hakiri kare kuruta nyuma. Kubibazo byoroshye convex uburyo bwa Nesterov bugera ku gipimo cyiza cyo guhuza gahunda ya 1 / k ^ 2 mu mubare wintambwe, iterambere ryagaragaye hejuru yikigereranyo cya 1 / k. Mu myigire yimbitse itangwa nkuburyo bworoshye mubice byinshi kandi akenshi bitanga umusaruro byihuse, imyitozo idahungabana kuruta imbaraga zisanzwe kuri coefficient imwe.
Gushyira mu bikorwa Isi
Gushoboza nesterov = Ibendera ryukuri muri PyTorch cyangwa TensorFlow SGD kugirango imyitozo yihuse, yoroshye.
Kwihutisha guhuza ibibazo byoroshye convex nkibinini binini byo gusubira inyuma.
Kugabanya kurenza urugero no kunyeganyega mugihe uhugura imiyoboro yimbitse hafi ya minima ityaye.
Guha imbaraga Nadam optimizer, yongeraho Nesterov kureba-imbere kuri Adam.
Kazoza ka Nesterov Kwihuta Gradient
Umuvuduko wa Nesterov ni ibendera ryubatswe muri optimizers hakurya ya PyTorch, TensorFlow, nizindi, hamwe na Nesterov ya Adam (Nadam) ihuza kureba imbere hamwe no gupima imiterere. Igitekerezo cyihuta cyacyo gikomeje gushishikariza ubushakashatsi muburyo bwihuse, gutangira gahunda, no gusesengura impamvu kwihuta bifasha mumiyoboro yimbitse idahuza. Witege-Nesterov-reba-imbere kugirango ikomeze guceceka bisanzwe kubimenyereza biruka byihuse, bihamye.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Ibyemezo bisobanutse. Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
- Igiciro na bije. Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
- Itsinda hamwe nakazi. Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Witondere
- Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
- Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
- Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Intambwe ikurikira
- Tangira nururimi rusobanutse rwibisubizo ukeneye.
- Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
- Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
- Inyandiko aho Nesterov yihuta Gradient ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Fata ikibazo cya Nesterov cyihuta
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
Niki Nesterov Yihuta Gradient?
Nesterov yihuta ya Gradient (NAG) nuburyo bwubwenge bwimbaraga zireba imbere mbere yo kubara gradient, ikayiha gukosora-imbere. Bikunze guhuza byihuse kandi bihamye kuruta imbaraga za kera.
Niki gitekerezo gisobanura Nesterov yihuta Gradient ugereranije nimbaraga za kera?
Nesterov yabanje gukoresha intambwe yihuta kugirango agere kumwanya-ureba imbere, hanyuma abare icyiciro kiriho, atanga ikosora riteganijwe.
Ni ubuhe buryo bugaragara bwo guhuza uburyo Nesterov ageraho kubibazo byoroshye?
Uburyo bwihuse bwa Nesterov bugera ku gipimo cyiza cya 1 / k ^ 2 ku ntego za convex zoroshye, byihuse kuruta icyiciro cya 1 / k.
Ninde watangije ubu buryo bwihuse bwa gradient?
Yurii Nesterov yasohoye uburyo bwihuse bwa gradient mu 1983 kugirango optime nziza.
Ni ukubera iki kureba-imbere bigenda bifasha hafi ya minima yagoramye?
Mugusuzuma icyiciro aho umuvuduko ugana, Nesterov arashobora gukosora igicucu cyegereje kare kuruta imbaraga za kera.
Mubimenyerezo, nigute ibiciro byo kubara imbaraga za Nesterov bigereranywa nimbaraga za kera?
Frameworks ishyira mubikorwa uburyo bwahinduwe kuburyo Nesterov yongeraho igiciro cyinyongera kirenze imbaraga zisanzwe.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo