AMABWIRIZA Yibanze

Nesterov Yihuta

Nesterov yihuta ya Gradient (NAG) nuburyo bwubwenge bwimbaraga zireba imbere mbere yo kubara gradient, ikayiha gukosora-imbere.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Nesterov Kwihuta Gradient
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Bikunze guhuza byihuse kandi bihamye kuruta imbaraga za kera.

Kwibira cyane

Umuvuduko wa classique ubara gradient kumwanya uriho, hanyuma ukongeraho umuvuduko wuzuye. Ubushishozi bwa Nesterov, buva mu bikorwa bya Yurii Nesterov mu 1983 ku bijyanye no kwihutisha imiyoboro ya convex, ni ukubanza gutera intambwe yihuta kugera ku kureba imbere no gusuzuma icyiciro kiriho. Ibi bituma optimizer iteganya aho umuvuduko uyitwara hanyuma ugashyiraho ikosora mbere yo kurasa, nkuwiruka ubona umurongo imbere kandi ugahindura hakiri kare kuruta nyuma. Kubibazo byoroshye convex uburyo bwa Nesterov bugera ku gipimo cyiza cyo guhuza gahunda ya 1 / k ^ 2 mu mubare wintambwe, iterambere ryagaragaye hejuru yikigereranyo cya 1 / k. Mu myigire yimbitse itangwa nkuburyo bworoshye mubice byinshi kandi akenshi bitanga umusaruro byihuse, imyitozo idahungabana kuruta imbaraga zisanzwe kuri coefficient imwe.

Gushyira mu bikorwa Isi

Gushoboza nesterov = Ibendera ryukuri muri PyTorch cyangwa TensorFlow SGD kugirango imyitozo yihuse, yoroshye.

Kwihutisha guhuza ibibazo byoroshye convex nkibinini binini byo gusubira inyuma.

Kugabanya kurenza urugero no kunyeganyega mugihe uhugura imiyoboro yimbitse hafi ya minima ityaye.

Guha imbaraga Nadam optimizer, yongeraho Nesterov kureba-imbere kuri Adam.

Kazoza ka Nesterov Kwihuta Gradient

Umuvuduko wa Nesterov ni ibendera ryubatswe muri optimizers hakurya ya PyTorch, TensorFlow, nizindi, hamwe na Nesterov ya Adam (Nadam) ihuza kureba imbere hamwe no gupima imiterere. Igitekerezo cyihuta cyacyo gikomeje gushishikariza ubushakashatsi muburyo bwihuse, gutangira gahunda, no gusesengura impamvu kwihuta bifasha mumiyoboro yimbitse idahuza. Witege-Nesterov-reba-imbere kugirango ikomeze guceceka bisanzwe kubimenyereza biruka byihuse, bihamye.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Ibyemezo bisobanutse. Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
  • Igiciro na bije. Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
  • Itsinda hamwe nakazi. Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.

Witondere

  • Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
  • Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
  • Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.

Intambwe ikurikira

  1. Tangira nururimi rusobanutse rwibisubizo ukeneye.
  2. Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
  3. Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
  4. Inyandiko aho Nesterov yihuta Gradient ifasha kandi nuburyo bworoshye bworoshye.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Fata ikibazo cya Nesterov cyihuta

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Niki Nesterov Yihuta Gradient?

Nesterov yihuta ya Gradient (NAG) nuburyo bwubwenge bwimbaraga zireba imbere mbere yo kubara gradient, ikayiha gukosora-imbere. Bikunze guhuza byihuse kandi bihamye kuruta imbaraga za kera.

Niki gitekerezo gisobanura Nesterov yihuta Gradient ugereranije nimbaraga za kera?

Nesterov yabanje gukoresha intambwe yihuta kugirango agere kumwanya-ureba imbere, hanyuma abare icyiciro kiriho, atanga ikosora riteganijwe.

Ni ubuhe buryo bugaragara bwo guhuza uburyo Nesterov ageraho kubibazo byoroshye?

Uburyo bwihuse bwa Nesterov bugera ku gipimo cyiza cya 1 / k ^ 2 ku ntego za convex zoroshye, byihuse kuruta icyiciro cya 1 / k.

Ninde watangije ubu buryo bwihuse bwa gradient?

Yurii Nesterov yasohoye uburyo bwihuse bwa gradient mu 1983 kugirango optime nziza.

Ni ukubera iki kureba-imbere bigenda bifasha hafi ya minima yagoramye?

Mugusuzuma icyiciro aho umuvuduko ugana, Nesterov arashobora gukosora igicucu cyegereje kare kuruta imbaraga za kera.

Mubimenyerezo, nigute ibiciro byo kubara imbaraga za Nesterov bigereranywa nimbaraga za kera?

Frameworks ishyira mubikorwa uburyo bwahinduwe kuburyo Nesterov yongeraho igiciro cyinyongera kirenze imbaraga zisanzwe.