Nesterov Degdega Kediska Gradient

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

1. Waa maxay fikradda qeexan ee Nesterov Accelerated Gradient marka la barbar dhigo xawaaraha qadiimiga?
   • Waxay meesha ka saartaa dhaqdhaqaaqa gebi ahaanba
   • Waxay isticmaashaa heerka waxbarashada go'an ee 1.0
   • Waxay ku qiimeysaa jaan-goynta halka hore loo eegayo halkii ay hadda taagan tahay
   • Waxa kaliya oo ay shaqeysaa iyada oo aan lahayn dufcad-yar
2. Waa maxay heerka isu-gudbinta la hubo ee habka Nesterov uu ku gaadhayo mashaakilaadka qallafsan?
   • Dalabka 1/k^2
   • Dalbo 1/k
   • Dalbo 1/log k
   • Heer dammaanad ma leh
3. Yaa markii hore soo bandhigay habkan dardargelinta?
   • Geoffrey Hinton sanadkii 2012
   • Isaac Newton
   • John von Neumann
   • Yuri Nesterov in 1983
4. Waa maxay sababta u-fiirinta hor-u-fiirinta u caawiso u dhow minima qaloocan?
   • Waxay kordhisaa heerka waxbarashada
   • Waxay filaysaa xatooyada xad dhaafka ah waxayna dalbataa sixitaan ka hor intaysan dhicin
   • Waxay tirtirtaa ereyga xawaaraha
   • Waxay kala soocaysaa jihada loo socdo
5. Ficil ahaan, sidee ayuu qiimaha xisaabinta ee Nesterov u barbardhigaa xawaaraha qadiimiga ah?
   • Qiyaas ahaan isku mid, mahad aljabra ahaan dib loo habeeyay
   • In ka badan toban jeer
   • Waxay u baahan tahay derivatives labaad tallaabo kasta
   • Laguma xisaabin karo GPU-yada
6. Keebaa hagaajinta la qabsiga isku dara Nesterov-fiirinta hore iyo isku-dheellitirka qaabka Adam?
   • RMSprop
   • Cadaagrad
   • Nadaam
   • LBFGS
7. Using the stated look-ahead form, theta = 10, learning rate = 0.1, beta = 0.9 and velocity = 2 give which evaluation point?
   • 10.18
   • 9.82
   • 8.20
   • 10.90
8. If beta is zero in the guide’s Nesterov look-ahead formula, where is the gradient evaluated?
   • At a point displaced by the full old velocity
   • At the previous validation score
   • At an arbitrary future minibatch
   • At the current parameter position