Ikibazo gihuza ibibazo · Hagati Urwego

Ikibazo cya Nesterov cyihuse

Ikizamini kigezweho na reba-imbere ya gradients, gukosora umuvuduko, igipimo cya convex, igipimo cyagereranijwe, Nadam, hamwe numubare wo kureba-imbere.

Inzira zijyanye no kuyoboraNesterov Yihuta
Ikibazo 1 Bya 8

Niki gitekerezo gisobanura Nesterov yihuta Gradient ugereranije nimbaraga za kera?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Niki gitekerezo gisobanura Nesterov yihuta Gradient ugereranije nimbaraga za kera?
    • Ikuraho imbaraga rwose
    • Ikoresha igipimo gihamye cyo kwiga cya 1.0
    • Isuzuma icyiciro kuri reba-imbere aho kuba umwanya uriho
    • Ikora gusa idafite mini-batch
  2. Ni ubuhe buryo bugaragara bwo guhuza uburyo Nesterov ageraho kubibazo byoroshye?
    • Tegeka 1 / k ^ 2
    • Tegeka 1 / k
    • Tegeka 1 / log k
    • Nta gipimo cyemewe
  3. Ninde watangije ubu buryo bwihuse bwa gradient?
    • Geoffrey Hinton muri 2012
    • Isaac Newton
    • John von Neumann
    • Yurii Nesterov mu 1983
  4. Ni ukubera iki kureba-imbere bigenda bifasha hafi ya minima yagoramye?
    • Yongera igipimo cyo kwiga
    • Iteganya kurenza urugero kandi igakosora mbere yuko biba
    • Isiba ijambo ryihuta
    • Itondekanya icyerekezo
  5. Mubimenyerezo, nigute ibiciro byo kubara imbaraga za Nesterov bigereranywa nimbaraga za kera?
    • Birasa nkaho, tubikesha algebraically ivugururwa
    • Inshuro zigera ku icumi hejuru
    • Irasaba inkomoko ya kabiri buri ntambwe
    • Ntishobora kubarwa kuri GPUs
  6. Ni ubuhe buryo bwo guhuza n'imikorere ihuza Nesterov kureba-imbere hamwe no gupima imiterere ya Adam?
    • RMSprop
    • Adagrad
    • Nadam
    • LBFGS
  7. Using the stated look-ahead form, theta = 10, learning rate = 0.1, beta = 0.9 and velocity = 2 give which evaluation point?
    • 10.18
    • 9.82
    • 8.20
    • 10.90
  8. If beta is zero in the guide’s Nesterov look-ahead formula, where is the gradient evaluated?
    • At a point displaced by the full old velocity
    • At the previous validation score
    • At an arbitrary future minibatch
    • At the current parameter position