Guide-yakabatana mibvunzo · Pakati Nhanho

Highway Networks uye Skip Connections Quiz

Edzai gedhi uye mapfupi mapfupi, gradient-kuyerera muganho, LSTM kufemerwa, transformer uye U-Net inoshandisa, uye zero-inopesana-imwe gedhi maitiro.

Nzira dzekutungamira dzinoenderanaHighway Networks uye Skip maConnections
Mubvunzo 1 ye 8

A very deep network struggles with optimization. What can a skip path provide?

Tarisa mubvunzo wese8 mibvunzo

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

  1. A very deep network struggles with optimization. What can a skip path provide?
    • A guarantee of perfect gradients at every depth
    • A more direct signal and gradient route that can ease training
    • A proof that more layers always improve accuracy
    • A replacement for the loss function
  2. Chii chinonzi residual block block compute?
    • kubuda = F(x) yakapetwa ne x
    • kubuda = x yakakamurwa naF(x)
    • kubuda = huwandu hweF (x) uye x
    • kubuda = F(x) plus x, uko x ndiyo nzira yekudimbudzira
  3. Chii chakakurudzira nzira yekugezera mumigwagwa mikuru?
    • LSTM magedhi kubva kune akadzokororwa network
    • Convolutional pooling
    • Batch normalization
    • Dropout
  4. Munetiweki yenzira huru, gedhi rekushandura T(x) rinodzora chii?
    • Chiyero chekudzidza che optimizer
    • Saizi yemufananidzo wekubuda
    • Yakawanda sei yekupinda inoshandurwa maringe nekuenda yakananga mukati
    • Huwandu hwema layer mune network
  5. Ndechipi chivakwa chemazuva ano chinotsamira pane zvakasara zvinongedzo zvakatenderedza sublayers?
    • K-zvinoreva kubatanidza
    • Muti wesarudzo
    • Linear regression
    • The transformer
  6. U-Net skip connections inobatsira sei kupatsanura?
    • Vanodzima encoder zvachose
    • Ivo vanopfuudza zvakanangana zvemamiriro ekunze kubva kune encoder kuenda kune decoder
    • Vanoshandura chifananidzo kuva chinyorwa
    • Vanoderedza nhamba yemakirasi ekubuda kune imwe
  7. In y = F(x)T(x) + x(1-T(x)), what remains when T(x)=0?
    • Only F(x)
    • The sum 2x
    • The carried input x
    • A mandatory zero output
  8. For the same coupled-gate highway form, what remains when T(x)=1?
    • The transformed value F(x)
    • Only the original x
    • F(x) plus x
    • An automatically normalized x