Weight Initialization Quiz

Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.

1. Sei kutanga zviremu zvese kusvika zero iri chikanganiso chinouraya?
   • Maneuroni ese anogashira magradients akafanana uye haambosiyanisi (symmetry haina kuputswa)
   • Zvinoita kuti kudzidzira kuve nekukurumidza
   • Zvinokonzera kuti kurasikirwa kuve kusina kunaka
   • Inoshandisa ndangariro yakawandisa
2. Iye (Kaiming) kutanga kwakanyatso kugadzirirwa iyo activation basa?
   • Sigmoid
   • ReLU
   • Tanh
   • Softmax
3. Ndechipi chinangwa chikuru chezvirongwa zvekutanga zvehuremu?
   • Kuita kuti zviremu zvose zvienzane
   • Kuisa huremu hwese kune imwe
   • Kuchengeta musiyano we activation uye magradients angango gara ari pama layer
   • Kubvisa kudiwa kwedata
4. Xavier (Glorot) kutanga kwakanyatsokodzera kunetiweki uchishandisa kupi activation?
   • ReLU uye akasiyana ayo
   • Chete linear activations
   • Hapana activation zvachose
   • Tanh uye sigmoid
5. Sei Iye kutanga achishandisa musiyano we 2 / fan_in pane 1 / fan_in?
   • Kubhadharira ReLU kumisikidza ingangoita hafu yezvipo zvayo kusvika zero
   • Kuita kuti zviremu zvikure pasina chikonzero
   • Kuti uderedze huwandu hwema parameters
   • Kufananidza saizi yebatch
6. Ko kurerekera kunowanzotangwa sei kana huremu huchingotangwa zvisina tsarukano?
   • Kuzvinhu zvakakura chaizvo zvakanaka
   • Kusvika zero, sezvo symmetry yatotyorwa nehuremu husina kurongeka
   • Kune kukosha kwakafanana nechiyero chekudzidza
   • Kune zvisizvo zvakakura pane huremu
7. Under Xavier initialization, which quantities determine the weight variance in the guide’s formula?
   • The number of training epochs and batch size
   • The output class count alone
   • Fan-in and fan-out
   • The activation’s test accuracy
8. For a ReLU layer with fan-in 64, what variance does the He formula 2/fan_in specify?
   • 1/64
   • 1/16
   • 2/64 squared
   • 1/32