Kedis ku xidhan hagaha · Adag Heerka

Kediska Caadiga Dufcada

Waxay hubisaa tirakoobka dufcadda, miisaanka affine iyo isbeddelka, celceliska socodka, xasilloonida dufcadda yar iyo sida BatchNorm uga duwan tahay LayerNorm.

Wadooyinka haga ee la xidhiidhaCaadiyan Dufcaddii
Su'aal 1 ee 8

Maxay caadi ka dhigtaa dufcadda?

Horudhac su'aal kasta8 su'aalo

Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.

  1. Maxay caadi ka dhigtaa dufcadda?
    • Gelitaanka lakabka, guud ahaan tusaalooyinka ku jira dufcada yar-yar ee hadda jirta
    • Calaamadaha wax soo saarka ugu dambeeya ee shabakada
    • Jadwalka heerka waxbarashada waqti ka dib
    • Baaxadda xogta tababarka
  2. Waa maxay sababta caadiga ah ee dufcadda ay ugu jiraan cabbirrada la baran karo gamma iyo beta?
    • Si loo kordhiyo xajmiga xogta
    • Si loo oggolaado cabbirka shabakadda oo beddelo qiyamka caadiga ah, iyadoo la ilaalinayo awoodda matalayaasha
    • In si aan kala sooc lahayn loo tuuro neurons inta lagu jiro tababarka
    • Si loo xisaabiyo shaqada khasaaraha
  3. Waa maxay faa'iidada wax ku oolka ah ee caadiga ah ee dufcadda?
    • Waxay meesha ka saaraysaa baahida loo qabo xog kasta oo tababar ah
    • Waxay dammaanad qaadaysaa in moodelku aanu dhaafi karin
    • Waxay u ogolaataa heerar waxbarasho sare iyo dhakhso badan, isku-xidhnaan badan
    • Waxay meesha ka saaraysaa baahida hawl-qabad
  4. Waqtiga go'aaminta (saadaalinta xogta cusub), waa maxay statistics ee caadiga ah ee dufcadda adeegsato?
    • Celceliska iyo kala duwanaanshaha hal gelida hadda jirta oo keliya
    • Tirakoobyada si aan kala sooc lahayn loo soo saaro mar kasta
    • Tirakoobka imtixaanka la sameeyay horay ayaa loo xisaabiyay
    • Celcelis ahaan socodsiinta celceliska iyo kala duwanaanshiyaha la ururiyay inta lagu jiro tababarka
  5. Waa maxay sababta caadiga ah ee dufcadu ay u dhaqmi karto si liidata iyada oo leh cabbirro yar oo aad u yar?
    • Tirakoobka Dufcadaha ayaa noqda qiyaaso buuq badan oo aan la isku halayn karin ee qaybinta runta ah
    • Dufcooyin yaryar ayaa ka dhigaya qaabka mid aad u weyn oo ku haboon xusuusta
    • Waxay curyaamisaa hawlaha firfircoonida
    • Dufcooyin yaryar ayaa ku qasbaya isticmaalka joogtada ah ee L1
  6. Waa kuwee farsamada caadiga ah ee inta badan lagu isticmaalo qaab-dhismeedka transformer-ka beddelka dufcadda caadiga ah?
    • Dib u dhigista caadiga ah
    • Lakabka caadiga ah
    • L2 caadiga ah ee khasaaraha
    • Goynta si tartiib ah
  7. Why does BatchNorm use running averages during inference instead of the current test batch’s statistics?
    • To retrain the model on test data
    • To make all activations exactly zero
    • So a prediction does not depend on which other examples happen to share the batch
    • To eliminate learned gamma and beta
  8. Where is BatchNorm commonly placed within a layer block according to the guide?
    • Only after the final prediction
    • Before the input data are loaded
    • Inside the optimizer update
    • Between the linear transformation and its activation function