Ikibazo gihuza ibibazo · Biragoye Urwego

Ikizamini gisanzwe

Kugenzura imibare yicyiciro, igipimo cya affine na shift, ikigereranyo cyo kugereranya, uduce duto duto duhindagurika nuburyo BatchNorm itandukanye na LayerNorm.

Inzira zijyanye no kuyoboraIbisanzwe
Ikibazo 1 Bya 8

Ni ubuhe buryo busanzwe busanzwe busanzwe?

Reba buri kibazo8 ibibazo

Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.

  1. Ni ubuhe buryo busanzwe busanzwe busanzwe?
    • Ibyinjira kumurongo, hejuru yingero muri mini-batch iriho
    • Ibisohoka byanyuma biranga urusobe
    • Gahunda yo kwiga igipimo mugihe
    • Ingano yamakuru yamakuru
  2. Ni ukubera iki icyiciro gisanzwe kirimo ibipimo byiga gamma na beta?
    • Kongera ingano yamakuru
    • Kureka urusobe rukagereranya no guhindura indangagaciro zisanzwe, kubungabunga imbaraga zo guhagararira
    • Kugabanuka kubushake bwa neuron mugihe cyamahugurwa
    • Kubara imikorere yigihombo
  3. Ni izihe nyungu zikunze kuvugwa zifatika zo mubisanzwe?
    • Bikuraho gukenera amakuru ayo ari yo yose
    • Iremeza ko icyitegererezo kidashobora gukabya
    • Yemerera igipimo cyo kwiga cyihuse kandi cyihuse, gihamye kurushaho
    • Bikuraho ibikenewe mumikorere ya activation
  4. Mugihe cyo gufata umwanzuro (guhanura amakuru mashya), ni ubuhe mibare isanzwe isanzwe ikoresha?
    • Ibisobanuro nibitandukaniro byubu byinjijwe gusa
    • Bisanzwe byabyaye imibare buri gihe
    • Imibare yikizamini cyashyizweho ibarwa mbere
    • Gukoresha impuzandengo yikigereranyo hamwe nibitandukanya byegeranijwe mugihe cy'amahugurwa
  5. Ni ukubera iki icyiciro gisanzwe gishobora kwitwara nabi hamwe nubunini buto cyane?
    • Ibarurishamibare ryuzuye rihinduka urusaku kandi rwizewe rwo kugabura kwukuri
    • Ibice bito bituma moderi nini cyane kuburyo idashobora kwibuka
    • Irahagarika ibikorwa byo gukora
    • Amatsinda mato ahatira gukoresha L1 isanzwe
  6. Nubuhe buryo busanzwe bukoreshwa cyane muburyo bwo guhindura ibintu nkuburyo busanzwe bwo gukora?
    • Ibisanzwe
    • Ibisanzwe
    • L2 bisanzwe mubihombo
    • Gukata buhoro buhoro
  7. Why does BatchNorm use running averages during inference instead of the current test batch’s statistics?
    • To retrain the model on test data
    • To make all activations exactly zero
    • So a prediction does not depend on which other examples happen to share the batch
    • To eliminate learned gamma and beta
  8. Where is BatchNorm commonly placed within a layer block according to the guide?
    • Only after the final prediction
    • Before the input data are loaded
    • Inside the optimizer update
    • Between the linear transformation and its activation function