Ikibazo gihuza ibibazo · Hagati Urwego
Kubura no Guturika Gradients Ikibazo
Kugenzura urunigi-amategeko agenga ibicuruzwa, kwiyuzuzamo, uburebure bwikurikiranya, inzira zisigaye nimbibi za spécran-radius heuristics.
Ikibazo 1 Bya 8
Ni ubuhe buryo bw'imibare muri backpropagation nintandaro yo kuzimira no guturika gradients?
Reba buri kibazo8 ibibazo
Ibisubizo nibisobanuro bigaragara mugihe ufata ikibazo.
- Ni ubuhe buryo bw'imibare muri backpropagation nintandaro yo kuzimira no guturika gradients?
- Kugwiza inshuro nyinshi kumurongo ukoresheje itegeko ryumunyururu
- Ongeraho gradients murwego rumwe
- Kugabanya igihombo nubunini bwicyiciro
- Gufata kare kare imizi yuburemere
- Why can sigmoid or tanh units contribute to vanishing gradients when they are saturated?
- Their derivatives are always larger than one
- Their derivatives become small in saturated regions, so repeated chain-rule products can shrink
- They remove the chain rule from backpropagation
- They force every weight to zero
- Ni ubuhe bwubatsi BURUNDU bugira ingaruka zikomeye kubibazo bigenda bikurikirana?
- Ibice bibiri
- Gusubira inyuma kumurongo umwe
- Umuyoboro uhora usubiramo udafunguye hejuru yigihe kinini
- Imbonerahamwe
- Kubona igihombo cyamahugurwa gihinduka NaN birashoboka cyane byerekana ikibazo ki?
- Kurimbuka
- Guhuza neza
- Ntoya cyane igipimo cyo kwiga
- Ibikoresho biturika
- Nigute amasano asigaye (skip) afasha mukuzimya gradients?
- Batanga gradient inzira itaziguye inzira isubira inyuma, kurenga kugabanuka kugwira
- Bakuraho ibintu byose bidafite umurongo
- Bongera igipimo cyo kwiga mu buryo bwikora
- Basiba ibice byambere
- In a simplified analysis of a recurrent linear transformation repeated over many steps, what matrix quantity is a rough signal of growth versus decay?
- The matrix trace relative to the batch size
- The spectral radius relative to one
- The number of hidden units alone
- The determinant relative to the learning rate
- A backpropagated gradient is multiplied by a factor below one at each of many layers. What trend should you expect?
- It must become exactly one
- It grows exponentially regardless of the factor
- The signal can shrink exponentially with depth
- It stops depending on earlier layers after one step
- Why can a recurrent network be especially vulnerable over a long sequence?
- The network has no hidden state
- The output layer is used only once
- The sequence is processed without a chain rule
- The recurrent transformation is applied repeatedly across timesteps, compounding its gradient effect