Maswali yanayounganishwa na mwongozo · Kati Kiwango
Maswali ya Muda Mrefu ya Seli za Kumbukumbu za Muda Mfupi
Jaribu majukumu ya lango la LSTM, uhifadhi wa hali ya seli, udhibiti wa ingizo na utoaji, masasisho ya nyongeza, mtiririko wa upinde rangi na vikomo vya mfuatano.
Swali 1 ya 8
In a common modern three-gate LSTM variant, which gates regulate cell information and exposed output?
Hakiki kila swali8 maswali
Majibu na maelezo huonekana unapojibu maswali.
- In a common modern three-gate LSTM variant, which gates regulate cell information and exposed output?
- Soma, andika na utekeleze milango
- Anza, simama, na usimamishe milango
- Sahau, ingizo, na milango ya pato
- Encode, decode, na kuhudhuria malango
- What training difficulty was LSTM designed to mitigate?
- Vigezo vingi sana vya kuhifadhi
- Vanishing gradients during learning over long sequences
- Kutokuwa na uwezo wa kutumia GPU
- Ukosefu wa kazi ya kuwezesha
- Nani alianzisha LSTM, na mwaka gani?
- Vaswani na wenzake mnamo 2017
- Rumelhart na Hinton mnamo 1986
- LeCun na Bengio mnamo 2012
- Hochreiter na Schmidhuber mnamo 1997
- In a common LSTM cell update, why can the additive cell-state path help gradient flow?
- It reduces reliance on repeated multiplicative transformations across time steps
- Inazidisha hali kwa idadi kubwa kila hatua
- Inafuta hali kila hatua
- Inafungia uzito wote wakati wa mafunzo
- Ni kazi gani ya kuwezesha ambayo milango ya LSTM kawaida hutumia kufanya kama swichi laini za kuwasha/kuzima?
- ReLU, ikitoa 0 hadi infinity
- Softmax juu ya msamiati
- Chaguo la kukokotoa la hatua linatoa 0 au 1 haswa
- Sigmoid, ikitoa 0 hadi 1
- Kwa nini Transfoma kwa kiasi kikubwa imebadilisha LSTM kwa muundo wa lugha kwa kiwango kikubwa?
- Transfoma haiwezi kushughulikia maandishi hata kidogo
- LSTM hazihitaji mafunzo
- Transfoma hulinganisha katika mfuatano na kunasa muktadha wa masafa marefu kupitia umakini
- Transfoma hutumia nambari chache zaidi kwa jumla
- If an LSTM forget gate is near one and its input gate near zero, what happens to the cell state?
- It largely retains the previous state
- It is forced to zero
- It becomes the raw input token
- It must reverse the sequence
- Which gate controls how much of an LSTM cell’s stored state is exposed as output?
- The forget gate alone
- The output gate
- The optimizer momentum term
- The positional encoding gate