Maswali yanayounganishwa na mwongozo · Kati Kiwango
Maswali ya Ratiba ya Warmup na Cosine Annealing
Hujaribu jukumu la mafunzo ya mapema la warmup, mpito hadi kuoza kwa cosine, na jinsi ya kusoma njia panda ya ratiba na sehemu ya mwisho.
Swali 1 ya 8
Kusudi kuu la awamu ya joto mwanzoni mwa mafunzo ni nini?
Hakiki kila swali8 maswali
Majibu na maelezo huonekana unapojibu maswali.
- Kusudi kuu la awamu ya joto mwanzoni mwa mafunzo ni nini?
- Ili kuleta utulivu wa mafunzo ya mapema wakati uzani ni wa nasibu na gradient ni kelele
- Ili kuongeza ukubwa wa kundi hatua kwa hatua
- Ili kufungia tabaka za chini za mfano
- Ili kubana mfano kwa uelekezaji wa haraka
- Cosine annealing huharibika kiwango cha kujifunza kufuatia umbo gani?
- Mstari wa moja kwa moja wa diagonal
- Mji wa kosini unaoanzia juu, hurahisisha, na kujaa karibu na sufuri
- Kitendaji cha hatua ambacho hushuka kwa nyakati zisizobadilika
- Mwinuko wa kielelezo kuelekea juu
- Ni kiboreshaji kipi hasa kinanufaika na joto kwa sababu makadirio yake ya tofauti si ya kutegemewa mapema?
- SGD isiyo na kasi
- Utafutaji wa gridi
- Adam na lahaja zake
- K-njia
- Katika fomula ya cosine, T inawakilisha nini?
- Joto la mfano kwa sampuli
- Idadi ya GPU zilizotumika
- Saizi ya msamiati wa ishara
- Jumla ya idadi ya hatua za mafunzo katika ratiba
- In the guide’s warmup-plus-cosine schedule, what begins after warmup reaches its target rate?
- Cosine decay begins from the peak learning rate
- All model weights are reset
- The schedule switches to a constant zero rate
- Momentum is removed from every optimizer
- A linear warmup rises from zero to its target rate over 200 steps. About what rate is used halfway through?
- The full target rate
- About half of the target rate
- The learning rate is exactly zero
- Twice the target rate
- At the cosine horizon t = T, what multiplier does the guide’s cosine formula produce?
- Moja
- One-half
- Sifuri
- It becomes negative one
- Why use a gradual cosine decay after warmup rather than abruptly setting the rate to zero?
- It guarantees a global minimum
- It increases the model’s parameter count
- It removes the need to check training loss
- It lets the rate ease down so optimization can settle gradually