Kedis ku xidhan hagaha · Dhexdhexaad Heerka
Kediska Jadwalka diirimaadka iyo Cosine Annealing
Wuxuu tijaabiyaa kuleyliyaha doorka tababarka hore, u gudbida suuska cosine, iyo sida loo akhriyo jadwalka toosan iyo barta dhamaadka.
Su'aal 1 ee 8
Waa maxay ujeedada ugu weyn ee wejiga kululaynta ee bilowga tababarka?
Horudhac su'aal kasta8 su'aalo
Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.
- Waa maxay ujeedada ugu weyn ee wejiga kululaynta ee bilowga tababarka?
- Si loo dejiyo tababarka hore marka miisaanku yahay random iyo gradients ay buuq badan yihiin
- Si loo kordhiyo xajmiga dufcada si tartiib tartiib ah
- Si aad u qaboojiso lakabyada hoose ee moodeelka
- Si aad u cadaadiso moodalka si aad u hesho fikrad degdeg ah
- Annealing cosine waxa ay kharribasaa heerka waxbarashada ee raacaya qaabkee?
- Xariiq toosan oo toosan
- Qalooca cosine ee ku bilowda sare, fududeeya, oo ku fidsan meel eber u dhow
- Shaqo tillaabo ah oo hoos u dhacda xilliyo go'an
- Kor u kaca jibbaarada
- Kee baa ka faa'iidaysanaya kululaynta sababtoo ah qiyaasaha kala duwanaanshaheeda ayaa ah kuwa aan la isku halayn karin goor hore?
- SGD cad oo aan dardar lahayn
- Raadinta qulqulka
- Aadam iyo noocyadiisa
- K-macneheedu waa
- Qaabka cosine-ka, muxuu T ka dhigan yahay?
- Heerkulka moodeelka ee shaybaarka
- Tirada GPU-yada la isticmaalay
- Cabbirka ereyada tokenizer
- Tirada guud ee tillaabooyinka tababarka ee jadwalka
- In the guide’s warmup-plus-cosine schedule, what begins after warmup reaches its target rate?
- Cosine decay begins from the peak learning rate
- All model weights are reset
- The schedule switches to a constant zero rate
- Momentum is removed from every optimizer
- A linear warmup rises from zero to its target rate over 200 steps. About what rate is used halfway through?
- The full target rate
- About half of the target rate
- The learning rate is exactly zero
- Twice the target rate
- At the cosine horizon t = T, what multiplier does the guide’s cosine formula produce?
- Mid
- One-half
- Eber
- It becomes negative one
- Why use a gradual cosine decay after warmup rather than abruptly setting the rate to zero?
- It guarantees a global minimum
- It increases the model’s parameter count
- It removes the need to check training loss
- It lets the rate ease down so optimization can settle gradually