Guide-yakabatana mibvunzo · Pakati Nhanho
Kudzidza Kuronga Kuronga Quiz
Inotarisa warmup, cosine uye nhanho zvirongwa, tangazve maitiro, kusagadzikana kwekutanga uye yakajairika warmup-ipapo-kuora yekudzidzira resipi.
Mubvunzo 1 ye 8
Chii chinangwa chechikamu che'warmup' muchirongwa chechiyero chekudzidza?
Tarisa mubvunzo wese8 mibvunzo
Mhinduro uye tsananguro zvinoonekwa paunenge uchitora bvunzo.
- Chii chinangwa chechikamu che'warmup' muchirongwa chechiyero chekudzidza?
- Kutanga nechiyero chidiki uye kukwira kumusoro, kudzivirira kusagadzikana kubva kune ekutanga ruzha gradients
- Kuita kuti chokwadi chekupedzisira chidzike
- Kuti usvetuke mashoma ekutanga mabheji edata
- Kuomesa huremu hwese pakutanga
- Ndeipi purogiramu inonyatso tevera hafu-cosine curve pasi kusvika pachiyero chidiki?
- Nguva dzose purogiramu
- Cosine annealing
- Random schedule
- Linear kuwedzera
- Chii chinoitika kana mwero wekudzidza ukakwidzwa zvakanyanya?
- Kudzidzira kunopindirana ipapo nekurongeka kwakakwana
- Iyo modhi inodzidzisa zvishoma asi inogara ichibudirira
- Iko kurasikirwa kunogona kutsauka kana kutenderera pane kuderera
- Hapana chinoshanduka; chiyero hachina mhedzisiro
- Kuora kwedanho kunoitei pachiyero chekudzidza?
- Inowedzera iyo linearly batch imwe neimwe
- Inoichengeta zvachose
- Inoiisa zvisina tsarukano nhanho imwe neimwe
- Inodonhedza nechinhu chakagadziriswa panguva dzakafanotsanangurwa
- What does a warm restart do to a learning-rate schedule?
- It raises the learning rate again to begin another schedule cycle
- It resets the model parameters to random values
- It permanently fixes the learning rate at zero
- It deletes the optimizer’s moment estimates
- In Goyal et al.’s large-minibatch ImageNet setup, what did their warmup scheme address?
- It removed the need for a validation set
- It eased early optimization difficulties after the learning-rate scale increased with batch size
- It changed the model architecture after each epoch
- It converted the learning-rate curve into a cosine wave
- In the cosine formula, what does T denote?
- The number of model layers
- Saizi yebatch
- The schedule horizon or total number of steps used for the decay
- The optimizer’s momentum coefficient
- If the cosine schedule uses lr_min greater than zero, where does the rate approach at the end of the horizon?
- Exactly zero regardless of lr_min
- The original warmup starting rate
- An unbounded value
- The specified minimum learning rate