Kedis ku xidhan hagaha · Dhexdhexaad Heerka
Kediska Jarida Gradient
Waxay hubisaa goynta caadiga ah iyo qiimaha, ilaalinta jihada, koontaroolka is-qarxinta iyo tusaale ahaan goynta tababarka gaarka ah ee ka duwan.
Su'aal 1 ee 8
Muxuu gooyn-si-caadiyan-gooynta ugu horrayn u ilaalinayaa iyadoo la xaddidayo cusboonaysiinta?
Horudhac su'aal kasta8 su'aalo
Jawaabaha iyo sharraxaadaha waxay soo baxayaan markaad qaadanayso kediska.
- Muxuu gooyn-si-caadiyan-gooynta ugu horrayn u ilaalinayaa iyadoo la xaddidayo cusboonaysiinta?
- Jihada cusboonaysiinta gradient guud
- Baaxadda saxda ah ee gradient kasta
- Tirada qiyaasaha moodeelka
- Jadwalka heerka waxbarashada
- Sida caadiga ah clip-by-caadiga ah ee leh marinka c, maxaa dhacaya marka heerka gradient g_norm uu dhaafo c?
- Gradients ayaa lagu dejiyay eber
- Qalab kasta waxaa lagu dhuftey c/g_norm
- Tababarku wuu joogsadaa
- Heerka waxbarashadu waa labanlaab
- Dhibaato noocee ah ayaa si tartiib tartiib ah loo gooyay si gaar ah loogu talagalay in lala dagaallamo?
- Qaybaha baaba'aya
- Soo dejinta xogta oo gaabis ah
- Jaangooyooyin qarxa
- Ku-habboonaanta habka ansaxinta
- Sidee buu-qiimuhu uga duwan yahay kilib-ilaa-caadi?
- Had iyo jeer waxay ilaalisaa jihada cusboonaysiinta
- Waxa kaliya oo ay ka shaqeysaa lakabyo iswaafaqsan
- Waxay ka saartaa gebi-ahaantii
- Waxa ay si madax banaan ugu xidhaa qayb kasta oo gradient ah, taas oo bedeli karta jihada
- A minibatch produces an unusually large global gradient norm. What does clip-by-norm do before the optimizer update?
- Scales the full gradient vector down to the configured threshold when the norm exceeds it
- Changes the model’s labels
- Drops every gradient component independently
- Increases the learning rate until the loss recovers
- Tababarka gaarka ah ee kala duwan (DP-SGD), doorkee buu ka ciyaaraa jarista gradient-ka tusaale ahaan?
- Waxay siraysaa xogta
- Waxay xadaynaysaa tusaale kasta saamayntiisa sidaa darteed qaylada la cabbiray waxay dammaanad qaadi kartaa sirta
- Waxay kordhisaa xajmiga dufcada
- Waxay meesha ka saartaa baahida shaqo lumis
- The global gradient norm is twice a clipping threshold c. By what factor is the gradient scaled?
- Laba
- One quarter
- One half (c divided by 2c)
- It is left unchanged
- Why does DP-SGD clip each example’s gradient before adding calibrated noise?
- To make all examples have the same label
- To remove the need for a privacy budget
- To increase the norm of rare-class gradients
- To bound an individual example’s influence on the released update