Xiga xigaHagaha xiga
Calaamadaha nuxurka AI ee Platformyada bulshada
Bulshada
Tilmaamaha aasaasiga ah
Label smoothing replaces hard one-hot targets with a softened target distribution during training.
Dhageyso hagahanAI-waa laga sheekeeyay · ~2 min
It can regularize some models, but its effects on accuracy, calibration, and distillation depend on the task, model, and evaluation.
With K classes, one common label-smoothing convention assigns 1 − ε to the correct class and distributes ε across the remaining classes; implementations may instead distribute ε across all classes, so check the loss definition. This prevents the target from demanding probability one for the labeled class and can discourage extreme logits. The Inception-v3 work and the Transformer paper are prominent documented uses of the method. Research has found calibration and generalization benefits in some settings, while also showing that smoothing can remove information about similarities among incorrect classes and weaken a model as a knowledge-distillation teacher. It is therefore not a universal accuracy or calibration improvement. Choose ε and evaluate calibration, task quality, and downstream distillation on representative validation data.
Kala soocidda ImageNet: Inception-v3 waxay adeegsatay summaynta fududaynta (epsilon 0.1) si kor loogu qaado saxnaanta-1 sare loona yareeyo kalsoonida xad dhaafka ah.
Turjumaada mashiinka: Transformer-kii asalka ahaa ayaa lagu dabaqay sumadda fududaynta ee 0.1, ka ganacsiga jaahwareerka yar ee buundooyinka BLEU sare.
Aqoonsiga hadalka: bartilmaameedyada la simay waxay yareeyaan kalsooni-darrada xad-dhaafka ah waxayna wanaajiyaan habaynta maqalka buuqa badan.
Moodooyinka sawir-qaadista caafimaadka: fududayntu waxay soo saartaa ixtimaalka si ka wanaagsan loo cabbiray, oo muhiim ah marka buundada kalsoonida ay ku wargeliso go'aamada caafimaad.
Summaynta summadaha ayaa weli ah mid aan ku habboonayn tababbarka ballaaran, laakiin cilmi-baaristu waxay u socotaa la qabsiga oo la bartay simayn taasoo hagaajinaysa epsilon tusaale ahaan ama fasalka halkii la isticmaali lahaa hal qiime siman. Hababka diiradda saaraya wax-soo-saarka sida luminta focal iyo heerkulka heerkulka ayaa inta badan lagu miisaamaa ama lagu daraa. Marka moodalku koraan oo qiyaasaha hubin la'aanta la isku halayn karo ay noqdaan kuwo badbaado-muhiim ah, filo in fududayntu ay noqoto mid ka mid ah aaladaha qaar badan oo ka mid ah soo saarista buundooyinka kalsoonida lagu kalsoonaan karo, iyada oo fiiro gaar ah loo leeyahay iskahorimaadka la og yahay ee distillation.
Warqad bilaash ah
Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.
Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.
Is tijaabi
Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.
Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq
Label smoothing replaces hard one-hot targets with a softened target distribution during training. It can regularize some models, but its effects on accuracy, calibration, and distillation depend on the task, model, and evaluation.
Halkii aad ka lahaan lahayd bartilmaameed adag 1.0/0.0, ku calaamadee silbashada (1-epsilon) fasalka runta ah oo ku faafi epsilon kuwa kale.
Smoothing softens the target distribution so the training objective does not demand a one-hot probability vector.
Inception-v3 and the Transformer paper are prominent documented uses of label smoothing; this wording makes no claim that either originated the technique.
Research reports calibration effects that depend on the model and evaluation setting; label smoothing is not a universal calibration guarantee.
Adigoo adkaynaya rucubyada oo la simay cilaaqaadka jilicsan ee u dhexeeya fasallada, fududayntu waxay meesha ka saari kartaa macluumaadka ay aqoontu ku tiirsan tahay.
Sii wad waxbarashada
Tilmaamayaal badan ayaa loo doortay mawduucan
Xiga xigaHagaha xiga
Calaamadaha nuxurka AI ee Platformyada bulshada
Bulshada