Kugabanuka k'ibiro na L2 Guhindura
Kugabanuka k'uburemere ni tekinike yoroshye, ikomeye yerekana uburemere bw'icyitegererezo kuri zeru mugihe cy'amahugurwa, bikabuza kwishingikiriza cyane kubintu byose.
Incamake
It reduces overfitting and is one of the most widely used regularizers in deep learning.
Kwibira cyane
Iyo icyitegererezo cyitoza, kirashobora gutombora urusaku mumibare mukura ibiro binini, byapimwe neza bihuye namahugurwa yashyizweho neza ariko muri rusange nabi. L2 isanzwe irwanya ibi wongeyeho ibihano bihwanye numubare wibipimo bya kwaduka kumurimo wo gutakaza. Optimizer ubu ifite intego ebyiri: guhuza amakuru no kugumana uburemere buto, bityo igatura ibisubizo byoroshye, bikomeye. Kugabanuka k'ibiro nigitekerezo gifitanye isano ya hafi yo kugabanya uburemere buri gice gito kuri buri ntambwe yo kuvugurura. Hamwe no kumanuka gahoro gahoro byombi birasa mubibare, ariko hamwe na optimizatifike yo guhuza n'imihindagurikire y'ikirere nka Adam baratandukanye, niyo mpamvu AdamW yatangijwe kugirango yangirike kubora uhereye kuri gradient ishingiye kandi ikitwara neza.
Ubushishozi
L2 isanzwe yongeraho lambda inshuro yuburemere bwa kwadarato kubihombo, bityo gradient yayo ikongeramo ijambo rijyanye na buri buremere, rikurura kuri zeru. Kugabanuka k'uburemere kugabanuka ahubwo kugwiza uburemere kubintu nka (1 ukuyemo kwiga_igihe inshuro lambda) muburyo butaziguye. Muburyo bwo guhuza n'imihindagurikire y'ikirere, guhuza L2 mu gihombo bituma igipimo cya perimeteri kigoreka igihano, bityo AdamW ikoresha igabanuka ukwayo, igarura gukurura imyenda igenewe kugana ibiro bito.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza ho Kugabanuka Ibiro na L2 Guhindura
Kugabanuka k'uburemere bikomeje kuba ibintu bisanzwe muburyo bwo gutoza amahugurwa y'ururimi runini hamwe nabahindura icyerekezo, kandi AdamW ubu niyo isanzwe ibatezimbere. Ubushakashatsi burakomeza muburyo kubora bifatanya na gahunda yo kwiga-igipimo cyateganijwe, urwego rusanzwe, nubunini bwikitegererezo, kuva imbaraga zacyo zihinduka uko icyitegererezo gikura. Tegereza amahame menshi, birashoboka kuri buri cyiciro cyangwa gahunda-yamenyeshejwe kubora nkuko gushakisha hyperparameter yikora hamwe no gupima-amategeko yizewe.
Gushyira mu bikorwa Isi
Ongeraho uburemere_umunsi muri AdamW cyangwa SGD optimizer ya PyTorch mugihe uhugura ibyiciro byamashusho kugirango wirinde gukabya
Guhuza coefficient ya lambda mugusubira inyuma, icyitegererezo cya L2 gihanishwa umurongo, kugirango uhindure ibyahanuwe kubintu bifitanye isano
Ururimi runini rwerekana ibintu byerekana uburemere buke (akenshi hafi 0.1) hamwe na gahunda yo kwiga
Gukomatanya kubora ibiro hamwe no kongera amakuru no guta ishuri kugirango moderi ntoya yubuvuzi-yerekana amashusho gufata mu mutwe imyitozo mike.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Kugabanuka Ibiro na L2 Guhindura bifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Weight Decay and L2 Regularization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gusanzwe
Ibibazo bikunze kubazwa
What is Weight Decay and L2 Regularization?
Kugabanuka k'uburemere ni tekinike yoroshye, ikomeye yerekana uburemere bw'icyitegererezo kuri zeru mugihe cy'amahugurwa, bikabuza kwishingikiriza cyane kubintu byose. Igabanya gukabya kandi nimwe mubikoreshwa cyane mubisanzwe biga byimbitse.
Niki L2 isanzwe yongeraho mubikorwa byo gutakaza?
L2 isanzwe yongeramo inshuro inshuro inshuro zose zingana zingana, guhana uburemere bunini no gushishikariza ibisubizo bito, byoroshye.
Ni ikihe kibazo nyamukuru kugabanuka ibiro bifasha kwirinda?
Mugukomeza ibiro bito, kubora bigabanya urugero rwurusaku rukwiye, kunoza rusange kugeza kumakuru mashya.
Ni kihe cyerekezo kubora gusunika uburemere bwikitegererezo?
Kubora ibiro bigabanya ibiro kuri zeru kuri buri vugurura, niyo mpamvu rimwe na rimwe bisobanurwa nk 'kubora' uburemere.
Kuki AdamW yatangijwe?
Muri Adamu, kuzinga L2 mubihombo bikorana nabi no gupima ibipimo; AdamW ikoresha kubora ukundi kugirango igarure kugabanuka kugenewe.
Kubintu byoroshye bya stochastic gradient descente, L2 isanzwe hamwe no kugabanuka ibiro bifitanye isano ite?
Hamwe na SGD isanzwe, kongeramo L2 igihano kubihombo bitanga ivugurura rimwe nkigabanuka ryibiro, kuburyo byombi bihwanye.