Gusanzwe
Guhinduranya ni uburyo bwa tekinike ibuza nkana icyitegererezo kuburyo rusange muri rusange amakuru mashya aho gufata mu mutwe amahugurwa.
Incamake
It is the main toolkit for fighting overfitting.
Kwibira cyane
Left unchecked, a flexible model will twist itself to fit every point in the training data, including noise. Regularization pushes back by adding a penalty or constraint that favors simpler solutions. The most common forms add a term to the loss function based on the size of the model's weights. L2 isanzwe (kubora ibiro) ihana uburemere bunini neza, kubigabanya kuri zeru no gutanga imiterere yoroshye. L1 regularization penalizes the absolute value of weights and can drive some all the way to zero, effectively selecting a subset of features. Kurenga ibihano byuburemere, guta ishuri byanze bikunze bizimya neuron mugihe cyamahugurwa, guhagarika hakiri kare guhagarika imyitozo mbere yo gukabya gushira, kandi kongera amakuru byagura amahugurwa meza. Each trades a little training accuracy for much better real-world performance.
Ubushishozi
Most regularization reshapes the objective the optimizer minimizes. Instead of just minimizing prediction error, you minimize error plus lambda times a penalty on weights, where lambda controls strength. L2 adds the sum of squared weights, encouraging many small weights; L1 adds the sum of absolute weights, encouraging sparsity with exact zeros. Ibitonyanga bikora muburyo butandukanye: kubushake bwa zeru kuri buri ntambwe, birinda neuron gufatanya guhuza no kugereranya imyitozo igizwe na subnetworks. All of these reduce variance at the cost of slightly increased bias.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza h'ubuyobozi
Ibihano bisobanutse nka L2 no guta ishuri bikomeza kuba ibisanzwe, ariko kwitabwaho ni uguhindura uburyo butaziguye, uburyo bwo guhitamo nka stochastic gradient descente bucece kubogama kuburugero runini kubisubizo rusange nubwo nta gihano cyongeyeho. Techniques such as label smoothing, mixup, and stronger data augmentation are increasingly central to training large vision and language models. Tegereza ubushakashatsi bwinshi kubwimpamvu imiyoboro irenze urugero irwanya gukabya, no muburyo bwo guhuza n'imihindagurikire ihuza imbaraga zisanzwe mu gihe cy'amahugurwa aho gushingira ku gushakisha intoki.
Gushyira mu bikorwa Isi
Ongeraho uburemere bwa L2 kubushakashatsi bwimbitse kuburyo busanzwe muri rusange kuva kumafoto ibihumbi byamahugurwa kugeza kubitagaragara.
Gukoresha L1 mubisanzwe muburyo bwa genomics kugirango uhite uhitamo intoki za genes zerekana mubyukuri ibizava mubihumbi.
Gukoresha guta ishuri murusobekerane kugirango rudashingira cyane kubimenyetso byose byabakoresha.
Guhagarika imyitozo hakiri kare gutakaza kwemeza guhagarika gutera imbere, nubwo gutakaza imyitozo bishobora gukomeza kugabanuka.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Regularisation ifasha nuburyo bworoshye bworoshye nibyiza.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Regularization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kugabanuka k'ibiro na L2 Guhindura
Ibibazo bikunze kubazwa
What is Regularization?
Regularization is a set of techniques that deliberately constrain a model so it generalizes to new data instead of memorizing the training set. Nibikoresho nyamukuru byo kurwanya birenze urugero.
Niyihe ntego yibanze yo guhora?
Guhindura bisanzwe bibuza nkana icyitegererezo cyo guca intege gufata mu mutwe amakuru yamahugurwa, kunoza imikorere kurugero rutagaragara.
Nubuhe buryo busanzwe bushobora gutwara uburemere kuri zeru, guhitamo neza ibiranga?
L1 ihana agaciro ntarengwa k'uburemere, ikunda gusunika uburemere buke bwingirakamaro kuri zeru, bukora ibintu byikora byatoranijwe. L2 igabanya ibiro neza ariko gake kuri zeru.
Nigute abata ishuri basanzwe bahuza imiyoboro yimitsi mugihe cyamahugurwa?
Kureka bidasubirwaho zeru igice cyibikorwa buri ntambwe yo guhugura, ikabuza neuron kwishingikiriza cyane kuri mugenzi wawe no kugereranya itsinda ryibikorwa bya subnetworks.
Mu gihombo gisanzwe 'ikosa + lambda × ibihano', kwiyongera kwa labda gukora iki?
Lambda igenzura imbaraga zisanzwe. Lambda nini itanga ibihano byinshi, kugabanya ibiro bikarishye kuri moderi yoroshye.
Kuki guhagarara hakiri kare bishobora gufatwa nkuburyo busanzwe?
Guhagarara iyo imikorere yo kwemeza ihagaritse gutera imbere birinda icyitegererezo gukomeza mubutegetsi aho ifata mu mutwe urusaku, kimwe nabandi basanzwe bagabanya ibibazo.