Kumanuka Kubiri
Kumanuka kabiri ni ibintu bitangaje kubona ko uko icyitegererezo kiba kinini, ikosa ryikizamini ryabanje kuba bibi hafi ya 'interpolation limit' ariko hanyuma rikarushaho kuba ryiza - ryanga gucuruza ibitabo bya kera.
Incamake
It matters because it helps explain why enormous, overparameterized neural networks generalize well instead of overfitting.
Kwibira cyane
Ibarurishamibare rya kera ryigisha U-shusho yumurongo: nkuko urugero rwikigereranyo ruzamuka, ikosa ryikizamini rigwa, hasi, hanyuma rikazamuka nkicyitegererezo kirenze. Kumanuka kabiri, ukunzwe na Belkin, Hsu, Ma, na Mandal muri 2019 kandi wize ku gipimo na OpenAI, byerekana umurongo ufite umanuka wa kabiri. Ikosa ryikizamini rirenga neza kuri interpolation - aho icyitegererezo gifite ibipimo bihagije kugirango bihuze buri myitozo neza (ikosa rya zeru). Shyira kera ibyo mubutegetsi burenze urugero kandi ikosa ryikizamini ryongeye kugwa, akenshi munsi yumwanya mwiza. Ingaruka imwe igaragara mubunini bw'icyitegererezo, igihe cyo guhugura ('ibihe-byubwenge' kumanuka kabiri), n'ubunini bwa dataset. Iravugurura ubwoba bwakera ko 'ibipimo byinshi bisobanura gukabya.'
Ubushishozi
Kurwego rwa interpolation hari igisubizo kimwe gihuye neza namakuru, kandi gihatirwa guhuzagurika no murwego rwo hejuru, bityo rusange muri rusange. Mubutegetsi burenze urugero, ibisubizo bitagira ingano ibisubizo bya zeru birahari, kandi buhoro buhoro kumanuka kubogamye kubogamye kugana inzira yoroshye, yo hasi-isanzwe. Uku guhitamo kubintu bito-bigoye interpolator - ntabwo ibipimo bibarwa ubwabyo - nibyo bituma umanuka wa kabiri kumanuka wikosa.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza Kabiri Kumanuka Fenomenon
Abashakashatsi bakoresha ibice bibiri kugirango banonosore amategeko yo gupima kandi bahitemo igihe cyo guhagarika imyitozo, kubera ko 'imyitozo ndende, ibe mbi, hanyuma nziza' ifite ingaruka zifatika. Tegereza ibitekerezo bikaze bihuza no guhora mu buryo butaziguye, imitsi ya tangent ya kentel, hamwe na grokking. Mubyukuri, isomo - rinini kandi rirerire rirashobora gufasha kurenga akarere k’akaga - rimaze gushimangira ibyemezo byo gutoza icyitegererezo-kinini-fatizo aho kuba kinini.
Gushyira mu bikorwa Isi
Gusobanura impamvu icyitegererezo cyururimi rwa miliyari 175-rusange rusanzwe rwiza kuruta urwego rwitondewe rwagati nubwo rufite ubushobozi bwinshi
Guhitamo kwitoza kera aho kwemeza kwemerwa byiyongera byigihe gito, kuberako ibihe-byikubye kabiri kumanuka bihanura gukira nyuma
Gupima icyerekezo cyerekanwe neza neza mugihe ibipimo bibara bihuye nubunini bwashizweho, hanyuma bikayobora byimbitse muburyo bukabije.
Kumenyesha ibyemezo-bingana ibyemezo muri AutoML kugirango abitoza birinde interpolation-yoroheje ya zone
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Double Descent Phenomenon ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Double Descent Phenomenon quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kumanuka
Ibibazo bikunze kubazwa
What is Double Descent Phenomenon?
Kumanuka kabiri ni ibintu bitangaje kubona ko uko icyitegererezo kiba kinini, ikosa ryikizamini ryabanje kuba bibi hafi ya 'interpolation limit' ariko hanyuma rikarushaho kuba ryiza - ryanga gucuruza ibitabo bya kera. Nibyingenzi kuko bifasha gusobanura impamvu imiyoboro minini, irenze urugero itagabanije imiyoboro rusange aho kuba ikwiye.
Ni he ikosa ryikizamini risanzwe rigeze kumurongo wikubye kabiri?
Ikosa ryibeshya ribera kuri interpolation, aho icyitegererezo gifite ubushobozi buhagije bwo gutwara ikosa ryamahugurwa kuri zeru hamwe nigisubizo gikomeye.
Bigenda bite kugirango ugerageze ikosa nkicyitegererezo kiba kirenze urugero?
Muburyo burenze urugero bwubutegetsi ikizamini cyamanutse kunshuro ya kabiri, aricyo gisobanura ibintu gitanga kumanuka kabiri izina ryayo.
Kuki kumanuka gahoro gahoro bifasha mubutegetsi burenze urugero?
Hamwe nibisubizo byinshi bya zeru biboneka, buhoro buhoro kumanuka kubogamye kubogamye kwerekeza kumurongo woroshye, wo hasi-bisanzwe, rusange muri rusange.
'Ibihe-byubwenge' kumanuka kabiri bivuga ingaruka zigaragara nkigikorwa cyiki?
Kumanuka kabiri birashobora kugaragara mugihe cyamahugurwa-igihe: ikosa ryikizamini rirashobora kwiyongera noneho gutera imbere nkuko imyitozo ikomeza kubihe byinshi.
Ni ikihe gitekerezo cya kera gikurura kabiri?
Ivuguruza igitabo U-gifata umurongo uvuga ko ibintu bigoye kurenza ingingo ihora yongera ikosa ryikizamini binyuze mukurenza urugero.