HejuruUbuyobozi bukurikira
Amategeko yo gupima imiyoboro ya Neural
Ibyingenzi
AMABWIRIZA Yibanze
Neural Tangent Kernel (NTK) nigikoresho cyibibare cyerekana ko imiyoboro yagutse itagira ingano yitwara nkuburyo bwihariye, bwimikorere yimikorere mugihe cyamahugurwa.
Umva iki gitaboAI-byavuzwe · ~2 min
Nibyingenzi kuko bihindura imyigire yimbitse yibintu mubintu bifunze-bifunze, bisesengurwa.
Yatangijwe na Jacot, Gabriel, na Hongler muri 2018, inyigisho ya NTK yiga uko bigenda nkuko urwego rwurusobe rwagutse cyane. Muri iyo mipaka, imyitozo hamwe no kumanuka igenda ihagarika kuba urugendo rwo mu gasozi rutagira umurongo: ibipimo by'urusobe ntibishobora kuva mu gutangira kwabo (ubutegetsi bw 'ubunebwe), kandi umurimo ubara bigenda bihinduka ku murongo, bigengwa na kernel ihora mu mahugurwa. Iyo kernel - igicuruzwa cyimbere cya gradients kubijyanye nibipimo - ni NTK. Kuberako intungamubiri za kernel zifite ibisubizo nyabyo, urashobora guhanura umusaruro wamahugurwa yatojwe utabanje kubitoza. NTK yasobanuye impamvu imiyoboro irenze urugero ishobora guhuza amakuru nyamara ikaba rusange muri rusange, kandi ihuza imyigire yimbitse nimyaka mirongo yuburyo bwumvikana bwimikorere yimikorere hamwe na Gaussia.
Guteganya urusobe runini rwimyitozo ngororamubiri isesengura kugirango uhitemo igipimo cyo kwiga udafite ikigeragezo gihenze
Gukoresha ibipimo bishingiye kuri NTK kugirango ubone urutonde rwabakandida bihendutse mugihe cyo gushakisha ubwubatsi
Gusobanura mubyukuri impamvu imiyoboro irenze urugero ihuza igihombo cya zeru kandi iracyari rusange
Gushushanya intangiriro zigereranya (NTK-yahumekewe na Gaussian inzira) kubikorwa bifite amakuru mato aho kutamenya neza kugereranya ibintu
NTK ni umusingi wibitekerezo bigezweho byimbitse-yiga, ariko imiyoboro nyayo itagira ingano yiga ibiranga - ikintu gifatika-kernel ishusho yabuze. Ubushakashatsi noneho bwibanze ku cyuho kiri hagati yimyitwarire ya 'ubunebwe' NTK nubutegetsi bukize-bwo kwiga, no gukoresha NTK guhanura imikorere yubwubatsi, kuyobora ubushakashatsi bwububiko bwububiko, hamwe no guhuza rusange. Tegereza ibitekerezo bya Hybrid bifata mugihe imiyoboro yitwaye nkintangiriro nigihe biga mubyukuri.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Neural Tangent Kernel (NTK) nigikoresho cyibibare cyerekana ko imiyoboro yagutse itagira ingano yitwara nkuburyo bwihariye, bwimikorere yimikorere mugihe cyamahugurwa. Nibyingenzi kuko bihindura imyigire yimbitse yibintu mubintu bifunze-bifunze, bisesengurwa.
Igisubizo hagati ya NTK ni uko mubugari butagira umupaka bugarukira intangiriro ihinduka agaciro keza kandi igakomeza guhora mumahugurwa ya gradient-descente.
NTK ni K (x, x ') = ⟨∇θ f (x), ∇θ f (x')⟩, ibicuruzwa by'imbere bya gradients y'ibisohoka bijyanye n'ibipimo.
NTK yatangijwe mu mpapuro za 2018 na Arthur Jacot, Franck Gabriel, na Clément Hongler.
Mu myitozo yubunebwe, imiyoboro yagutse iguma hafi yagaciro kambere kandi ibisohoka bigahinduka umurongo, aribyo bituma isesengura-ryimikorere ryemewe.
Kwisubiraho kwa Kernel byafunze ibisubizo, kuburyo murwego rwa NTK umuntu ashobora gusesengura ibyavuye mumurongo watojwe.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Amategeko yo gupima imiyoboro ya Neural
Ibyingenzi