Igitekerezo cya Neural Tangent
Neural Tangent Kernel (NTK) nigikoresho cyibibare cyerekana ko imiyoboro yagutse itagira ingano yitwara nkuburyo bwihariye, bwimikorere yimikorere mugihe cyamahugurwa.
Incamake
It matters because it turns mysterious deep learning into something with closed-form, analyzable equations.
Kwibira cyane
Yatangijwe na Jacot, Gabriel, na Hongler muri 2018, inyigisho ya NTK yiga uko bigenda nkuko urwego rwurusobe rwagutse cyane. Muri iyo mipaka, imyitozo hamwe no kumanuka igenda ihagarika kuba urugendo rwo mu gasozi rutagira umurongo: ibipimo by'urusobe ntibishobora kuva mu gutangira kwabo (ubutegetsi bw 'ubunebwe), kandi umurimo ubara bigenda bihinduka ku murongo, bigengwa na kernel ihora mu mahugurwa. Iyo kernel - igicuruzwa cyimbere cya gradients kubijyanye nibipimo - ni NTK. Kuberako intungamubiri za kernel zifite ibisubizo nyabyo, urashobora guhanura umusaruro wamahugurwa yatojwe utabanje kubitoza. NTK yasobanuye impamvu imiyoboro irenze urugero ishobora guhuza amakuru nyamara ikaba rusange muri rusange, kandi ihuza imyigire yimbitse nimyaka mirongo yuburyo bwumvikana bwimikorere yimikorere hamwe na Gaussia.
Ubushishozi
NTK isobanurwa nkibicuruzwa byimbere byurusobe rwa gradient vectors kubintu bibiri byinjira: K (x, x ') = ⟨∇θ f (x), ∇θ f (x')⟩. Mubugari butagira umupaka iyi kernel ihinduka kugiciro cyagenwe mugutangira kandi ikagumaho mugihe cyo kumanuka gahoro gahoro, bityo imyitozo igabanuka kugabanuka kwintangiriro. Imiyoboro yagutse yimuka kuri buri kintu, niyo mpamvu rwose umurongo ufata.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Kazoza ka Neural Tangent Kernel Theory
NTK ni umusingi wibitekerezo bigezweho byimbitse-yiga, ariko imiyoboro nyayo itagira ingano yiga ibiranga - ikintu gifatika-kernel ishusho yabuze. Ubushakashatsi noneho bwibanze ku cyuho kiri hagati yimyitwarire ya 'ubunebwe' NTK nubutegetsi bukize-bwo kwiga, no gukoresha NTK guhanura imikorere yubwubatsi, kuyobora ubushakashatsi bwububiko bwububiko, hamwe no guhuza rusange. Tegereza ibitekerezo bya Hybrid bifata mugihe imiyoboro yitwaye nkintangiriro nigihe biga mubyukuri.
Gushyira mu bikorwa Isi
Guteganya urusobe runini rwimyitozo ngororamubiri isesengura kugirango uhitemo igipimo cyo kwiga udafite ikigeragezo gihenze
Gukoresha ibipimo bishingiye kuri NTK kugirango ubone urutonde rwabakandida bihendutse mugihe cyo gushakisha ubwubatsi
Gusobanura mubyukuri impamvu imiyoboro irenze urugero ihuza igihombo cya zeru kandi iracyari rusange
Gushushanya intangiriro zigereranya (NTK-yahumekewe na Gaussian inzira) kubikorwa bifite amakuru mato aho kutamenya neza kugereranya ibintu
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Neural Tangent Kernel Theory ifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Neural Tangent Kernel Theory quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Amategeko yo gupima imiyoboro ya Neural
Ibibazo bikunze kubazwa
What is Neural Tangent Kernel Theory?
Neural Tangent Kernel (NTK) nigikoresho cyibibare cyerekana ko imiyoboro yagutse itagira ingano yitwara nkuburyo bwihariye, bwimikorere yimikorere mugihe cyamahugurwa. Nibyingenzi kuko bihindura imyigire yimbitse yibintu mubintu bifunze-bifunze, bisesengurwa.
Mubugari butagira umupaka, Neural Tangent Kernel yitwara ite mugihe cy'amahugurwa?
Igisubizo hagati ya NTK ni uko mubugari butagira umupaka bugarukira intangiriro ihinduka agaciro keza kandi igakomeza guhora mumahugurwa ya gradient-descente.
NTK ni iki mu mibare?
NTK ni K (x, x ') = ⟨∇θ f (x), ∇θ f (x')⟩, ibicuruzwa by'imbere bya gradients y'ibisohoka bijyanye n'ibipimo.
Ninde watangije Neural Tangent Kernel?
NTK yatangijwe mu mpapuro za 2018 na Arthur Jacot, Franck Gabriel, na Clément Hongler.
Ubutegetsi 'imyitozo y'ubunebwe' ni ubuhe?
Mu myitozo yubunebwe, imiyoboro yagutse iguma hafi yagaciro kambere kandi ibisohoka bigahinduka umurongo, aribyo bituma isesengura-ryimikorere ryemewe.
Kuberako NTK igabanya imyitozo yo gusubira inyuma, niki gishoboka?
Kwisubiraho kwa Kernel byafunze ibisubizo, kuburyo murwego rwa NTK umuntu ashobora gusesengura ibyavuye mumurongo watojwe.