AMABWIRIZA Yibanze

Igitekerezo cya Neural Tangent

Neural Tangent Kernel (NTK) nigikoresho cyibibare cyerekana ko imiyoboro yagutse itagira ingano yitwara nkuburyo bwihariye, bwimikorere yimikorere mugihe cyamahugurwa.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Neural Tangent Kernel Theory
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Nibyingenzi kuko bihindura imyigire yimbitse yibintu mubintu bifunze-bifunze, bisesengurwa.

Kwibira cyane

Yatangijwe na Jacot, Gabriel, na Hongler muri 2018, inyigisho ya NTK yiga uko bigenda nkuko urwego rwurusobe rwagutse cyane. Muri iyo mipaka, imyitozo hamwe no kumanuka igenda ihagarika kuba urugendo rwo mu gasozi rutagira umurongo: ibipimo by'urusobe ntibishobora kuva mu gutangira kwabo (ubutegetsi bw 'ubunebwe), kandi umurimo ubara bigenda bihinduka ku murongo, bigengwa na kernel ihora mu mahugurwa. Iyo kernel - igicuruzwa cyimbere cya gradients kubijyanye nibipimo - ni NTK. Kuberako intungamubiri za kernel zifite ibisubizo nyabyo, urashobora guhanura umusaruro wamahugurwa yatojwe utabanje kubitoza. NTK yasobanuye impamvu imiyoboro irenze urugero ishobora guhuza amakuru nyamara ikaba rusange muri rusange, kandi ihuza imyigire yimbitse nimyaka mirongo yuburyo bwumvikana bwimikorere yimikorere hamwe na Gaussia.

Gushyira mu bikorwa Isi

Guteganya urusobe runini rwimyitozo ngororamubiri isesengura kugirango uhitemo igipimo cyo kwiga udafite ikigeragezo gihenze

Gukoresha ibipimo bishingiye kuri NTK kugirango ubone urutonde rwabakandida bihendutse mugihe cyo gushakisha ubwubatsi

Gusobanura mubyukuri impamvu imiyoboro irenze urugero ihuza igihombo cya zeru kandi iracyari rusange

Gushushanya intangiriro zigereranya (NTK-yahumekewe na Gaussian inzira) kubikorwa bifite amakuru mato aho kutamenya neza kugereranya ibintu

Kazoza ka Neural Tangent Kernel Theory

NTK ni umusingi wibitekerezo bigezweho byimbitse-yiga, ariko imiyoboro nyayo itagira ingano yiga ibiranga - ikintu gifatika-kernel ishusho yabuze. Ubushakashatsi noneho bwibanze ku cyuho kiri hagati yimyitwarire ya 'ubunebwe' NTK nubutegetsi bukize-bwo kwiga, no gukoresha NTK guhanura imikorere yubwubatsi, kuyobora ubushakashatsi bwububiko bwububiko, hamwe no guhuza rusange. Tegereza ibitekerezo bya Hybrid bifata mugihe imiyoboro yitwaye nkintangiriro nigihe biga mubyukuri.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Ibyemezo bisobanutse. Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
  • Igiciro na bije. Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
  • Itsinda hamwe nakazi. Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.

Witondere

  • Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
  • Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
  • Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.

Intambwe ikurikira

  1. Tangira nururimi rusobanutse rwibisubizo ukeneye.
  2. Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
  3. Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
  4. Inyandiko aho Neural Tangent Kernel Theory ifasha kandi nuburyo bworoshye bworoshye.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Neural Tangent Kernel Theory quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Niki Neural Tangent Kernel Theory?

Neural Tangent Kernel (NTK) nigikoresho cyibibare cyerekana ko imiyoboro yagutse itagira ingano yitwara nkuburyo bwihariye, bwimikorere yimikorere mugihe cyamahugurwa. Nibyingenzi kuko bihindura imyigire yimbitse yibintu mubintu bifunze-bifunze, bisesengurwa.

Mubugari butagira umupaka, Neural Tangent Kernel yitwara ite mugihe cy'amahugurwa?

Igisubizo hagati ya NTK ni uko mubugari butagira umupaka bugarukira intangiriro ihinduka agaciro keza kandi igakomeza guhora mumahugurwa ya gradient-descente.

NTK ni iki mu mibare?

NTK ni K (x, x ') = ⟨∇θ f (x), ∇θ f (x')⟩, ibicuruzwa by'imbere bya gradients y'ibisohoka bijyanye n'ibipimo.

Ninde watangije Neural Tangent Kernel?

NTK yatangijwe mu mpapuro za 2018 na Arthur Jacot, Franck Gabriel, na Clément Hongler.

Ubutegetsi 'imyitozo y'ubunebwe' ni ubuhe?

Mu myitozo yubunebwe, imiyoboro yagutse iguma hafi yagaciro kambere kandi ibisohoka bigahinduka umurongo, aribyo bituma isesengura-ryimikorere ryemewe.

Kuberako NTK igabanya imyitozo yo gusubira inyuma, niki gishoboka?

Kwisubiraho kwa Kernel byafunze ibisubizo, kuburyo murwego rwa NTK umuntu ashobora gusesengura ibyavuye mumurongo watojwe.