Jijiya Tangent Kernel Theory
Neural Tangent Kernel (NTK) kayan aikin lissafi ne wanda ke nuna cewa cibiyoyin sadarwa mara iyaka mara iyaka suna aiki kamar ƙayyadaddun hanyar kwaya a lokacin horo.
Dubawa
It matters because it turns mysterious deep learning into something with closed-form, analyzable equations.
Zurfafa nutsewa
Jacot, Gabriel, da Hongler ne suka gabatar da su a cikin 2018, ka'idar NTK tana nazarin abin da ke faruwa yayin da yadudduka na cibiyar sadarwa ke zama marar iyaka. A cikin wannan iyaka, horarwa tare da zuriyar gradient yana daina zama tafiya mara kyau: ma'aunin cibiyar sadarwa da kyar ke motsawa daga farkon farawarsu (tsarin '' horon kasala ''), kuma aikin da yake ƙididdigewa yana tasowa a layi, wanda kernel ke tafiyar da shi a duk lokacin horo. Wannan kwaya - samfurin ciki na gradients dangane da sigogi - shine NTK. Saboda koma bayan kwaya yana da ainihin mafita, zaku iya hasashen fitowar cibiyar sadarwar da aka horar ba tare da horar da ita ba. NTK ya bayyana dalilin da ya sa manyan cibiyoyin sadarwa na iya dacewa da bayanai duk da haka har yanzu suna gabaɗaya, kuma yana danganta zurfin koyo zuwa shekarun da suka gabata na hanyoyin kernel da aka fahimta da hanyoyin Gaussian.
Fahimtar Fasaha
An ayyana NTK a matsayin samfur na ciki na ma'aunin gradient na cibiyar sadarwa don abubuwa biyu: K(x, x') = ⟨∇θ f(x), ∇θ f(x')⟩. A cikin iyaka marar iyaka wannan kernel yana haɗuwa zuwa ƙima mai ƙima a farkon farawa kuma yana tsayawa yayin saukowar gradient, don haka horo yana raguwa zuwa koma bayan kwaya. Faɗin cibiyoyin sadarwa suna motsawa ƙasa da kowane siga, wanda shine ainihin dalilin da yasa layin ke riƙe.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Neural Tangent Kernel Theory
NTK shine kashin bayan ka'idar zurfin ilmantarwa na zamani, amma hanyoyin sadarwa na gaske suna koyon fasali - wani abu da kafaffen hoton kwaya ya ɓace. Bincike yanzu yana mai da hankali kan gibin da ke tsakanin halayen NTK 'lalalaci' da tsarin 'arziƙi' tsarin ilmantarwa, da kuma yin amfani da NTK don hasashen aikin gine-gine, jagorar binciken gine-ginen jijiyoyi, da ɗaure gabaɗaya. Yi tsammanin ra'ayoyin gaurayawan da ke kama lokacin da cibiyoyin sadarwa suka yi kama da kernels idan suka koyi wakilci da gaske.
Aiwatar da Gaskiyar Duniya
Hasashen fa'idar horarwar cibiyar sadarwa ta hanyar nazari don zaɓar ƙimar koyo ba tare da gudanar da gwaji mai tsada ba
Yin amfani da ma'auni na tushen NTK don sanya darajar gine-ginen ɗan takara da arha yayin binciken gine-ginen jijiyoyi
Yin bayanin dalilin da yasa cibiyoyin sadarwa masu yawa ke haɗuwa zuwa asarar horon sifili kuma har yanzu suna gaba ɗaya
Ƙirƙirar ƙimar kwaya (Tsarin Gaussian da aka yi wahayi zuwa ga NTK) don ayyuka tare da ƙananan bayanai inda ainihin ƙididdiga ta rashin tabbas ke da mahimmanci.
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Takaddun inda Ka'idar Kernel Tangent Kernel ke taimakawa kuma inda hanyoyin mafi sauƙi suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Neural Tangent Kernel Theory quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Dokokin Sikeli don hanyoyin sadarwar Jijiya
Tambayoyin da ake yawan yi
What is Neural Tangent Kernel Theory?
Neural Tangent Kernel (NTK) kayan aikin lissafi ne wanda ke nuna cewa cibiyoyin sadarwa mara iyaka mara iyaka suna aiki kamar ƙayyadaddun hanyar kwaya a lokacin horo. Yana da mahimmanci saboda yana juya zurfin koyo mai zurfi zuwa wani abu tare da rufaffiyar tsari, daidaitattun ƙididdiga.
A cikin iyaka marar iyaka, ta yaya Neural Tangent Kernel ke nunawa yayin horo?
Sakamakon NTK na tsakiya shine cewa a cikin iyaka marar iyaka kernel yana haɗuwa zuwa ƙayyadaddun ƙima kuma ya kasance mai dorewa a duk lokacin horon ƙasa.
Menene NTK ta lissafi?
NTK shine K(x,x') = ⟨∇θ f(x), ∇θ f(x')⟩, samfurin ciki na gradients na fitarwa dangane da sigogi.
Wanene ya gabatar da Neural Tangent Kernel?
An gabatar da NTK a cikin takardar 2018 ta Arthur Jacot, Franck Gabriel, da Clément Hongler.
Menene tsarin 'koyar da kasala'?
A cikin horarwar malalaci, ma'auni mai faɗin hanyar sadarwa suna tsayawa kusa da ƙimar su ta farko kuma fitowar ta samo asali ne a layi, wanda shine abin da ke sa ƙididdigar ƙayyadaddun kernel inganci.
Saboda NTK yana rage horo zuwa koma bayan kwaya, menene zai yiwu?
Kernel regression yana da rufaffiyar mafita, don haka a cikin iyakar NTK mutum na iya yin hasashen abubuwan da aka horar da cibiyar sadarwa ta hanyar nazari.