Grokking da Jinkirta Gabaɗaya
Grokking wani al'amari ne mai ban mamaki inda hanyar sadarwa ta farko ta haddace bayanan horon ta, tana zaune a kusa da ingancin ingancin inganci na dogon lokaci, sannan kuma ba zato ba tsammani ya mamaye tsawon lokaci bayan daidaiton horo ya kai 100%.
Dubawa
It overturns the intuition that learning and generalization happen together.
Zurfafa nutsewa
Masu bincike OpenAI ne suka gano su a cikin 2021 akan ƙananan ayyuka na algorithm kamar ƙididdiga na yau da kullun, grokking yana nuna kaifi biyu. Tun da farko, samfurin ya dace da tsarin horo daidai yayin da aikin tabbatarwa ya tsaya a kan kwatsam, yana kallon rashin bege. Sannan, bayan dubunnan ko ma miliyoyin ƙarin matakai ba tare da wani ci gaba ba, daidaiton tabbatarwa yana tsalle kwatsam zuwa cikakke. Babban bayanin shine lalata nauyi (daidaitacce) a hankali yana matsawa hanyar sadarwar don watsar da warwarewar da aka haddace da gano ƙaramin tsari, wanda aka tsara wanda a zahiri ke ɗaukar ƙa'idar da ke ƙasa, misali wakiltar ƙari na zamani azaman jujjuyawa akan da'irar. Grokking ya fi bayyane akan ƙananan kayan aikin roba, amma fahimtarsa yana ba da haske kan zurfin injiniyoyi na lokacin da kuma dalilin da yasa gabaɗaya ke fitowa.
Fahimtar Fasaha
Nazarin injinan jujjuyawar hanyoyin sadarwa na grokked kuma sun gano suna aiwatar da tsaftataccen algorithms, kamar yin amfani da abubuwan saka madauwari mai kama da Fourier don yin lissafi na yau da kullun ta hanyar gano trigonometric. Canjin ya yi daidai da ma'aunin cibiyar sadarwa ya zama mai rauni da ƙanƙantar ƙa'ida a ƙarƙashin daidaitawa: haddar yana buƙatar ma'auni masu girma, marasa daidaituwa, yayin da kewayar da'ira ta fi sauƙi. Grokking don haka yana misalta gasa tsakanin mafita mai saurin-neman haddace da saurin-zuwa tsari, mafi inganci gama gari.
Dabarun Tasiri
Shawarwari masu haske
Yana taimaka muku keɓance bayyanannen da'awar fasaha daga harshen talla.
Kudin da kasafin kuɗi
Kuna iya yin mafi kyawun tambayoyin aiwatarwa kafin kashe kuɗi ko lokaci.
Ƙungiya da aikin aiki
Ƙungiyoyin da ke da fahimtar juna suna yin mafi kyawun samfura, manufofi, da yanke shawara na koyo.
Makomar Grokking da Jinkirta Gaba ɗaya
Grokking shine taga a cikin ilimin kimiyya na gama gari wanda masu bincike ke fatan haɓakawa. Buɗe tambayoyin sun haɗa da ko jinkirin gama gari yana faruwa a shiru cikin manyan samfura, yadda ake ganowa ko haɓaka canjin canji, da abin da yake nufi don sanin lokacin da ƙirar ta koyi dabara da gaske tare da misalan haddar. Hankali na iya ba da labari mafi kyawun daidaitawa, jadawalin horo, da kayan aikin fassara, kuma zai iya taimakawa hasashen iyawar gaggawa a cikin manyan nau'ikan harshe.
Aiwatar da Gaskiyar Duniya
Yin nazarin ayyukan ƙididdiga na yau da kullun don jujjuya-injiniya ainihin da'irori da hanyar sadarwa ke koya.
Nuna yadda lalata nauyi ke tafiyar da canji daga haddacewa zuwa gaɓoɓin gaskiya
Fahimtar binciken bincike ta hanyar ba da tsabta, cikakkiyar fahimtar halayen ƙirar don tantancewa
Gargadi masu aiki cewa farkon tabbatar da faranti ba koyaushe yana nufin ƙirar ta gaza koya ba
Hatsari & Tsare-tsare
Ƙungiyoyi daban-daban na iya amfani da kalmar iri ɗaya daban, don haka ayyana iyaka da wuri.
Alamomi na iya yin kama da ƙarfi yayin da aikin zahirin duniya bai yi daidai ba.
Yin watsi da ingancin bayanai da tsare-tsaren kimantawa galibi yana haifar da sakamako mara ƙarfi.
Taswirar Hanya
Fara da ma'anar harshe a sarari na sakamakon da kuke buƙata.
Zaɓi ma'aunin nasara ɗaya da yanayin gazawa ɗaya kafin gwaji.
Gudun ƙaramin matukin jirgi tare da bayanan wakilci, ba saitin demo da aka goge ba.
Daftarin aiki inda Grokking da Jinkirta Gabatarwa ke taimakawa kuma inda hanyoyin mafi sauƙi suka fi kyau.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Grokking and Delayed Generalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Tsayawa
Tambayoyin da ake yawan yi
What is Grokking and Delayed Generalization?
Grokking wani al'amari ne mai ban mamaki inda hanyar sadarwa ta farko ta haddace bayanan horon ta, tana zaune a kusa da ingancin ingancin inganci na dogon lokaci, sannan kuma ba zato ba tsammani ya mamaye tsawon lokaci bayan daidaiton horo ya kai 100%. Yana juyar da tunanin cewa koyo da gama gari suna faruwa tare.
Menene ma'anar grokking a horon hanyar sadarwar jijiyoyi?
Grokking shine tsalle kwatsam zuwa ingantaccen ingantaccen aiki wanda ke faruwa da kyau bayan daidaiton horo ya riga ya kasance 100%.
A kan waɗanne irin ayyuka aka fara lura sosai?
OpenAI Masu bincike sun ba da rahoton yin tsokaci a cikin 2021 akan ƙananan matsalolin algorithmic na roba kamar ƙari na zamani.
Wanne abu ne aka fi yarda da shi tare da haifar da sauye-sauye zuwa gabaɗaya a cikin grokking?
Lalacewar nauyi a hankali tana kawar da hanyar sadarwar nesa da gaɓoɓin warwarewar da aka haddace zuwa ƙaƙƙarfan da'ira mai jujjuyawa.
Lokacin da masu bincike suka canza hanyar sadarwa ta grokked akan lissafi na zamani, menene suka samu?
Fassarar injina ta bayyana hanyar sadarwa ta koyi trigonometric, wakilcin madauwari don ƙididdige ƙididdiga na yau da kullun.
Me yasa aka kwatanta grokking a matsayin gasa tsakanin mafita biyu?
Cibiyoyin sadarwa da sauri suna samun mafita mai haddacewa amma, ƙarƙashin daidaitawa, a ƙarshe suna haɗuwa zuwa da'ira mai sauƙi.