Grokking no Gutinda Rusange
Grokking nikintu gitangaje aho umuyoboro wubwonko ubanza gufata mu mutwe amakuru yamahugurwa, ukicara hafi ya zeru kwemeza igihe kirekire, hanyuma ugahita ushyira mugihe kinini nyuma yimyitozo ikwiye 100%.
Incamake
It overturns the intuition that learning and generalization happen together.
Kwibira cyane
Yavumbuwe na OpenAI abashakashatsi mu 2021 ku mirimo mito ya algorithmic nka arithmetic modular, grokking yerekana umurongo utyaye w'ibyiciro bibiri. Kera kare, icyitegererezo gihuye namahugurwa yashizweho neza mugihe ibikorwa byo kwemeza bigumaho amahirwe, bisa nkibidakwiye. Noneho, nyuma yibihumbi cyangwa na miriyoni zinyongera zintambwe zidafite iterambere rigaragara, kwemeza ukuri gutunguranye gusimbuka hafi-neza. Ibisobanuro byingenzi ni uko kugabanuka kwuburemere (guhora) bihatira buhoro buhoro urusobe kureka igisubizo cyaciwe mu mutwe no kuvumbura ikintu gifatika, cyubatswe gifata amategeko ashingiyeho, urugero nko kwerekana modular yongeyeho nkizunguruka kumuzingi. Grokking igaragara cyane kuri datasets ntoya, ariko kubyumva bitanga urumuri kumashini yimbitse yigihe n'impamvu rusange igaragara.
Ubushishozi
Ubushakashatsi bwa mehaniki bwasubije inyuma imiyoboro yabugenewe isanga bashyira mubikorwa algorithms isukuye, nko gukoresha ibizunguruka bisa na Fourier kugirango bakore imibare yimibare ikoresheje indangamuntu ya trigonometric. Inzibacyuho ifitanye isano nuburemere bwurusobekerane ruba ruke kandi ruto-rusanzwe mugihe gisanzwe: gufata mu mutwe bikenera uburemere bunini, budasanzwe, mugihe uruziga rusanzwe rworoshye. Grokking rero irerekana irushanwa hagati yihuta-kubona-gufata mu mutwe igisubizo hamwe no gutinda-gushiraho, gukora neza muri rusange.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza ha Grokking no Gutinda Rusange
Grokking ni idirishya mubumenyi bwa rusange abashakashatsi bizeye kuzamuka. Ibibazo byafunguye birimo niba gutinda muri rusange bibaho bucece imbere muri moderi nini, uburyo bwo kumenya cyangwa kwihutisha inzibacyuho, nicyo bisobanura kumenya igihe icyitegererezo cyize rwose igitekerezo hamwe ningero zafashwe mumutwe. Ubushishozi burashobora kumenyesha neza gahunda zisanzwe, gahunda zamahugurwa, hamwe nibikoresho byo gusobanura, kandi birashobora gufasha guhanura ubushobozi bugaragara mururimi runini.
Gushyira mu bikorwa Isi
Kwiga modular arithmetic imirimo kugirango uhindure-injeniyeri imirongo nyayo umuyoboro wiga
Kwerekana uburyo kugabanuka kubiro bitera guhinduka kuva mu mutwe ukajya muri rusange
Kumenyesha ubushakashatsi bwo gusobanura utanga isuku, yumvikana neza imyitwarire yicyitegererezo yo gusesengura
Kuburira abimenyereza ko kwemeza hakiri kare ntabwo bivuze ko icyitegererezo cyananiwe kwiga
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Grokking na Gutinda Rusange bifasha kandi nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Grokking and Delayed Generalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Gusanzwe
Ibibazo bikunze kubazwa
What is Grokking and Delayed Generalization?
Grokking nikintu gitangaje aho umuyoboro wubwonko ubanza gufata mu mutwe amakuru yamahugurwa, ukicara hafi ya zeru kwemeza igihe kirekire, hanyuma ugahita ushyira mugihe kinini nyuma yimyitozo ikwiye 100%. Ihirika ubushishozi ko kwiga no gushyira hamwe bibaho hamwe.
Niki gisobanura guswera mumahugurwa y'urusobe rw'imitsi?
Grokking nugusimbuka gutunguranye kubikorwa byiza byo kwemeza bibaho neza nyuma yimyitozo yukuri imaze kuba 100%.
Ni ubuhe bwoko bw'imirimo yakoreshwaga bwa mbere?
Abashakashatsi OpenAI bavuze ko bakubise mu 2021 ku bibazo bito bito bya algorithmic nkibisubizo byiyongera.
Ni ibihe bintu bikunze gushimirwa mugutwara inzibacyuho muri rusange?
Kugabanuka k'uburemere buhoro buhoro gusunika urusobe kure yumuti wafashwe mu mutwe ugana ku buryo bworoshye, rusange.
Iyo abashakashatsi bahinduye injeniyeri y'urusobekerane kuri arithmetic modular, basanze iki?
Ubusobanuro bwa Mechanistic bwerekanye urusobe rwize trigonometric, uruziga rugereranya kubara modular arithmetic.
Kuki guswera bisobanurwa nkirushanwa hagati y ibisubizo bibiri?
Imiyoboro ihita ibona igisubizo cyo gufata mu mutwe ariko, mubisanzwe, amaherezo ihurira kumurongo woroheje rusange.