Tilmaamaha aasaasiga ah

Guud ahaan dib u dhaca iyo dib u dhigista

Grokking waa dhacdo la yaab leh halkaas oo shabakada neural ay marka hore xifdiso xogta tababarka, ku fadhido meel u dhow saxnaanta ansaxinta wakhti dheer, ka dibna si lama filaan ah u soo koobto muddo dheer ka dib saxnaanta tababarku 100%.

2 daqiiqo akhriMarkii u dambaysay ee la cusbooneysiiyay

Dulmar

It overturns the intuition that learning and generalization happen together.

quusid qoto dheer

Waxaa helay OpenAI cilmi-baarayaal sanadka 2021 hawlo algorithmeedka yar yar sida xisaabta modular, grokking wuxuu muujinayaa qalooc laba waji leh. Bilowgii hore, moodeelku wuxuu si fiican ugu habboon yahay habka loo dejiyay tababarka halka waxqabadka ansaxinta uu ku jiro fursad, isagoo u muuqda mid rajo la'aan ah. Ka dib, kumanaan ama xitaa malaayiin tillaabo dheeri ah oo aan lahayn horumar muuqda, saxnaanta xaqiijintu waxay si lama filaan ah ugu booddaa mid qumman. Sharaxaada ugu horeysa waa in miisaanka qudhunka (joogteynta) ay si tartiib tartiib ah u cadaadiso shabakada si ay uga tanaasulaan xalalka xafidan ee jilicsan oo ay ogaadaan is haysta, qaabaysan kaas oo dhab ahaantii qabta xeerka hoose, tusaale ahaan ka dhigan isku-darka qaab-dhismeedka sida wareegyada wareegga. Grokking waxa ay aad uga muuqataa xog-ururinta yaryar, laakiin fahamkeedu waxa ay iftiiminaysaa makaanikada qoto dheer ee goorta iyo sababta ay u soo baxayso guud.

Aragtida Farsamada

Daraasaadka makaanikada ee shabakadaha grokked-engineered oo waxay ogaadeen inay hirgeliyaan algorithms nadiif ah, sida isticmaalka Fourier-like gundhig wareeg ah si ay u sameeyaan xisaab modular iyada oo loo marayo aqoonsiga trigonometric. Kala-guurku waxa uu la xidhiidhaa miisaannada shabakadu oo noqda mid yar oo caadi ah oo hoos yimaada habaynta: xafididdu waxay u baahan tahay miisaanyo waaweyn oo aan joogto ahayn, halka wareegga guud uu yahay mid sahlan. Grokking ayaa sidaas ku tusinaysa tartanka u dhexeeya xal xifdinta degdega ah loo helo iyo qaab gaabin ah, oo hufan mid guud.

Saamaynta Istiraatijiyadeed

Go'aamo cad

Waxay kaa caawinaysaa inaad kala saartid sheegashooyinka farsamada cad iyo luqadda suuq-geynta.

Qiimaha iyo miisaaniyada

Waxaad waydiin kartaa su'aalo fulineed oo wanaagsan ka hor inta aadan lacag ama waqti bixin.

Kooxda iyo socodka shaqada

Kooxaha fahamka la wadaago waxay sameeyaan wax soo saar, siyaasad, iyo go'aano waxbarasho oo wanaagsan.

Mustaqbalka Grokking iyo Guud ahaan dib u dhaca

Grokking waa daaqadda sayniska guud ee cilmi-baarayaashu rajeynayaan inay kor u qaadaan. Su'aalaha furan waxaa ka mid ah haddii guud ahaan dib u dhigistu ay si aamusnaan ah uga dhacdo moodooyinka waaweyn, sida loo ogaado ama loo dardargeliyo kala-guurka, iyo waxa ay ka dhigan tahay ogaanshaha marka moodalku si dhab ah u bartay fikrad iyo tusaalooyin la xafiday. Aragtidu waxay wargelin kartaa habayn ka wanaagsan, jadwal tababar, iyo agabka turjumida, waxayna kaa caawin kartaa saadaalinta awoodaha degdega ah ee qaababka luqadaha waaweyn.

Dhaqangelinta Adduunka-dhabta ah

Barashada hawlo xisaabeed modular si loo rogo-injineerka wareegyada saxda ah ee shabakadu barato

Muujinta sida qudhunka miisaanku u kaxeeyo beddelka xifdinta una guurto xog-ururin dhab ah

Wargelinta cilmi-baarista tarjumaadda iyadoo la siinayo dabeecado nadiif ah oo si buuxda loo fahmay si loo falanqeeyo

Ka digista takhaatiirta in saxanka hore ee ansaxinta aysan had iyo jeer macnaheedu ahayn in moodalku uu ku guuldareystay inuu barto

Khatarta & Dariiqyada Ilaalada

Kooxo kala duwan ayaa laga yaabaa inay isla erey u isticmaalaan si kala duwan, marka hore u qeex baaxadda.

Tilmaamaha ayaa u ekaan kara kuwo xooggan halka waxqabadka dhabta ah ee dunidu aanu sinnayn.

In la iska indho tiro tayada xogta iyo qorshayaasha qiimayntu waxay inta badan abuurtaa natiijooyin jilicsan.

Qorshe Hawleedka Dhaqangelinta

1

Ka bilow qeexidda luqadda cad ee natiijada aad u baahan tahay.

2

Dooro hal cabbir guusha iyo hal xaalad guuldarro ka hor tijaabada.

3

Ku orod duuliye yar oo wata xogta matale, ee ma aha bandhig muuqaal ah.

4

Dukumeenti halka Grokking iyo dib u dhigista Guud ay ka caawiso iyo meelaha hababka fudud ay ka fiican yihiin.

Sii wad Sahaminta

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Grokking and Delayed Generalization quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Bilow kedis

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Su'aalaha soo noqnoqda

What is Grokking and Delayed Generalization?

Grokking waa dhacdo la yaab leh halkaas oo shabakada neural ay marka hore xifdiso xogta tababarka, ku fadhido meel u dhow saxnaanta ansaxinta wakhti dheer, ka dibna si lama filaan ah u soo koobto muddo dheer ka dib saxnaanta tababarku 100%. Waxay meesha ka saaraysaa fikradda ah in wax-barashada iyo guud ahaan ay wada dhacaan.

Maxaa qeexaya grokking ee tababarka shabakada neerfaha?

Grokking waa boodada lama filaanka ah ee waxqabadka ansaxinta wanaagsan taas oo si fiican u dhacda ka dib markii saxnaanta tababarka ay tahay 100%.

Shaqooyin noocee ah ayaa markii ugu horreysay si cad loo arkay?

OpenAI Cilmi baadhayaashu waxay ka warbixiyeen xamaasad 2021 dhibaatooyinka algorithmism yar yar sida isku-darka modular.

Arrinkee ayaa inta badan lagu tiriyaa kaxaynta u gudubka guud ee grokking?

Burburka miisaanka ayaa si tartiib tartiib ah u riixaya shabakada si ay uga fogaato xallinta jeexan ee xifdiga ah oo ku wajahan wareeg isku dhafan, guud.

Markii cilmi-baarayaashu dib-u-habeyn ku sameeyeen shabakad grokked oo ku saabsan xisaabta modular, maxay heleen?

Fasiraadda makaanikada ayaa shaaca ka qaaday in shabakadu ay baratay trigonometric, matalaad wareeg ah si ay u xisaabiso xisaabta modular.

Waa maxay sababta grokking loogu tilmaamay tartan u dhexeeya laba xal?

Shabakadu waxay si dhakhso ah u helaan xal xifdisan laakiin, marka la joogteeyo, waxay aakhirka isugu yimaadaan wareeg guud oo fudud.