Ịchịkọta ọnụ na igbu oge
Grokking bụ ihe na-eju anya ebe netwọkụ akwara buru ụzọ buru data ọzụzụ ya n'isi, na-anọdụ ala na nkwado nkwado dị nso ruo ogologo oge, wee na-agbakọta na mberede ogologo oge mgbe izizi ọzụzụ ruru 100%.
Nchịkọta
It overturns the intuition that learning and generalization happen together.
Ime miri emi
Ndị nyocha OpenAI chọtara ya na 2021 na obere ọrụ algọridim dị ka mgbakọ na mwepụ modular, grokking na-egosi usoro ụzọ abụọ dị nkọ. Na mbido, ihe nlereanya ahụ dabara n'ọzụzụ a setịpụrụ nke ọma ebe arụmọrụ nkwado na-anọ na ohere, na-ele anya na-enweghị atụ. Mgbe ahụ, mgbe puku kwuru puku ma ọ bụ ọbụna ọtụtụ nde usoro agbakwunyere na-enweghị ọganihu pụtara ìhè, izi ezi na-amali na mberede na-aga nke ọma. Nkọwa na-eduga bụ na ire ere (nhazi) na-eji nwayọọ nwayọọ na-amanye netwọk ahụ ka ọ hapụ ngwọta echedoro n'isi wee chọpụta otu kọmpat, ahaziri nke na-ejide n'ezie iwu dị n'okpuru, dịka ọmụmaatụ na-anọchite anya mgbakwunye modular dị ka ntụgharị na gburugburu. A na-ahụkarị Grokking na obere dataset sịntetik, mana ịghọta ya na-eme ka a mata n'usoro dị omimi nke mgbe na ihe kpatara nchikota na-apụta.
Nghọta nka nka
Ọmụmụ ihe eji arụ ọrụ weghagharịa netwọkụ grokked wee chọpụta na ha na-emejuputa algọridim dị ọcha, dị ka iji mgbakwụnye okirikiri dị ka Fourier iji rụọ mgbakọ modular site na njirimara trigonometric. Mgbanwe a na-ejikọta na nha netwọkụ ahụ na-aghọ sparser na obere ụkpụrụ n'okpuru nhazi: n'isi chọrọ nnukwu ibu na-adịghị mgbe niile, ebe sekit izugbe dị mfe. Grokking si otú a na-egosi asọmpi n'etiti ngwa-ngwa ịchọta ngwọta n'isi na nke na-eji nwayọọ nwayọọ na-etolite, na-arụ ọrụ nke ọma karị.
Mmetụta atụmatụ
Mkpebi doro anya
Ọ na-enyere gị aka ikewapụta nkwupụta ọrụ aka doro anya na asụsụ ahịa.
Ọnụ ego na mmefu ego
Ị nwere ike ịjụ ajụjụ mmejuputa iwu ka mma tupu itinye ego ma ọ bụ oge.
Team na usoro ọrụ
Ndị otu nwere nghọta na-eme ka ngwaahịa, amụma na mkpebi mmụta ka mma.
Ọdịnihu nke Grokking na igbu oge n'ozuzu
Grokking bụ windo n'ime sayensị nke izugbe nke ndị nyocha na-atụ anya ịbawanye elu. Ajụjụ mepere emepe na-agụnye ma nchikota oge na-eme n'obere ọnụ n'ime nnukwu ụdị, otu esi achọpụta ma ọ bụ mee ka mgbanwe ahụ dịkwuo ngwa ngwa, yana ihe ọ pụtara maka ịmara mgbe ihe nlereanya amụtala echiche n'ezie na ihe atụ ndị eburu n'isi. Nghọta nwere ike ịgwa usoro nhazi oge ka mma, usoro ọzụzụ, na ngwaọrụ nkọwa, ma nwee ike inye aka ịkọ ike dị ngwa n'ụdị asụsụ buru ibu.
Mmejuputa n'ezie n'ụwa
Ịmụ ọrụ mgbakọ na mwepụ modular iji tụgharịa-injinetị kpọmkwem sekit otu netwọk na-amụta.
Na-egosipụta ka ire ere dị arọ si ebute mgbanwe site n'isi n'isi gaa n'ezi mkpokọta
Ịmepụta nchọpụta nkọwa site n'inye àgwà nlereanya dị ọcha, ghọtara nke ọma iji nyochaa
Ịdọ ndị na-ahụ maka ọrụ aka na ntị na ọkwa dị larịị n'oge anaghị apụta mgbe niile ka ihe atụ agaghị amụta
Ihe ize ndụ & okporo ụzọ nche
Otu dị iche iche nwere ike iji otu okwu ahụ mee ihe n'ụzọ dị iche, yabụ kọwapụta oge n'oge.
Ihe nrịbama nwere ike ịdị ike ebe arụmọrụ ụwa na-adaghị adaba.
Ileghara ogo data na atụmatụ nyocha anya na-emepụtakarị nsonaazụ na-adịghị mma.
Map mmejuputa
Malite na nkọwa asụsụ dị larịị nke nsonaazụ ịchọrọ.
Họrọ otu metrik ịga nke ọma na otu ọnọdụ ọdịda tupu nnwale.
Gbaa obere onye na-anya ụgbọ elu nwere data nnọchite anya, ọ bụghị ihe ngosi ngosi na-egbu maramara.
Detuo ebe Grokking na igbu oge na-enyere aka yana ebe ụzọ ndị dị mfe ka mma.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Grokking and Delayed Generalization quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nhazi
Ajụjụ a na-ajụkarị
What is Grokking and Delayed Generalization?
Grokking bụ ihe na-eju anya ebe netwọkụ akwara buru ụzọ buru data ọzụzụ ya n'isi, na-anọdụ ala na nkwado nkwado dị nso ruo ogologo oge, wee na-agbakọta na mberede ogologo oge mgbe izizi ọzụzụ ruru 100%. Ọ na-atụgharị uche na mmụta na mkpokọta na-emekọ ọnụ.
Kedu ihe na-akọwa grokking na ọzụzụ netwọkụ akwara ozi?
Grokking bụ ima elu na mberede na arụmọrụ nkwado dị mma nke na-eme nke ọma mgbe izizi ọzụzụ adịlarị na 100%.
Kedu ụdị ọrụ ndị a na-ahụ anya nke ọma na mbụ?
OpenAI Ndị nyocha kọrọ na 2021 na-akpa ọchị na obere nsogbu algọridim sịntetik dị ka mgbakwunye modular.
Kedu ihe a na-ekwukarị na ọ na-ebute mgbanwe gaa n'ozuzu oke n'ịgba aghara?
Ibu arọ na-eji nke nta nke nta na-akwapụ netwọk ahụ pụọ na ngwọta na-adịghị ahụkebe n'isi gaa na sekit kọmpat ma na-emekọ ihe ọnụ.
Mgbe ndị nchọpụta tụgharịrị netwọọdụ grokked na mgbakọ na mwepụ modular, gịnị ka ha chọtara?
Ntụwapụta n'ọrụ gosipụtara netwọk ahụ mụtara trigonometric, okirikiri okirikiri iji gbakọọ mgbakọ na mwepụ modul.
Kedu ihe kpatara eji kọwaa grokking dị ka asọmpi n'etiti ngwọta abụọ?
Netwọk na-achọta ngwa ngwa ngwọta na-ebu n'isi mana, n'okpuru nhazi oge, na-emecha na-ejikọta na sekit n'ozuzu ya dị mfe.