Dzokera kuNhau
InnovationAI Understanding muchidimbu

Kudzoreredza ndangariro kunodzikisa gaka remamodheru emutauro pane isingawanzo kugadzirwa maitiro

Chidzidzo chitsva chearXiv chinoshuma kuti kupa mamodheru emitauro kuwana mienzaniso yakachengetwa kunonatsiridza kunzwisiswa kwavo kune misiyano yesyntactic inosanganisira mazwi asingawanzo, kunyange gaka risina kubviswa.

7 min readRead the primary source
Source-page capture accompanying Retrieval memory narrows language models’ gap on rare syntactic patterns
Primary-source documentKwakanyorwa
Muparidzi
arxiv.org
Source link
arxiv.orghttps://arxiv.org/abs/2608.23851
Source type
Gwaro rekutanga - chiziviso chepamutemo, bepa, faira, kana peji rebato rekutanga ratinoverenga zvakananga.
ContextNzwisisa izvi mumasekonzi makumi matanhatu

Tanga pano

Matemu akakosha

Memory (Agent Memory)
Yakachengetwa mamiriro mumiriri weAI anoshandisa pamatanho kana masesheni kuvandudza kuenderera.
Kudzoreredza
Kutsvaga magwaro akakodzera kana marekodhi kubva kune ruzivo ruzivo rwemubvunzo.
Kusimba
Kugona kwe modhi kuchengetedza kuita pasi peruzha, mashifiti, kana mapindiro eanopikisa.
Zviedze iwe pachakoAI Models Inotsanangurwa Mibvunzo

Chii chaitika

Vatsvagiri Jing Liu naNajoung Kim vakaedza kana episodic-memory memory inogona kuderedza manzwiro emhando dzemitauro kune kuwanda kwemazwi ega pakutonga misiyano. Vakashandisa mhando dzemitauro yekudzorera-yakawedzerwa, kunyanya k-yepedyo-yavakidzani mamodheru ayo anowedzera parametric modhi nemienzaniso yakachengetwa. Bepa rinoshuma kuti kudzoreredza kwekuwedzera kwakadzikisa gaka rekuita pakati pepamusoro-uye yakaderera-frequency bvunzo zvinhu pane akawanda masyntactic phenomena uye mumamodheru akadzidziswa pane ese ari maviri-echokwadi uye makuru-data data.

Iro bepa rinogadzirisa hutera hwakati mumamodhimu emutauro weNeural: kutongwa kwavo kwegiramamatiki kunogona kuchinja zvichienderana nekuti kazhinji mazwi ekutaura akabuda sei panguva yekudzidziswa. Vanyori vanoisa izvi senge lexical-frequency gap. Mubvunzo wavo ndewekuti imwe nzira yekuwedzera yakaita se episodic memory - kukurumidza kuchengetedza uye kudzoreredza kwezvimwe zviitiko - inogona kuita kuti maitiro emuenzaniso awedzere kusimba kana chimiro chegirama chine zvinhu zvisingawanzo zvirevo. Kwairi kunopa izvi seyedzo yefungidziro yakatorwa kubva kuComplementary Learning Systems theory, kwete sehumbowo hwekuti mamodheru ane ndangariro dzakafanana nemunhu.

Kuti vaedze pfungwa, vatsvakurudzi vanoshandisa kudzoreredza-yakawedzerwa mhando dzemitauro. Mukuita kwakataurwa kwebepa, k-yepedyo-yemuvakidzani mamodheru anosanganisa parametric mutauro modhi neyakajeka yekuchengetedza muenzaniso. Panguva yekugadzirisa, iyo sisitimu inogona kudzoreredza mienzaniso yakachengetwa pane kungovimba neruzivo rwakavharirwa mumaparamita ayo. Kwabva mumiriri haatsanangure zviri mukati kana saizi yemuunganidzwa wakachengetwa, chinhambwe chekutora, kana mazita emhando yega yega, saka iwo madeti haagone kuongororwa kubva kwakapihwa.

Vanyori vanoshuma kuti kudzoreredza kuwedzera kwakapfupisa mutsauko wekuita pakati pepamusoro-frequency uye yakaderera-frequency zvinhu mune syntactic-kusiyanisa bvunzo. Vanoti mhedzisiro yacho yaienderana muzviitiko zvakasiyana-siyana uye nemhando dzakafanodzidziswa padata rechokwadi remwana uye nedata hombe. Kwakabva hakupi zvibodzwa zvenhamba, nguva dzekusatendeseka, kukosha kwekutanga, kana nhamba yezvinhu zvekuyedzwa. Nekuda kweizvozvo, gwara rekutsvagirwa kwakashumwa rakajeka kubva kune abstract, asi ukuru uye simba rehuwandu hazvizivikanwe pano. Mhedzisiro yechipiri ine chekuita nezvinoita kuti kudzoreredza kubatsire. Bepa rinoshuma kuti ruzivo rwezvimiro rwaive rwakakosha pakudzoreredza kunobudirira, nepo kufanana kwesemantic chete kwaibatsira kushoma. Mukutaura kwekushandisa, izvi zvinosiyanisa kudzoreredza mienzaniso nekuti inogovana gadziriro yegirama kubva pakudzoreredza mienzaniso nekuda kwekuti inokurukura nyaya dzakafanana. Kwakabva hakutsanangure kuti ruzivo rwezvimiro rwakamiririrwa kana kuyerwa sei, saka mhedzisiro haigone kuturikirwa mune chaiyo yekumisikidza resipi kubva kune iripo.

Pepa rinotsanangura zvakawanikwa sehumbowo hunovimbisa-hwe-pfungwa uye inotaura zvakajeka kuti kudzoreredza kwakatetepa, pane kuvharwa zvizere, iyo frequency gap. Inopa nzira dzinoverengeka dzeramangwana: zvakasarudzika kudzoreredza zviitiko zvakadzoserwa, kuvandudza zvinomiririra uye nzira dzekutora dzeruzivo rwezvimiro, uye kubvumira kuchengetedza uye kudzoreredza masisitimu kuti asiyane nebasa. Nekuti sosi irekodhi rearXiv rakaunzwa muna Nyamavhuvhu 24, 2026, rinofanirwa kubatwa sechipo chekutsvagisa chine nguva icho chakazvimirira chekudzokorora uye chimiro chekuongorora-vezera chisina kusimbiswa nemavara akapihwa.

Kwakabva mashoko: arxiv.org ↗

Nei zvichikosha

Mhedzisiro yacho inoratidza kuti kuchengeta uye kudzoreredza mimwe mienzaniso yakapfuura kunogona kubhadhara kusasimba mumuenzaniso wakadzidzwa nhamba inomiririra. Inoratidzawo kuti kudzoreredza nyaya dzemhando yepamusoro: vanyori vanoshuma kuti ruzivo rwezvimiro rwakakosha pakudzoreredza kunobatsira, nepo semantic kufanana chete kwaibatsira kushoma. Izvi zvinogona kuzivisa magadzirirwo emitauro iyo inofanirwa kubata zvivakamutauro zvisingawanzoitiki, kunyange zvazvo kwakabva kwacho kusingapi huwandu hwenhamba yekuvandudza kana kumisa kushanda mumashandisirwo akaitwa.

Chidzidzo ichi chakakosha nekuti chinosiyanisa dhizaini yedhizaini inokanganisa magadzirirwo emhando dzemitauro. Iyo modhi inotsamira zvakanyanya pane parametric inomiririra inogona kukodha yakajairika mapatani zvakanyanya kupfuura zvisingawanzo. Kana mienzaniso yakachengetwa ichikwanisa kudzikamisa kusaenzana ikoko, kudzoreredza kunove kunopfuura nzira yekupa mamiriro echokwadi: zvinogona zvakare kubatsira mafomu emuenzaniso maitiro asina kumiririrwa mune ayo akadzidza paramita. Chirevo chebepa chinogumira kune yakaedzwa syntactic-contrast setting, asi iri pasi peinjiniya mubvunzo wakakodzera kune masisitimu anoda mitauro inowirirana mumipumo isina kumiririrwa.

Kukosha kwakashumwa kwekudzoreredza kwemaitiro kunonyanya kucherechedzwa. Mazhinji masisitimu ekudzoreredza akarongwa maererano nemusoro kana semantic kufanana, asi ongororo ye syntactic inowanzoenderana nehukama pakati pemashoko kwete panyaya yenyaya. Sekureva kwevanyori, kufanana kwesemantic pachayo kwakapa bhenefiti shoma mukuedza kwavo, nepo ruzivo rwechimiro rwaikosha. Kana izvo zvakawanikwa zvikaramba zviripo, vagadziri vangangoda nzira dzekudzoreredza dzinomiririra chimiro chegirama zvakajeka pane kufungidzira kuti muenzaniso wakafanana semantic zvakare inobatsira girama analogue.

Mhedzisiro yacho inogona zvakare kuve yakakosha kune mamodheru akadzidziswa pasi peakasiyana data data. Vanyori vanoti bhenefiti yakaonekwa mumamodeli akadzidziswa pane data-chaiyo yemwana pamwe nemhando dzakadzidziswa pane yakakura-data data. Izvi zvinoratidza kuti mhedzisiro yakashumwa haina kuganhurirwa kune imwe chiyero chekudzidzisa kana fungidziro imwechete yekutaura mutauro. Hazviratidzi kuti kutorazve kunogadzirisa matambudziko makuru ekudzidza mutauro, uye hakuratidzi kuvandudzwa kwemaitiro ekutaura, kushandura, dzidzo, kana zvimwe zvikumbiro zvisipo kubva kwaunobva. Kukosha kunoshanda kunoramba kwakasungwa neuchapupu husipo. Chidimbu hachitauri kuti kurongeka kwakagadziridzwa kwakadii, kudiwa kwakawanda kwakadii kwekuchengetera kana kutorazve, kana kuti kubatsirwa kwakaramba kuchiitika pakachinja mienzaniso yakachengetwa.

Izvo zvakare haitauri kuenzanisa nedzimwe nzira dzekurangarira, mitauro mikuru yezvinyorwa, mitauro inopfuura iyo inomiririrwa muzviedzo, kana chaiyo-yepasirese mamiriro ekutumira. Izvo zvisingazivikanwe zvinoita kuti zvive nguva isati yakwana kubata zvakawanikwa seyakagadziriswa chigadzirwa tekinoroji. Iro bepa rekukodzera rakakosha kune vaverengi nevagadziri: gaka rakaderedzwa asi harina kubviswa. Izvi zvinoreva kuti kudzoreredza kunogona kunge kuri nzira yekuripa kwete mushonga wakakwana weutera humiriri hwemukati. Mhedzisiro yacho inotsigira kumwe kuferefeta kuti ruzivo rweparametric uye mienzaniso yakajeka inopindirana sei, ichisiya yakavhurika kana iyo yakawedzera kuomarara ichiburitsa bhenefiti yakakwana yekururamisa kushandiswa mune imwe system. Sosi inogadza gwara rekutsvagisa uye mhedzisiro yekuyedza, kwete vimbiso yebasa rose.

Interactive Mechanism

Interactive Mechanism: Iyo Inonyatsoshanda

Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.

Document Size:128K tokens
Needle Placement Depth (Location in document):50% into text
Attention Context Buffer Map:
Target Fact (50%)
Equivalent Pages~320Standard book pages
Retrieval Accuracy99.9%Needle recall score
RAM / KV Cache5.1 GBMemory overhead
Prompt CachingActive~80% discount on reuse
Core takeaway: Million-token context windows allow querying whole codebases or legal archives in one prompt. However, KV cache memory scales with context length, making prompt caching crucial for real-time production.
Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Zvekutarisa zvinotevera

Mibvunzo mikuru ndeyekuti zvakakura uye zvinogara zvakadii izvo zvakashumwa zvakawanikwa, zvingave zvine mitauro yakawanda uye mabasa emitauro, uye kuti kudzosa kunokanganisa sei mutengo wekombuta uye ndangariro zvinodiwa. Vanyori vanoti iyo frequency gap yakadzikiswa kwete kuvharwa zvizere uye vakurudzira kuyera kwakasarudzika kwemienzaniso yakadzoserwa, zvirinani zvimiro zvinomiririra uye nzira dzekutora, uye inochinjika kuchengetedza uye kudzoreredza zvigadziriso. Kwazvabva hakuzivise saizi-yakasetwa, mhando chaidzo, huwandu hwe data rakachengetwa, kana kuti zviedzo zvakaongororwa nevezera rako.

Rimwe basa rinofanirwa kushuma saizi yenhamba yeyakanyanya-frequency maringe nepasi-frequency gap isati yatorwa uye mushure mekudzoserwa, pamwe chete netest-set kuumbwa uye kusava nechokwadi kwenhamba. Izvo zviyero zvakakosha kuti uone kana iyo yakataurwa kutetepa idiki uye yakasarudzika kana yakakura zvakakwana kukanganisa kusarudzwa kwemuenzaniso uye dhizaini yehurongwa. Iyo yakapihwa tsime haavapi, saka ivo ndihwo humbowo huripo husipo.

Vatsvakurudzi vanokurudzirawo kudiwa kudzokororwa kwezviitiko zvakadzorerwa. Kuona maitirwo anoitwa shanduko iyi kuchabatsira kujekesa kana bhenefiti yacho ichiuya zvakanyanya kubva pakuva nemienzaniso yakakodzera iripo kana kubva pakupa mienzaniso yakadzoserwa yakawedzera simba panguva yekufungidzira. Ongororo inobatsira ingada kupatsanura zvakawanikwa kubva kumhando yekudzosa, huremu nzira, uye yepasi modhi yemutauro, asi kwainoburitsa hakurevi mibairo yekutevera yakadaro. Kudzosa kwemaitiro ndeimwe nzvimbo yakakosha yekutarisisa. Bepa rinoti ruzivo rwezvimiro rwaive rwakakosha uye kufanana semantic chete kwaibatsira kushoma, asi haritsanangure zvinomiririra kana nzira dzekudzosa dzakashandiswa. Zvidzidzo zvenguva yemberi zvinofanirwa kuyedza kana kuwanikwa kuchipona munzira dzakasiyana dze encoding syntax uye nepakati pe syntactic phenomena isingabatanidzwe muzviedzo zvazvino. Kudzokorodza kwaizoratidza kana mhedzisiro yacho iri midziyo yakajairika yekudzoreredza-yakawedzerwa mamodheru emitauro kana mhedzisiro yeiyi setup.

Vanyori vanodaidzawo zvigadziriso zvinochinjika zvekuchengetedza uye kudzoreredza. Izvi zvinomutsa mibvunzo inoshanda pamusoro pemienzaniso ipi inofanira kuchengetwa, kuti inofanira kuramba iripo kwenguva yakareba sei, uye kuti mari yekutora inokura sei sezvo muunganidzwa unokura. Iyo sosi inopa hapana latency, ndangariro, kana compute kuyerwa. Izvo zvisingazivikanwe ndezvenyama nekuti nzira inonatsiridza bhenji asi inoda zvakanyanya hupfumi inogona kunge iine hushoma kukosha mumasisitimu akaiswa.

Pakupedzisira, vaverengi vanofanira kutarisa kuongororwa kwakazvimirira. Iyi ndiyo arXiv preprint yakatumirwa Nyamavhuvhu 24, 2026, uye rekodhi rakapihwa hariratidze ongororo yevezera. Kudzokorora mumamodheru, maseti, mitauro, uye nzira dzekuongorora zvingadiwa tisati tapedzisa kuti kudzoreredza kwemaitiro episodic kunonatsiridza kusimba kwechigadzirwa. Kusvika panguva iyoyo, mhedziso yakasimba yakatsigirwa idiki: mune yakashumwa yehumbowo-ye-pfungwa yekuedza, yakajeka kudzoreredza yakaderedzwa-asi haina kubvisa-mhedzisiro yelexical frequency pakunzwa kune syntactic misiyano.

Related guides & Quizzes

AI Models InotsanangurwaTransformersKudzidziswa kweAIPrompt EngineeringEdza zvaunoziva - edza yemahara AI quizTarisa kumusoro izwi reAI mune yedu glossaryTevedza iyo AI modhi yekuburitsa tracker
Wakawana izvi zvinobatsira?