Subira ku makuru
UmutekanoAI Understanding ibisobanuro

Cryptonomist ivuga igihombo gikabije kiva muburozi bwa AI-agent

Cryptonomist ivuga ko uburozi 1,2% bwa AI-memoire ya corpus bwagabanije kumenya neza kuva kuri 0.850 bugera kuri 0.300, mugihe ibizamini byapimwe hamwe nubwirinzi bwananiwe gukemura ikibazo.

5 min readRead the linked source
Primary-source image accompanying Cryptonomist reports sharp accuracy losses from AI-agent memory poisoning
InkomokoInkomoko yanditse
Umwanditsi
en.cryptonomist.ch
Ihuza ry'inkomoko
en.cryptonomist.chhttps://en.cryptonomist.ch/2026/08/24/agent-memory-poisoning-defenses/
Ubwoko bw'inkomoko
Inkomoko ihujwe - ibanze-isoko yimiterere ntabwo yashizweho.
ImirongoSobanukirwa ibi mumasegonda 60

Tangira hano

Amagambo y'ingenzi

Kwibuka (Memory Memory)
Imiterere yabitswe umukozi wa AI akoresha intambwe cyangwa amasomo kugirango atezimbere.
Hallucination
Iyo icyitegererezo gitanga amakuru meza ariko yibinyoma cyangwa adashyigikiwe.
Kubona
Gushakisha inyandiko cyangwa inyandiko zijyanye nubumenyi bwikibazo.
IsuzumeIkibazo cya AI

Byagenze bite

Ikinyamakuru Cryptonomist kivuga ko urupapuro rw’ubushakashatsi rwakozwe na Arulnidhi Karunanidhi rwasuzumye uburyo amakuru y'ibinyoma yinjijwe mu bwenge budasubirwaho ashobora kugira ingaruka ku bakozi ba AI mu masomo akurikira. Ibizamini byatangajwe byagaragaye ko hari igihombo kinini cyaturutse ku mubare muto w’amakuru y’uburozi n’intege nke haba mu gusuzuma ibirimo ndetse no kwirwanaho bishingiye ku gushakisha. Urupapuro rusaba imbogamizi zo guturamo nkuburyo bwo kugarura igihe. Ibyagaragaye ntabwo byemejwe byigenga bivuye mu nkomoko yatanzwe.

Cryptonomist ivuga ko impapuro zize kwibuka bidasubirwaho mubakozi ba AI: amakuru avuye mumikoranire yabanje kubikwa hanyuma akagaruka mugihe ikibazo gishya kigaragara nkicyingenzi. Impungenge z'umutekano ni uko amagambo y'ibinyoma yashyizwe muri iryo duka ashobora gukomeza kuboneka mu gihe kizaza. Nk’uko raporo ibigaragaza, ikibazo nticyagarukiye gusa ku gihe kimwe kigaragara. Ububiko bwuburozi bushobora gutangwa nyuma nkibisobanuro bifatika, birashoboka kuyobora umukozi kugisubizo kitari cyo nubwo mugihe umwimerere wambere utakigaragara kubakoresha.

Raporo ivuga ko abashakashatsi bafite uburozi 1,2% bya corpus ya LongMemEval hamwe n'amagambo y'ibinyoma. Cryptonomist asobanura ibivugwa ko byatanzwe muri pass imwe, nta mbarutso zidasanzwe, amabwiriza yakozwe, cyangwa kugarura ibintu bigamije koroshya igitero. Mu kizamini cyatangajwe, kugarura ukuri byagabanutse kuva 0.850 bigera kuri 0.300. Iyi mibare ni ibikoresho kuko isobanura impinduka nini ziva mubice bito byuburozi bwa corpus, nubwo isoko idatanga ibisobanuro bihagije byuburyo bwo kumenya uburyo ikizamini gihagarariye sisitemu zoherejwe.

Cryptonomist avuga kandi ko ibyiciro bine byandika-byerekana igihe cyo gusuzuma byagaragaye 0.832 byo kugerageza gutera inshinge mu buryo butaziguye kandi byerekanaga 1.5% by'inyandiko-mvugo-iremereye inyandiko nziza. Iyo mikorere ntabwo yimukiye kubibeshya: umuyoboro wanze zeru yibuka uburozi 360 mubizamini byatangajwe. Iyi ngingo ivuga ko ibi bigaragaza imbogamizi yo kugenzura gusa ibirimo, bishobora kumenya amabwiriza ateye amakenga byoroshye kuruta kumenya niba amagambo atuje, yemewe ari ukuri. Inkomoko ntabwo yigenga yerekana kode yimpapuro, kubaka dataset, cyangwa protocole yo gusuzuma birenze kuvuga ko ibikoresho byo gupima, corpora, hamwe na raporo yimikorere yasohotse.

Ibisobanuro birambuye: en.cryptonomist.ch ↗

Impamvu ari ngombwa

Kwibuka guhoraho gukoreshwa cyane kugirango ureke abakozi ba AI batwara amakuru mumasomo. Niba ibinyoma byemewe bishobora kurokoka ibisanzwe kandi bikagira ingaruka nyuma yo kugarura, kwibuka bihinduka imipaka yumutekano aho kuba ibintu byoroshye gusa. Ibisubizo byatangajwe byerekana ko sisitemu zishobora gukenera ingamba zigabanya ingaruka z’isoko iyo ari yo yose, hamwe no kugenzura bifatika, gukurikirana ibimenyetso, no gusuzuma abantu.

Ikibazo cyatangajwe gifite akamaro kuko kwibuka bidasubirwaho birashobora guhindura icyitegererezo cyizere kubakozi ba AI. Ikiganiro gisanzwe gishobora gutanga igisubizo kitari cyo muburyo bumwe; umukozi ufite ububiko burambye arashobora gutwara ibintu bitari byiza mumirimo nyuma. Niba iyo ngingo yagaruwe nkimiterere, irashobora guhindura igenamigambi, incamake, ibyifuzo, cyangwa gukoresha ibikoresho. Inkomoko ntagaragaza nimwe murizo ngaruka zifatika zibaho, ariko irerekana uburyo bwakoreshwa muburyo buto bwo kubika amakuru atari yo ashobora kuba maremare kandi afite akamaro kenshi.

Konti yinkomoko nayo irwanya kwishingikiriza byoroshye kubirango byerekana. Cryptonomist ivuga ko kugarura ibintu bitaremereye bifite ishingiro bitandukanijwe no kutagira kwirwanaho, hamwe na p-agaciro ka 0.80. Uburemere bukomeye butezimbere akamaro gusa ukuyemo ibintu bitizewe rwose. Mu kizamini kimwe kivanze-gihamye, usibye ibintu bitizewe byazamuye ukuri kuva 0.3167 bigera kuri 0.7000 mugihe ibyo bikoresho byari byiza cyane. Iyo ibimenyetso bikenewe byanditseho ko bitizewe, ariko, raporo ivuga ko kwibutsa ibimenyetso byagabanutse kuri zeru naho ukuri kugabanuka kugera kuri 0.0417.

Ibyo gucuruza bifite ingaruka zifatika kubateza imbere nimiryango ukoresheje ibikoresho bifasha kwibuka. Inkomoko yinkomoko irashobora kuba ingirakamaro, ariko ntabwo ari kimwe nibimenyetso byerekana ko ikirego ari ukuri. Kurenza urugero kuri labels birashobora kwemerera amakuru yuburozi kuva mubyiciro byizewe kunyuramo, mugihe kuyungurura bikabije bishobora gukuraho amakuru yukuri kumasoko yashyizwe mubikorwa nkutizera. Icyifuzo cyatanzwe, imbogamizi zabatuyemo, gihindura intego yo kumenya ibinyoma byose bikagabanya umubare wibimenyetso byakuweho isoko imwe cyangwa icyiciro kimwe gishobora gutanga. Inkomoko ntisobanura ko ubu buryo busumba ibikorwa bikora.

Interactive Mechanism

Uburyo bukoreshwa: Uburyo bukora

Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Kugenzura Ibitekerezo Byagenzuwe+10 Points
AI Agents Quiz

An agent must create a draft calendar event for Tuesday at 2 p.m. Which evidence would establish the requested result?

Ibyo kureba

Ibibazo nyamukuru ni ukumenya niba ingaruka zavuzwe zororoka hanze ya LongMemEval, uburyo imbogamizi zabatuye zikora zirwanya ibitero bikomeye cyangwa bihuza n'imihindagurikire y'ikirere, hamwe nigiciro nyacyo batanga. Inkomoko ntisobanura ko umukozi w’ubucuruzi woherejwe yahungabanijwe, akamenya uwahohotewe ku isi, cyangwa ngo yerekane ko ubwunganizi bwateganijwe bukora mu musaruro. Cryptonomist avuga kandi ko ingingo yayo yakozwe hifashishijwe ubuhanga-bwenge kandi igasuzumwa nitsinda ryayo.

Icyambere cyambere ni kwigana byigenga. Cryptonomist avuga ko ibyavuye mu mpapuro zanditswe na Arulnidhi Karunanidhi akavuga ko gushyigikira ibikoresho, corpora, hamwe na raporo rusange byashyizwe ahagaragara, ariko ingingo yatanzwe ntabwo igaragaza inyandiko arXiv yanditse cyangwa ngo itange isubiramo mu buryo bwa tekiniki. Abashakashatsi bagomba gusuzuma niba igipimo cy’uburozi cya 1,2% hamwe n’impinduka zavuzwe neza zigumaho mu buryo butandukanye bwo kwibuka, uburyo bwo kugarura ibintu, ingano ya corpus, n'imirimo ya agent. Ibisubizo biva muri LongMemEval byonyine ntibigomba gufatwa nkigipimo cya buri mukozi woherejwe.

Icyifuzo cyo kwirwanaho kigarukira kandi gikeneye kwipimisha kurwanya imyitwarire ifatika. Kugabanya gusaranganya ibimenyetso biva mu isoko cyangwa icyiciro kimwe bishobora kugabanya ibyangijwe n’ubukangurambaga bw’uburozi bwibanze, ariko birashobora kandi gutuma umukozi abura igisubizo mugihe ibimenyetso bifatika bituruka ahantu hamwe. Isuzuma ryingirakamaro rero ryapima ibitero byibasiwe nigikorwa gisanzwe, harimo nigihe ibimenyetso byizewe kandi bitizewe bivanze cyangwa ibirango bitari byo. Inkomoko itanga icyifuzo ariko ntagisubizo cyibisubizo, ibisobanuro birambuye, cyangwa kugereranya na sisitemu yo hanze.

Hanyuma, amashyirahamwe agomba kureba ibimenyetso byerekana ko sisitemu yo kwibuka yandika aho ikirego cyaturutse, kwemerera abakoresha kugenzura cyangwa gukosora ibyo bibitse, no gutandukanya ibyemejwe bidafite ishingiro kubintu bifatika. Izi nizo ngamba zifatika zo gukora iperereza, ntabwo ibisubizo byagaragajwe niyi ngingo. Raporo ntisobanura kutubahiriza, ibicuruzwa byangiritse, koherezwa mu bucuruzi, cyangwa igitero cyemejwe. Ntabwo kandi yerekana niba kwibuka uburozi bishobora kwinjizwa muri sisitemu nzima nta burenganzira. Kubera ko ingingo ivuga ko yakozwe hifashishijwe ubufasha bwa AI kandi igasuzumwa mu buryo bwanditse, impapuro ziri munsi n’ibicuruzwa byasohotse bisaba ko hasuzumwa mu buryo butaziguye mbere y’uko imibare ikoreshwa mu gushyiraho politiki y’umutekano.

Ibijyanye nuyobora & ibibazo

Abakozi ba AIImyitwarire ya AIModeri ya AI YasobanuweAmahugurwa ya AIGerageza ibyo uzi - gerageza ikibazo cya AI kubuntuReba ijambo AI mumagambo yacuKurikiza inzira ya AI ikurikirana
Basanze ari ingirakamaro?