Subira ku makuru
Guhanga udushyaAI Understanding ibisobanuro

Abashakashatsi berekeza imitwe yibitekerezo bifitanye isano na salusiyo muri LLaVA

Icapiro rivuga ko kwibasira imitwe 32 yitabwaho muri LLaVA-1.5-7B byagabanije ibintu bya salusine byanditseho amashusho 400 yafashwe na COCO.

5 min readRead the primary source
Primary-source image accompanying Researchers target attention heads linked to object hallucinations in LLaVA
Inyandiko y'ibanzeInkomoko yanditse
Umwanditsi
arxiv.org
Ihuza ry'inkomoko
arxiv.orghttps://arxiv.org/abs/2608.24966
Ubwoko bw'inkomoko
Inyandiko y'ibanze - itangazo ryemewe, impapuro, dosiye, cyangwa urupapuro rwambere-dusoma mu buryo butaziguye.
ImirongoSobanukirwa ibi mumasegonda 60

Tangira hano

Amagambo y'ingenzi

Icyerekezo-Ururimi Icyitegererezo (VLM)
Moderi ya modimodal itunganya hamwe amakuru yamakuru kandi yanditse.
LoRA (Kurwanya Urwego Ruto)
Ikintu gikora neza-kuringaniza uburyo bwongerera urwego rwo hasi adapter matrices.
Kwibuka (Memory Memory)
Imiterere yabitswe umukozi wa AI akoresha intambwe cyangwa amasomo kugirango atezimbere.
IsuzumeModeri ya AI Yasobanuwe Ikibazo

Byagenze bite

Abashakashatsi batanga uburyo bushingiye ku gusobanura uburyo bwo kugabanya ibintu bya salusiyo mu cyerekezo-cy'ururimi LLaVA-1.5-7B. Bagaragaje imitwe yitabwaho ibitekerezo byabo byagabanutse kumagambo yibintu, bagerageza abakandida binyuze mu gukuraho, kandi bagashyira mubikorwa bibiri bigamije. Uburyo bukomatanyije bwagabanije ibipimo bya salusiyo byerekanwe kumashusho 400 ya COCO.

Inkomoko ni inyandiko ya arXiv yatanzwe ku ya 25 Kanama 2026, ikavuga ko impapuro zemerewe mu mahugurwa ya Actionable Interpretability Workshop yabereye muri COLM 2026.Isomo ryayo ni kunanirwa mu buryo bw'ururimi rwerekanwe: kubyara ibisobanuro byerekana ibintu bidahari ku ishusho yinjira. Ubushakashatsi bwibanze kuri LLaVA-1.5-7B kandi ibaza niba isuzuma risobanurwa rishobora kuyobora igisubizo gikwiye. Uru rupapuro rusaba rero rwerekeye ibisubizo byubushakashatsi bwakozwe, ntabwo bisohora ibicuruzwa cyangwa impinduka kuri LLaVA kuboneka kumugaragaro. Urwo rwego ni ingenzi mu gusobanura ibisubizo: umusanzu wasobanuwe nuburyo bwo gukora iperereza no guhindura imyitwarire runaka muburyo bwiswe icyitegererezo munsi yubushakashatsi bwavuzwe. Igice nticyerekana nkigisobanuro cyagutse kijyanye na sisitemu zose zerekana ururimi.

Abashakashatsi babanza gutondekanya imitwe bakurikije uburyo ibitekerezo byabo kumashusho bigabanuka kumagambo yita ibintu bya salusine. Baca berekana urutonde mugukuraho imitwe yabakandida no gupima uburyo intervention ihindura log amahirwe yo kuba ibimenyetso bya salusiyo. Iyi nzira itanga imitwe 32. Inzira igabanya interineti kugirango igaragaze ibice byerekana icyitegererezo, nubwo igice kitavuga niba imitwe imwe ihora ihitamo mumashusho atandukanye, ibisobanuro cyangwa kugenzura icyitegererezo. Urukurikirane kandi rutandukanya kwisuzumisha no gutabara: uburyo bwo kwitondera butanga ibimenyetso byerekana urutonde, gukuraho bitanga umukandida ecran, hamwe nubuhanga bubiri bwatoranijwe butanga ikosora. Inyandiko yatanzwe ntabwo itanga ubushakashatsi bwagutse bwo kongera imyitozo.

Urupapuro rushyira mubikorwa bibiri gusa kuri iyo mitwe: adaptate ya LoRA ikata umutwe hamwe nigihe cyo kugenzura igihe. Ku mashusho 400 yafashwe na COCO, uburyo bwahujwe buravugwa ko bugabanura INTEBE, bisobanurwa mu nkomoko nk'igice cy'inyandiko hamwe n'ikintu cya salusiyo, kuva 0.370 kugeza 0.230. Iragabanya kandi CHAIRi, igice cyibintu bya salusine bivugwa, kuva 0.156 kugeza 0.096. Ibitekerezo byatanzwe birangira ako kanya nyuma ya “(p”, bityo p-agaciro bifitanye isano hamwe nubushobozi bukurikira bwibarurishamibare ntibishoboka hano. Izi ndangagaciro zitangazwa ko ari ibisubizo byatanzwe kugirango isuzumabumenyi ryakozwe, kandi bigomba gusomwa hamwe n’ibisobanuro bituzuye by’ibarurishamibare.

Ibisobanuro birambuye: arxiv.org ↗

Impamvu ari ngombwa

Akazi gahuza isuzuma ryimyitwarire yicyitegererezo no gukosorwa kugamije aho gufata salusiyo nko gutsindwa kudatandukanye. Niba byigana, uburyo bushobora gufasha abashakashatsi gukemura sisitemu yururimi-mugihe bahinduye bike mubyitegererezo. Ibimenyetso bigarukira gusa ku cyitegererezo cyatanzwe, umurimo no gusuzuma.

Ibintu bya salusiyo nikibazo nyamukuru gikemurwa nubu bushakashatsi: sisitemu irashobora gutanga ibisobanuro byanditse byerekana neza ibintu bitagaragara mubishusho. Ibisubizo byatangajwe bifite akamaro kuko bigerageza guhuza kunanirwa nuburyo bwimbere bwimbere hanyuma ugakoresha iryo suzuma kugirango uyobore ikosora. Nicyo cyerekezo cyihariye cyubushakashatsi kuruta gupima gusa niba ibisobanuro byikitegererezo birimo amakosa, kuko bitanga konti yerekana aho imyitwarire ishobora guturuka. Kwibanda ku buryo bwaho kandi butanga akazi gakurikira ikintu gifatika cyo gusesengura mugihe ugereranije imyitwarire yicyitegererezo mbere na nyuma yo gutabarwa.

Impinduka zavuzwe ni nyinshi mu isuzuma ryakozwe n’ubushakashatsi: INTEBE zigabanuka 0.140, naho CHAIRi igabanuka 0.060. Iyi mibare yerekana ibisobanuro bike byibuze byibuze ikintu kimwe cyerekanwe hamwe nibintu bike bya salusine byavuzwe muri rusange mugihe cyageragejwe. Inkomoko ntisobanura ko uburyo butezimbere imyumvire rusange, ibisobanuro byingirakamaro cyangwa ukuri mubindi bikorwa. Itanga raporo yo kugabanya ingamba zatoranijwe za salusiyo, ntabwo ari igisubizo cyuzuye cyo kureba-ururimi rwizewe. Kubwibyo, ubusobanuro bwibisubizo biterwa nuburyo izo mpinduka zipimishije zihuye nimyitwarire yingirakamaro murwego rwagutse rwanditse.

Intego igamije irashobora kuba ingirakamaro mugihe ishobora kugabanya kunanirwa gusobanuwe bidasabye guhindura moderi yagutse. Urupapuro, ntirutanga amakuru ahagije mumasoko yatanzwe kugirango hamenyekane niba izo nyungu zibaho mubikorwa. Nta makuru yatanzwe yo guhugura, gufata umwanzuro hejuru, gupima ubukererwe, ibisabwa byo kwibuka, inzira yoherejwe cyangwa kugereranya nubundi buryo bworoshye. Agaciro rusange k'imirimo muri iki gihe kari mu buryo n'ibimenyetso byacyo, mu gihe inyungu zikorwa zikomeje kutagenzurwa. Itandukaniro riri hagati yubushakashatsi bushimishije hamwe nubuhanga bwiteguye bwo gukora rero buracyari ingenzi mugihe cyo gusuzuma akazi.

Interactive Mechanism

Uburyo bukoreshwa: Uburyo bukora

Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Kugenzura Ibitekerezo Byagenzuwe+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Ibyo kureba

Ibisubizo byuzuye byibarurishamibare, ibisobanuro-byujuje ubuziranenge no gukora ku zindi moderi na datasets ntibishoboka mu gice cyatanzwe. Irindi suzuma rigomba kumenya niba imitwe yatoranijwe ihagaze neza, niba uburyo butera ibintu bitagabanijwe, hamwe naya mahugurwa, igihe-cyo kugereranya nigihe cyo kubara ibikorwa bitangiza.

Icyambere cyibanze ni inyandiko yuzuye y'ibarurishamibare hamwe nuburyo bukoreshwa. Igice kidasubirwaho ntabwo kirimo p-agaciro nyuma yo gufungura utwuguruzo, intera intera, gutandukana kumashusho cyangwa ibisobanuro birambuye byo kugereranya. Basomyi bagomba kandi gushakisha ibisubizo bitandukanya imitwe ya LoRA ikata umutwe nu mwanzuro-wigihe cyo kugenzura, kimwe nigisubizo cyo kubahuza. Hatabayeho kugereranya, biragoye kumenya ibice bigize konti zimpinduka zavuzwe. Ibyo bisobanuro byafasha kandi gusobanura neza ikizere kigomba gushyirwa mubitandukaniro byatangajwe nuburyo isuzuma ryakozwe.

Kugabanuka mubintu bya salusine bishobora kuza hamwe nizindi mpinduka ziterekanwa mugice. Raporo yigihe kizaza igomba gusuzuma niba icyitegererezo aho gusiba ibintu bihari, bitanga ibisobanuro bike byamakuru, bigahinduka cyane, cyangwa bigahindura amagambo muburyo budafashwe nintebe na CHAIRi. Inkomoko ntabwo itanga ibisobanuro-byiza, ibintu-kwibutsa cyangwa ibisubizo-byo gusuzuma-abantu, ubwo rero ibicuruzwa bishoboka ni inyungu zitazwi aho kuba ingaruka zashizweho. Isuzuma ryuzuye rero rigomba gutekereza kugabanya amakosa yatoranijwe hamwe nimpinduka zose mumakuru yingirakamaro yagumishijwe mumutwe.

Kwigana bizagaragaza uburyo ubushakashatsi buboneka. Ubushakashatsi bugomba kugeragezwa kubindi byegeranyo byakusanyirijwe hamwe, ibisobanuro, ibisobanuro byanditse hamwe nicyitegererezo cyururimi, harimo na moderi idahuje imyubakire ya LLaVA-1.5-7B. Byaba byiza kandi kumenya niba guhitamo imitwe 32-biguma bihamye kandi niba umugenzuzi wubutaka yongeramo ibisobanuro bifatika. Inkomoko yatanzwe ntisobanura niba code, moderi yahinduwe cyangwa ibikoresho byo gusuzuma birahari. Ibisubizo bivuye muri ibyo byakurikiranwe byerekana niba uburyo bwatangajwe bwihariye kubigeragezo byumwimerere cyangwa birashobora gushyigikira ibikorwa byinshi byo gusobanura.

Ibijyanye nuyobora & ibibazo

Moderi ya AI YasobanuweAbahinduraImyitwarire ya AIChatGPT na LLMsGerageza ibyo uzi - gerageza ikibazo cya AI kubuntuReba ijambo AI mumagambo yacuKurikiza icyerekezo cya AI cyo kurekura
Basanze ari ingirakamaro?