Dzokera kuNhau
InnovationAI Understanding muchidimbu

Benchmark inowana mamodheru emutauro wechiratidzo achinetsekana kuona zvibodzwa zvisina kujeka kuburikidza nenhaurirano

Chiyereso chitsva chinoshuma kuti mamodheru makuru emutauro wechiratidzo anoita zvakanaka pazasi pekutanga kwevanhu paanofanirwa kuona zvinotariswa kuburikidza netsananguro isina kukwana uye nekudyidzana.

5 min readRead the primary source
Primary-source image accompanying Benchmark finds vision-language models struggle to identify ambiguous targets through dialogue
Primary-source documentKwakanyorwa
Muparidzi
arxiv.org
Source link
arxiv.orghttps://arxiv.org/abs/2608.23978
Source type
Gwaro rekutanga - chiziviso chepamutemo, bepa, faira, kana peji rebato rekutanga ratinoverenga zvakananga.
ContextNzwisisa izvi mumasekonzi makumi matanhatu

Tanga pano

Matemu akakosha

Benchmark
Muedzo wakamisikidzwa kana dhatabheti rinoshandiswa kuyera nekuenzanisa kuita kwemuenzaniso.
Calibration
Zvibodzwa zvekuvimbo zvemodhi zvinonyatsoenderana nei zvingangoitika.
Annotation
Mazita akawedzerwa nevanhu kana metadata inoshandiswa kudzidzisa kana kuongorora mhando dzekudzidza dzemuchina.
Zviedze iwe pachakoAI Models Inotsanangurwa Mibvunzo

Chii chaitika

Iyo itsva arXiv preprint inounza inodzorwa sisitimu yekuyedza inopindirana yekuona pasi mumamodhi makuru emutauro wechiratidzo. Chidzidzo ichi chinosiyana kuti ingani ruzivo nezvechinangwa chekuona chinopihwa pekutanga uye kuti ingani inofanirwa kuunganidzwa kuburikidza nenhaurirano. Pakati pezvinhu zvina-zvakavakirwa pakuona kwevanhu uye mana ekudyidzana maprotocol, vanyori vanotaura kuti mamodheru azvino anoita zvakanyanya pazasi pebasa-level rekutanga revanhu.

Iro bepa rinotarisana nekuona pasi, iyo inotsanangura sebasa rekubatanidza chirevo chekutaura kune chinangwa chekuona. Vanyori vanopokana kuti ongororo dzakajairwa dzinowanzo pfuti imwe chete: modhi inogamuchira tsananguro inodzidzisa uye inoimepu kune chinhu chakarongwa. Chimiro chavo panzvimbo pacho chinobata chirevo senzira yekudyidzana umo ruzivo rwekutanga runogona kunge rusina kukwana kana kusanzwisisika uye chinangwa chinogona kusimbiswa kuburikidza nenhaurirano.

Ongororo yacho inosiyana maviri epakati mamiriro: ingani ruzivo rwechinangwa rwunopihwa pakutanga uye yakawanda sei inofanirwa kuwanikwa kuburikidza nekudyidzana. Sosi yacho inoti iyo dhizaini inovhara ina-yakavakirwa-yakavakirwa vanhu mamiriro ekuona uye mana ekudyidzana protocol. Izvo hazviratidze iwo mamiriro kana maprotocol mune arXiv peji mavara akapihwa pano, saka chiyero uye realism yezviyedzo zvigadziriso hazvigone kuongororwa zvakazvimirira kubva kune ino sosi chete.

Pakati pezvirongwa zvakaedzwa, vanyori vanoshuma kuti mamodheru makuru emutauro wekuona anoita zvakanyanya pazasi pebasa-chikamu chekutanga chevanhu. Chiziviso hachipi zvibodzwa zviri pasi, nhamba kana kuzivikanwa kwemamodheru akaongororwa, saizi yeboka rekuenzanisa kwevanhu, kana maitirwo ezviverengero anoshandiswa kuratidza musiyano iwoyo. Mhedzisiro yacho inofanirwa kuverengerwa seyakaziviswa nebepa, kwete seyero yeindasitiri-yakafara.

Iyo yakashumwa maitiro haina zvakafanana zvakashata. Kudyidzana kunogona kubatsira kana mibvunzo yekutevera ichinatsa kana kugadzirisa tsananguro yekutanga. Nekudaro, kuita kwakadzikira kana pasina tsananguro yekutanga inopihwa uye modhi inofanirwa kuwana ruzivo rwechinangwa nekubvunza mibvunzo. Vanyori vanotsanangura izvi sekunetseka nekuita, kutungamirwa nemubvunzo. Zvidzidzo zvekutevera zvinonzi zvakawana mapatani akafanana pane tsananguro dzakagadzirwa nevanhu uye neAI, kuedza kwakasiyana-siyana, kudzokororwa kupindirana, vanopa tsananguro, uye mamiriro ekuona, asi kwazvinoita haape iwo ruzivo rwunodiwa kuenzanisa iwo mamiriro.

Kwakabva mashoko: arxiv.org ↗

Nei zvichikosha

Zvakawanikwa zvinoratidzira kusasimba kunoshanda mumultimodal AI masisitimu anofanirwa kugadzirisa mareferensi asina kujeka pane kungofananidza tsananguro yakazara kumufananidzo. Mamodheru dzimwe nguva anonatsiridza kana mibvunzo yekutevera ichijekesa kana kugadzirisa tsananguro yekutanga, asi kuita zvakanyanya kana vachifanira kubvunza mibvunzo kuti vaone zvinorehwa nemunhu. Kunyanya kuzvivimba kwakashumwa kunomutsawo kunetseka kune masisitimu anotaurira kusavimbika kune vashandisi.

Mazhinji ekuona AI mabasa ari nyore kana sisitimu inogamuchira yakazara, rondedzero chaiyo yezvaunowana. Mupiro webepa ndewekutarisisa mamiriro asina kurongeka apo munhu anonongedzera kune chimwe chinhu chisina kujeka, anotora mamiriro ekugovana, kana kupa ruzivo mumatanho. Muchigadziro ichocho, kubudirira kunoda zvinopfuura kufananidzwa kwekuona: sisitimu inofanirwa kuziva kusajeka, kusarudza kuti ndeupi ruzivo rwusipo, kubvunza mubvunzo unobatsira, uye kusanganisa mhinduro nezvainoona.

Mukaha wakashumwa pakati pemamodheru nematanho ekutanga ebasa revanhu zvine basa nekuti sisitimu inogona kuoneka inokwanisa mukuratidzira kwepfuti imwe chete ichiramba isingavimbike muhurukuro dzakajairika. Mushandisi anogona kutarisira kuti modhi inzwisise zvirevo zvakaita serengedzo isina kujeka kuchinhu chiri muchiitiko, asi bhenji inoratidza kuti kuita kunodzikira kana modhi yacho ichifanira kunyatso ratidza kuti ndechipi chinhu chavanoda. Kwainobva haatauri kuti ese akaiswa sisitimu ine utera uhwu muchiyero chimwe chete, asi inoratidza kutadza maitiro ayo akajairwa-pfuti bvunzo anogona kupotsa.

Iro bepa zvakare rinoshuma kusarongeka kwakashata: modhi dzinowanzo ratidza kusatya kupfuura iwo empirical echokwadi waranti. Izvi zvinogadzira dambudziko rekushanda rakasiyana kubva pakungowana mhinduro isiriyo. Kana sisitimu ichiita seyakajeka paunenge uchisarudza chinangwa chisiri icho, mushandisi anogona kunge aine chikonzero chidiki chekutarisa mhedzisiro. Iyo abstract haitauri kuti chivimbo chakaitwa sei, kuyerwa kwakayerwa sei, kana kuti chero modhi kana protocol yakaitwa zvirinani kupfuura mamwe.

Mhedzisiro yakafara, yakavakirwa pakugadzira kwevanyori, ndeyekuti inodyidzana yekuona pasi inofanira kuongororwa semusanganiswa wekuona kuenderana, kutsvaga ruzivo, uye synthesis. Izvo zvinogona kuzivisa kuyedzwa kwevabatsiri vemultimodal uye mamwe masisitimu anoshandisa nhaurirano kududzira mifananidzo. Zvakadaro, sosi yacho haipe humbowo hwekutumirwa, kuyerwa kwemushandisi, zviitiko zvekuchengetedza, kana humbowo hwekuti bhenji rinofanotaura kuita mune imwe nzvimbo yekutengesa kana yeruzhinji-chikamu.

Interactive Mechanism

Interactive Mechanism: Iyo Inonyatsoshanda

Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.

Thinking Budget (Test-Time Tokens):1,024 tokens
Complex Accuracy79%Math & Code Logic
Latency3.2sTime to first full output
Inference Cost$0.0092Per query estimated
Reasoning StyleStep VerificationInternal chain depth
Active Thinking Trace:
1Deconstruct user problem into formal constraints
2Propose candidate hypotheses & step-by-step calculation
3Self-correction: Backtrack and refute subtle edge cases
4Exhaustive consistency check & final output synthesis
Core takeaway: Test-time compute fundamentally changes AI economics. Instead of only scaling during pre-training, giving reasoning models more tokens at inference time allows them to systematically solve PhD-level STEM problems.
Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Zvekutarisa zvinotevera

Iro bepa ndeye arXiv preprint uye kwainobva haripe mazita emhando, saizi dzemuenzaniso, evaluation metrics, basa-level zvibodzwa, kana ruzivo nezve ina yekuona mamiriro uye maitirwo ekudyidzana. Kumwe ongororo kunofanirwa kuongorora kana chimiro chakazara mumamodheru, mitauro, nharaunda dzinoonekwa, uye zviitiko zvemashandisirwo epasi rose, uye kana sarudzo yemubvunzo iri nani kana kusavimbika kugadzirisa kunovandudza mashandiro.

Mubvunzo wekutanga ndeye reproducibility. Kwarinobva kunozivisa bepa searXiv:2608.23978, rakatumirwa Aug. 25, 2026, uye rinonyora kuti vhezheni-imwe preprint. Inoti basa rakabatana neEMNLP 2026 zvidzidzo zvikuru, asi hazvigadziri kugamuchirwa kana kudzokororwa nevezera. Vaverengi vanofanira kuongorora bepa rakazara rekuvaka basa, maitiro ezvinyorwa, rondedzero yemuenzaniso, kukurumidza, mitemo yekugova, uye ongororo yenhamba.

Nyaya yechipiri ndeyechokwadi chekunze. Iyo abstract inoti mapatani anoenderera kune akasiyana siyana ekutsanangura masosi, kuedza kufunga, kudzokororwa kupindirana, vanopa tsananguro, uye mamiriro ekuona, asi haitsanangure iwo misiyano muzvinyorwa zvinopihwa. Ongororo yekutevera pamifananidzo isingazivikanwe, nharaunda dzakazara, mitauro yakasiyana, mamiriro ekusvikika, uye nhaurirano yevashandisi mhenyu zvingabatsira kuona kuti kusasimba kwakataurwa kwakatetepa here kana kuti kwakajairika.

Nzvimbo yechitatu yekutarisa ndeyekupindira dhizaini. Iro bepa rinoratidza kuti mibvunzo yekutevera inogona kunatsa kana kugadzirisa tsananguro yekutanga, nepo kubvunza kwakasimba kunoramba kwakaoma. Musiyano iwoyo unoratidza bvunzo inobatsira yebasa remangwana: ingave mamodheru anogona kuona kusavimbika nekukurumidza uye kubvunza mibvunzo yakanangwa pane kufungidzira. Sosi yacho haitauri nzira yakabudirira yekuvandudza hunhu ihwohwo, saka chero chirevo chekuti kumwe kukurudzira, kudzidziswa, kana nzira yekubatanidza inogadzirisa dambudziko inoda humbowo hwakasiyana.

Pakupedzisira, kuenzanisa kunofanirwa kuenderera mberi. Modhi inobvunza kujekesa mibvunzo asi ichiramba yakazvivimba inogona kuramba ichigadzira zvikanganiso zvinodzivisika. Mhedzisiro yeramangwana inofanirwa kuzivisa zvese zviri zviviri kudzika kwepasi uye kusavimbika kwemhando, kusanganisira kuita pasi pekudyidzana kwakadzokororwa uye nepakati pemamiriro akasiyana ekuona. Kusvika iwo ruzivo rwavepo, bepa rinotsigira yambiro yakajeka nezve yazvino LVLM ongororo, asi kwete chaiyo chinzvimbo chemasisitimu kana mhedziso nezve kugadzirira kwekumwe kutumirwa.

Related guides & Quizzes

AI Models InotsanangurwaChatGPT neLLMsAI AgentsEdza zvaunoziva - edza yemahara AI quizTarisa kumusoro izwi reAI mune yedu glossaryTevedza iyo AI modhi yekuburitsa tracker
Wakawana izvi zvinobatsira?