Dzokera kuNhau
InnovationAI Understanding muchidimbu

RoboPhys-3D bhenji bvunzo kana yakamisikidzwa mamodheru enyika inochengetedza 3D zviitiko nezviito

A new preprint inokurudzira kuongorora vhidhiyo yenyika modhi ine 3D kuvakazve uye metrics yakatarisana nebasa, ichishuma kuti kutonga kwekuona kunogona kupotsa kutadza kwakasungirirwa kunzwisiso yenyika uye zviito zvinogoneka.

5 min readRead the primary source
Source-provided image accompanying RoboPhys-3D benchmark tests whether embodied world models preserve 3D scenes and actions
Primary-source documentKwakanyorwa
Muparidzi
arxiv.org
Source link
arxiv.orghttps://arxiv.org/abs/2608.28718
Source type
Gwaro rekutanga - chiziviso chepamutemo, bepa, faira, kana peji rebato rekutanga ratinoverenga zvakananga.
ContextNzwisisa izvi mumasekonzi makumi matanhatu

Tanga pano

Matemu akakosha

Benchmark
Muedzo wakamisikidzwa kana dhatabheti rinoshandiswa kuyera nekuenzanisa kuita kwemuenzaniso.
Pipeline
Iyo yakarongedzerwa kufambiswa kwebasa rekutanga, nhanho dzemuenzaniso, uye postprocessing matanho.
Zviedze iwe pachakoAI Models Inotsanangurwa Mibvunzo

Chii chaitika

Vatsvagiri vakaunza RoboPhys-3D, bhenji yekuongorora yakamisikidzwa mamodheru enyika kuburikidza ne3D kuvaka patsva, kunzwisisa kwenyika uye nhanho-nhanho yebasa. Iyo bhenji inovhara makumi mashanu ekuita mabasa, zviuru zvishanu episodhi uye zviuru makumi maviri neshanu epasi-echokwadi mavhidhiyo. Bepa rinoshuma kuti Cosmos 3 yakawana yepamusoro-soro yeRoboPhyscore pakati pemamodhi mana akaedzwa epasirese mamodhiyo, nepo kuuraya-yakavakirwa metrics yakafumura kushaya simba iyo yekunzwisisa uye yechiratidzo-mutauro-yemuenzaniso mitongo haina kubata.

Bepa rakatumirwa kuarXiv musi waNyamavhuvhu 28, 2026, rinosuma RoboPhys-3D sechiyereso chemhando dzepasi rose. Vanyori vanoronga dambudziko rakatenderedza mavhidhiyo epasirese modhi ayo anoshandiswa seinjini yedata, varongi vezvekuita uye masimulator eiyo yakamisikidzwa AI. Kutsoropodza kwavo ndekwekuti ongororo dzakajairwa dzepasirese-modhiyo hadzipi protocol yakabatana yakavakirwa mumatatu-dimensional chiitiko chimiro uye zviito zvinogoneka. RoboPhys-3D yakavakirwa paRoboTwin 2.0 uye inovhara makumi mashanu mabasa ekunyengera mumarejimendi mana, aine zviuru zvishanu episodhi uye zviuru makumi maviri neshanu emavhidhiyo echokwadi epasi.

Maitiro ekubhenji akagadzira mavhidhiyo uye pasi-echokwadi mavhidhiyo kuburikidza neiyo yakafanana 3D yekuvakazve pombi. Sekureva kwebepa, dhizaini iyi inoitirwa kupatsanura zvikanganiso zvakaunzwa nemaitiro ekuvakazve kubva pazvikanganiso zvinokonzerwa nevhidhiyo yakagadzirwa. RoboPhys-3D mapoka 50 metrics kuita 18 sub-dimensions uye mana ekuongorora nhanho: pixel-level kutendeka, 3D geometry kuenderana, nhanho-nhanho kunzwisisa uye basa-level kukwana. Vanyori vanosumawo Avhareji Yakazara Chibodzwa, icho avhareji ese makumi mashanu metrics, uye RoboPhyscore, diki-basa-rinoenderana mamaki zvichienderana nemametrics avanoshuma seakanyanya kuwirirana nekubudirira kwebasa.

Iyo abstract mishumo inoguma kune ina inomiririra vhidhiyo modhi yenyika. Cosmos 3 yakagamuchira yepamusoro-soro RoboPhyscore, ine zvibodzwa zve0.6330, inotsanangurwa se92.7% yepasi-chokwadi mamakisi. Bepa racho rinoti matanho ehurumende-uye ekuuraya-akavakirwa akaburitsa kutadza kukuru kusina kubatwa nemaonero kana mitongo kubva kumhando dzemutauro wechiratidzo. Inoshumawo chibvumirano chakasimba pakati peRoboPhyscore uye kuongororwa kwevanhu, nePearson correlation ye0.9761 uye Spearman kuwirirana kwe0.8962. Izvi zvirevo kubva kune imwe vhezheni arXiv preprint; kwakabva hakupi yakazvimiririra yekuongorora kana zvizere zvekuyedza kuseri kweabstract.

Kwakabva mashoko: arxiv.org ↗

Nei zvichikosha

Iro basa rinogadzirisa dambudziko repakati mune yakamisikidzwa AI: vhidhiyo inogadzirwa inogona kutaridzika inogutsa uku ichimiririra zvisizvo chiitiko kana kutadza kutsigira chiito chinogona kushandiswa. Mucherechedzo unobatanidza kufanotaura kwekuona ne 3D nyika uye kupedzwa kwebasa kunogona kupa vaongorori nzira inoshanda yekuenzanisa masisitimu, kunyangwe bepa rakafanodhindwa uye chirevo hachigadziri kushanda pamarobhoti emuviri kana kunze kwekumisikidza kwayo.

Mupiro wepakati webepa kuyedza kuyera kupfuura kuti kuburitswa kwakagadzirwa kunoratidzika kuve kunonzwisisika. Kune hurongwa hunoda kutungamira robhoti, kufanana kwekuona chete kunogona kunge kusina kukwana kana zvakafanotaurwa geometry, chimiro chechinhu kana kutevedzana kwezviito kusina kunaka. Nekusanganisira 3D kuenderana uye basa-level kuzara padivi pepixel-level kutendeka, RoboPhys-3D inogona kubatsira kupatsanura inoyevedza vhidhiyo chizvarwa kubva kune fungidziro inochengetedza ruzivo rwunodiwa pakuronga nekuita. Musiyano iwoyo unoenderana zvakananga nemagadzirirwo eAI masisitimu anoongororwa uye anovandudzwa.

Iyo pombi yekuvakazve yakagovaniswa inogona kubatsira nekuti inopa akagadzirwa uye mareferensi mavhidhiyo maitiro akafanana ekuyera. Kana zvigadzirwa zvekuvaka patsva zvichikanganisa mativi ese ekuenzanisa nenzira inofananidzwa, vaongorori vangave vachikwanisa kuziva kana chibodzwa chakaderera chinoratidza dambudziko mumuenzaniso wenyika kana mumuongorori. Iyo tsime inongotaura kuti pombi inogonesa iyi musiyano; hazviratidze kuti kupatsanurwa kwakakwana kana kuti kukanganisa kwega kwega kwekuvaka kunogona kuongororwa zvakavimbika.

Hukama hwakataurwa pakati peRoboPhyscore uye kuongororwa kwevanhu hunoratidza kuti iyo yakatsanangurwa compact mamaki inogona kuteedzera kutonga kwevanhu munzvimbo yakaedzwa. Kana ikadzokororwa, chibodzwa chakarongedzerwa basa chinogona kuita kuti kuenzanisa kuve nyore pane kushuma akawanda emametric asina hukama. Nekudaro, humbowo hunoramba hwakasungwa nebenchmark yebepa, mana anomiririra modhi uye yakataurwa dhizaini yekuongorora. Sosi yacho hairatidze kuti RoboPhyscore yakakwira inovimbisa budiriro yekubata kwemuviri, inokonzeresa kune isingaonekwe nharaunda kana kufanotaura kuita mukuchengetedzeka-yakakosha deployments.

Interactive Mechanism

Interactive Mechanism: Iyo Inonyatsoshanda

Ongorora ari pasi tekinoroji kuseri kwekusimudzira uku uchipindirana.

Agent Lifecycle Stage:
1
User Intent & Planning: "Audit customer refund request #4092 and settle payment."
2
Tool Calling: Emits structured JSON call crm_get_transaction(id='4092').
3
Guardrail & Verification:🛡️ Paused: High-value action requires human operator sign-off.
4
Final Settlement: Refund recorded, email receipt dispatched, and audit log stored.
Core takeaway: An AI agent is not just a language model—it is a closed loop of planning, tool invocation, and environment feedback. Production systems require self-healing retries and strict human approval guardrails.
Interactive Concept Check+10 Points
AI Models Explained Quiz

Which component of an AI application is the machine-learning model itself?

Zvekutarisa zvinotevera

Matanho anotevera akakosha kudzokorora kwakazvimiririra, kuburitswa kweiyo bhenji yakadzama basa uye maitiro ekuongorora, uye humbowo hwekuti RoboPhyscore inofanotaura kuita munzvimbo nyowani kana pane chaiyo hardware. Vaverengi vanofanirawo kuona kana masaisai emodhiyo anoramba akatsiga pamhando dzebasa, kuti zvikanganiso zvekuvaka patsva zvinokanganisa zvibodzwa here, uye kana chibvumirano chakashumwa nekuongorora kwevanhu chiri pasi pekuyedzwa kwakawanda.

Iko kukosha kweiyo kunoshanda kunotsamira pane izvo zvisina kubatanidzwa mune iyo sosi abstract: kuzivikanwa uye masisitimu emamodhi mana akaedzwa, iwo chaiwo basa rekuita, iyo 50 metrics, kuvaka patsva uye maitiro anoshandiswa kuona metrics ane chekuita nekubudirira kwebasa. Idzo ruzivo rwakakosha pakudzokorora uye kutonga kuti RoboPhyscore inoyera kugona kwakafara here kana kuti yakanyatso kurongedzerwa pakugovera basa rebhenji.

Chinhu chikuru chisingazivikanwe kuchinjisa kupfuura mavhidhiyo akarekodhwa uye akateedzera kana mabhenji episodhi anomiririrwa neRoboTwin 2.0. Kwakabva hakutaurire bvunzo pamarobhoti emuviri, nharaunda itsva, ruzha rwe sensor, zvimhingamipinyi zvenguva chaiyo kana hurongwa hwezvinhu zvausina kujaira. Basa rekutevera rinofanirwa kuyedza kana zvibodzwa zvichifanotaura kubudirira kwechiito pasi peaya mamiriro, apo zvikanganiso zvidiki mujometry kana nyika zvinogona kuva nemhedzisiro yakakura pane yazvinoita muongororo yekunze.

Vatsvagiri vanofanirwawo kuongorora kuti yakagadzikana sei iyo yakataurwa modhi chinzvimbo. Iyo abstract inopa Cosmos 3's RoboPhyscore asi hairatidze mamwe masisitimu 'zvibodzwa, kusavimbika siyana kana per-basa musiyano. Mavhezheni eramangwana uye zvidzidzo zvakazvimirira zvinogona kuratidza kana ongororo yekuona uye yemutauro-yemhando yemhando inoramba ichipotsa makirasi mamwe chete ekutadza, ingave sarudzo dzekuvaka patsva dzinochinja masisitimu, uye kana mamodheru achikwanisa kukwidziridza bhenji pasina kuvandudza kuuraya chaiko kwepasirese. Iyo yakashumwa Pearson naSpearman kuwirirana zvakare kunopa kudzokororwa pane yakakura-yemunhu masampuli uye akasiyana mabasa ekuunganidza.

Related guides & Quizzes

AI Models InotsanangurwaAI AgentsTransformersRamangwana reAIEdza zvaunoziva - edza yemahara AI quizTarisa kumusoro izwi reAI mune yedu glossaryTevedza iyo AI modhi yekuburitsa tracker
Wakawana izvi zvinobatsira?