Inqubomgomo Yokusabalalisa Yokulawula Irobhothi
I-Diffusion Policy isebenzisa umqondo ofanayo wokwenza umsindo ngemuva kwezijeneretha zesithombe ezifana ne-Stable Diffusion ekulawuleni irobhothi: esikhundleni sokubikezela isenzo esisodwa esilandelayo, ikhiqiza ukulandelana okufushane kwezenzo zesikhathi esizayo ngokulungisa umsindo ngokuphindaphindiwe.
Uhlolojikelele
It matters because it handles the messy, multi-modal nature of real manipulation far better than older methods.
I-Deep Dive
Yethulwa ngo-2023 ngabacwaningi base-Columbia, MIT, kanye ne-Toyota Research Institute, Inqubomgomo Yokusabalalisa ihlela kabusha ukufunda kwe-visuomotor njengokuqeda umsindo okunemibandela. Uma kubhekwa izithombe zekhamera zakamuva kanye nesimo serobhothi, iqala emsindweni ongahleliwe futhi iqhube izinyathelo ezimbalwa zokuhlukanisa umsindo ukuze kukhiqizwe 'isiqephu sesenzo' - isho izinyathelo zesikhathi ezilandelayo eziyi-8 kuya kwezingu-16 zokuma komphumela. Ukuwina okukhulu i-multimodality: uma umsebenzi unezixazululo ezimbalwa ezivumelekile (ungabamba inkomishi ukusuka kwesokunxele noma kwesokudla), ukwehla okujwayelekile kubenza babe isenzo esibi esimaphakathi, kuyilapho imodeli yokusabalalisa ingazibophezela ngokuhlanzekile kumodi eyodwa. Iphinde ifunde ngokuzinza emibonisweni yabantu (ukuhlanganisa ukuziphatha) futhi ibhekane kahle nezikhala zesenzo ezinobukhulu obuphezulu, ikwenze kube ukukhetha okuzenzakalelayo ezinhlelweni eziningi zesimanje zokukhohlisa.
I-Technical Insight
Ukuqeqeshwa kwengeza umsindo we-Gaussian ekuboniseni ukulandelana kwesenzo futhi kufundisa inethiwekhi (ngokuvamile i-U-Net noma i-transformer) ukubikezela lowo msindo, obekwe esimweni sokubhekwa okubukwayo nokubalulekile. Ngesikhathi sokusebenza izwakala isuka kumasampuli angahleliwe phezu kwezinyathelo ezimbalwa (DDPM/DDIM) ukuze iveze umzila wesenzo. Ukubikezela izingcezu kanye nokuhlela kabusha 'kwe-receding-horizon' kunikeza ukuvumelana kwesikhashana ngenkathi kuhlala kuxhumene nokuphawuliwe okusha.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lenqubomgomo Yokusabalalisa Yokulawula Amarobhothi
Umsebenzi unciphisa inani lezinyathelo ze-denoising (ngamamodeli angaguquguquki nokuhambisana nokugeleza) ukuze izinqubomgomo zisebenze ngezilinganiso eziphezulu zokulawula ihadiwe yangempela. Amakhanda esenzo sokusatshalaliswa abhawushelwa kuma-backbones amakhulu olimi lombono ukuze akhe ama-VLA, futhi okuhlukile okuqaphela i-3D nokulinganayo kuthuthukisa ukusebenza kahle kwesampula. Lindela ukulawula okusekelwe ekusakazweni ukuze kuhlale kuyisithako esiyinhloko 'kubuchopho' berobhothi obujwayelekile obunika amandla imisebenzi ewubuciko kanye neyezandla ezimbili.
Ukuqaliswa Komhlaba Wangempela
Ingalo yerobhothi ephusha ibhulokhi emise okuka-T endaweni ephokophelwe, ibhentshimakhi lapho Inqubomgomo Yokusabalalisa isebenze ngokuphawulekayo ngaphezu kwezindlela zangaphambili zokuhlanganisa ukuziphatha
Amarobhothi e-Bimanual afunda imisebenzi yasekhishini ethambile njengokuphenyisisa ukudla noma ukuhlanganisa izingxenye ezivela kumademo okusebenza kwabantu
Ukukhetha imigqomo eyimfuhlumfuhlu lapho ukubamba okuningi okuvumelekile kukhona futhi inqubomgomo izibophezela kokukodwa esikhundleni sokulinganisa
Imojula ye-Action-head ngaphakathi kwezinhlelo zesenzo solimi lombono ekhiqiza ukunyakaza okushelelayo kwe-high-frequency yezandla ezihlakaniphile
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Diffusion Policy for Robot Control quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Stable Diffusion
Imibuzo evame ukubuzwa
What is Diffusion Policy for Robot Control?
I-Diffusion Policy isebenzisa umqondo ofanayo wokwenza umsindo ngemuva kwezijeneretha zesithombe ezifana ne-Stable Diffusion ekulawuleni irobhothi: esikhundleni sokubikezela isenzo esisodwa esilandelayo, ikhiqiza ukulandelana okufushane kwezenzo zesikhathi esizayo ngokulungisa umsindo ngokuphindaphindiwe. Ibalulekile ngoba iphatha imvelo engcolile, enezimo eziningi zokukhohlisa kwangempela kangcono kakhulu kunezindlela ezindala.
Ikhiqiza ini Inqubomgomo Yokusabalalisa endaweni ngayinye yesinqumo?
I-Diffusion Policy ikhiqiza isiqephu sesenzo - izinyathelo zesikhathi zesikhathi esizayo ezimbalwa - ngokwenza i-denoising, kunokuba umyalo owodwa owodwa.
Iyiphi indlela yokukhiqiza inqubomgomo Yokusabalalisa eyiboleka ku-AI yesithombe?
Njengamamodeli okusabalalisa izithombe, iqala emsindweni futhi iphinde ihlehle ngokuphindaphindiwe, kodwa lapha okukhiphayo kuwumzila wesenzo omiswe kokubhekwayo.
Iyiphi inkinga yemisebenzi ye-multi-modal i-Diffusion Policy eyixazulula kangcono kunokuhlehla okulula?
Uma izenzo ezimbalwa zivumelekile (isb., bamba kwesokunxele noma kwesokudla), ukuhlehla kuzenza zibe inketho emaphakathi embi; ukusabalalisa kungenza ngokuhlanzekile kumodi eyodwa.
Ngesikhathi sokuqeqeshwa, yini inethiwekhi Yenqubomgomo Yokusabalalisa efundiswa ukubikezela?
Umsindo we-Gaussian wengezwa ezenzweni ezibonisiwe futhi inethiwekhi ifunda ukubikezela lowo msindo (uncike kokubhekwayo), inhloso evamile yokukhipha umsindo.
Kuyini ukuhlela kabusha kwe-'receding-horizon' Kunqubomgomo Yokusabalalisa?
Inqubomgomo ibikezela ingxenye yezenzo kodwa ihlela kabusha ngezikhathi ezithile isebenzisa ukuqaphela okusha, ibhalansisa ukuvumelana kwesikhashana nokusebenza kabusha.