Visual AI GUIDE

Diffusion Policy yeRobhoti Kudzora

Diffusion Policy inoshandisa iyo yakafanana denoising zano kuseri kwemifananidzo jenareta seStable Diffusion kune marobhoti kutonga: pachinzvimbo chekufanotaura chiito chimwe chinotevera, chinoburitsa kupfupika kutevedzana kwezvichaitika mune ramangwana nekudzokorodza ruzha.

2 min verengaLast update

Pfupiso

It matters because it handles the messy, multi-modal nature of real manipulation far better than older methods.

Kudzika Kwakadzika

Yakaunzwa muna 2023 nevatsvagiri veColumbia, MIT, uye Toyota Research Institute, Diffusion Policy inodzokorodza kudzidza kwe visuomotor seyakagadziriswa denoising. Tichifunga ichangoburwa mifananidzo yekamera uye mamiriro erobhoti, inotanga kubva kune ruzha uye inomhanya akati wandei nhanho kuti ibudise 'chiito chunk' - taura 8 kusvika ku16 nguva dzinotevera dzekupedzisira-effector. Iko kuhwina kukuru ndeye multimodality: kana basa riine akati wandei mhinduro (iwe unogona kubata gagi kubva kuruboshwe kana kurudyi), tsika dzechinyakare dzinovaisa mukuita kwakashata kwepakati, nepo modhi yekuparadzira inogona kuita zvakachena kune imwe modhi. Inodzidzawo zvakadzikama kubva mukuratidzira kwevanhu (behaviour cloning) uye inogara zvakanaka nepamusoro-dimensional nzvimbo dzekuita, zvichiita kuti ive sarudzo yekusarudzika mumasisitimu mazhinji emazuva ano.

Technical Insight

Kudzidzira kunowedzera Gaussian ruzha kuratidza kutevedzana kwechiito uye inodzidzisa network (kazhinji U-Net kana transformer) kufanotaura ruzha irworwo, rwakamisikidzwa pane zvinoonekwa uye zvine chekuita nekutarisa. Panguva yekumhanya inodenha kubva kune zvisina kujairika samples pamusoro pematanho mashoma (DDPM/DDIM) kuburitsa chiito trajectory. Kufanotaura machunks pamwe ne 'receding-horizon' kuronga zvakare kunopa kuenderana kwechinguvana uchiramba uchiita zvekutarisa kutsva.

Strategic Impact

Kumhanya uye chiyero

Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.

Vaka sarudzo

Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.

Team uye workflow

Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.

Ramangwana reDiffusion Policy yeRobhoti Kudzora

Basa riri kucheka huwandu hwematanho ekuita denoising (kuburikidza nemamodhi anoenderana uye kuyerera kwekuenzanisa) saka marongero anomhanya nepamusoro kudzora mitengo pahardware chaiyo. Misoro yezviito zvediffusion iri kusungirirwa pamabhenekeri makuru emutauro wekuona kuti aumbe maVLA, uye 3D-inoziva uye akasiyana akasiyana anovandudza semuenzaniso. Tarisira diffusion-based control kuti irambe iri chinhu chakakosha mu generalist robhoti 'brains' inogonesa dexterous uye bimanual mabasa.

Real-World Implementation

Ruoko rwerobhoti rwuchisundidzira chivharo chakaita saT kuti chipinde pachinangwa, bhenji uko Diffusion Policy yakanyatso pfuura maitiro ekutanga maitiro-cloning.

Marobhoti eBimanual anodzidza mabasa akapfava ekicheni senge kutenderedza chikafu kana kuunganidza zvikamu kubva kune vanhu teleoperation demos.

Cluttered-bin picking uko kune akawanda ma grasps aripo uye mutemo unozvipira kune imwe panzvimbo yeavhareji

Chiito-musoro module mukati mechiratidzo-mutauro-chiito masisitimu inogadzira yakatsetseka yakakwira-frequency kufamba kwemaoko ane hunyanzvi.

Njodzi & Guardrails

Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.

Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.

Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.

Implementation Roadmap

1

Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.

2

Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.

3

Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.

4

Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.

Ramba Uchiongorora

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Diffusion Policy for Robot Control quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tanga mibvunzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Mibvunzo inowanzo bvunzwa

What is Diffusion Policy for Robot Control?

Diffusion Policy inoshandisa iyo yakafanana denoising zano kuseri kwemifananidzo jenareta seStable Diffusion kune marobhoti kutonga: pachinzvimbo chekufanotaura chiito chimwe chinotevera, chinoburitsa kupfupika kutevedzana kwezvichaitika mune ramangwana nekudzokorodza ruzha. Izvo zvine basa nekuti inobata yakashata, yakawanda-modal hunhu hwekunyengedza chaiko zvirinani kupfuura nzira dzechikuru.

Chii chinogadzirwa neDiffusion Policy pane imwe neimwe sarudzo?

Diffusion Policy inoburitsa chiitiko chunk - akati wandei anotevera nhanho dzezviito - nekuita denoising, pane imwechete yakasarudzika murairo.

Ndeipi nzira yekugadzira iyo Diffusion Policy inokwereta kubva pamufananidzo AI?

Kufanana nemhando yekuparadzira mifananidzo, inotanga kubva muruzha uye ichidzokorodza, asi pano chinobuda chiitiko chinotarirwa pane zvakaonekwa.

Nderipi dambudziko reakawanda-modal mabasa anogadziriswa Diffusion Policy zvirinani pane kudzoreredza kuri nyore?

Kana zviito zvakati wandei zvichishanda (semuenzaniso, kubata kuruboshwe kana kurudyi), kudzoreredza kunovaita sarudzo yepakati isina kunaka; kupararira kunogona kuita zvakachena kune imwe modhi.

Panguva yekudzidziswa, chii chinonzi network muDiffusion Policy inodzidziswa kufanotaura?

Ruzha rweGaussian runowedzerwa kune zvakaratidzwa zviito uye network inodzidza kufanotaura iyo ruzha (inogadziriswa pane zvakaonekwa), iyo yakajairwa denoising chinangwa.

Chii chinonzi 'receding-horizon' kurongazve muDiffusion Policy?

Iyo mutemo inofanotaura chunk yezviito asi nguva nenguva inoronga zvakare uchishandisa zvitsva zvinoonekwa, kuenzanisa kuenderana kwechinguvana nekuitazve.