Ita-A-Vhidhiyo Chinyorwa-kune-Vhidhiyo
Make-A-Vhidhiyo ndeye Meta's 2022 sisitimu inosandura kurudziro kuita kavhidhiyo kapfupi pasina kumbodzidzira pane akanyorwa mavara-mavhidhiyo maviri.
Pfupiso
It matters because it showed that the visual knowledge inside text-to-image models could be 'taught' to move using only unlabeled video.
Kudzika Kwakadzika
Make-A-Vhidhiyo, yakaziviswa ne Meta AI muna Gunyana 2022, inogadzira masekonzi mashoma evhidhiyo kubva mumutsara wakaita sekuti 'imbwa yakapfeka chikepe chemhare ichibhururuka mudenga.' Chinongedzo chayo ndechekubvisa chitarisiko kubva pakufamba: chinyorwa-ku-chifananidzo modhi (yakavakirwa paCLIP-chimiro chakabatana chinyorwa-chifananidzo nzvimbo uye kupararira) inodzidza kuti zvinhu zvinotaridzika sei kubva kumabhiriyoni emifananidzo yakanyorwa, nepo akaparadzana spatiotemporal akaturikidzana achidzidza mafambiro ezvinhu kubva kuvhidhiyo isina kunyorwa chete. Izvi zvinobvisa kushomeka kwemhando yepamusoro yemavara-mavhidhiyo maviri. Iyo base modhi inogadzira yakaderera-resolution, yakaderera-frame-reti zvimedu, zvino yakatsaurirwa network inodudzira mamwe mafuremu uye upscale spatial resolution. Mhedzisiro yacho yainyatsoenderana kwenguva yayo, kunyangwe zvimedu zvaive zvipfupi, zvisinganzwisisike, uye zvaida kupenyereka uye kutenderera.
Technical Insight
Make-A-Vhidhiyo inowedzera 2D mufananidzo-chizvarwa convolutions uye kutarisa mu 3D nekuwedzera pseudo-temporal layer. Pretrained spatial huremu akaomeswa nechando kana kurongedzwa zvakanaka ukuwo matsva emazuva ano achidzidza mafambiro kubva kuvhidhiyo mbishi, saka hapana mavara-vhidhiyo mavara anodiwa. Iyo furemu-yekududzira network inobva yaomesa mutsara wenguva uye super-resolution diffusion modules inosimudza ruzivo rwenzvimbo, ichishandura yakaomarara gumi nematanhatu-frame, yakaderera-res draft kuita yakatsetseka, inopinza clip mupombi yakapwanyika.
Strategic Impact
Kumhanya uye chiyero
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Vaka sarudzo
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Team uye workflow
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Ramangwana reMake-A-Vhidhiyo Chinyorwa-kune-Vhidhiyo
Make-A-Vhidhiyo's image-pre-plus-unlabeled-motion resipi yakadyara zvinyorwa-kune-vhidhiyo wave. Zvizvarwa zvaro zvinosimbisa kureba, kwepamusoro-resolution, zvimedu zvakagadzikana zvenguva pfupi zvine inodzoreka kamera inofamba uye odhiyo. Tarisira iyo yakakosha pfungwa, kushandisazve yakakura ruzivo rwemufananidzo uye kufamba kwekudzidza zvakachipa, kuenderera kunyange sezvivakwa zvinoshanduka kuenda kune transformer-based latent diffusion uye mamodheru akabatana anobvumawo mufananidzo kana vhidhiyo mamiriro ekugadzirisa nekuenderera mberi.
Real-World Implementation
Kusimudzira mutsara mumwe chete unotsanangura kuita kapfupi looping clip yesocial media post
Kuunza pfungwa yakamira senge 'teddy bear ipenda mufananidzo' kuhupenyu semufananidzo unofamba
Kupindirana pakati pemifananidzo miviri yakapihwa nemushandisi kugadzira vhidhiyo yekuchinja yakatsetseka
Kugadzira madhiramu ekukurumidza ekufamba ezviratidziro zvebhodhibhodhi pamberi pechero firimu
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Make-A-Video Text-to-Video quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Sora uye Zvinyorwa-ku-Vhidhiyo
Mibvunzo inowanzo bvunzwa
What is Make-A-Video Text-to-Video?
Make-A-Vhidhiyo ndeye Meta's 2022 sisitimu inosandura kurudziro kuita kavhidhiyo kapfupi pasina kumbodzidzira pane akanyorwa mavara-mavhidhiyo maviri. Izvo zvine basa nekuti zvakaratidza kuti ruzivo rwekuona mukati memavara-kune-mufananidzo modhi rinogona 'kudzidziswa' kufamba uchishandisa vhidhiyo isina kunyorwa chete.
Ndeipi yaive yepakati hunyanzvi iyo inoita kuti Make-A-Vhidhiyo irege kuda akanyorwa mavara-mavhidhiyo maviri?
Gadzira-A-Vhidhiyo inobvisa dambudziko: chinyorwa-ku-chifananidzo modhi inodzidza kuti zvinhu zvinotaridzika sei kubva pamifananidzo ine mashoko, nepo akapatsanurwa epanguva akaturikidzana achidzidza kufamba kubva kune mbishi, isina kunyorwa vhidhiyo.
Ko Make-A-Vhidhiyo inowedzera sei kugona kufamba kune mufananidzo modhi?
Iyo inowedzera 2D spatial convolutions uye kutarisisa neatsva temporal layers anodzidza machinjiro emukati nekufamba kwenguva.
Chii chinoitwa neframe-interpolation uye super-resolution matanho?
Mushure meiyo yakaderera yakaderera-res, yakaderera-frame-reti dhizaini, kududzira kunowedzera mafuremu uye super-resolution modules inosimudza kugadzirisa.
Ndechipi chaive chigadzikiso chekubuda kweMake-A-Vhidhiyo?
MaClips aingova masekonzi mashoma, akadzikira, uye aiwanzoita kupenya kwechinguva uye kukanganisa.