Visual AI Itọsọna
Ṣe-A-Fidio Ọrọ-si-Fidio
Make-A-Video jẹ eto 2022 ti Meta ti o yi itọka ọrọ pada si agekuru fidio kukuru laisi ikẹkọ lailai lori awọn orisii ọrọ-fidio ti a samisi.
Gbọ si itọsọna yiiAI-ṣe afihan · ~2 min
Lori iwe yi2 min ka
Akopọ
O ṣe pataki nitori pe o fihan pe imọ wiwo inu awọn awoṣe ọrọ-si-aworan le jẹ 'kọwa' lati gbe ni lilo fidio ti ko ni aami nikan.
Jin Dive
Make-A-Video, announced by Meta AI in September 2022, generates brief video clips from text prompts. Its key trick is decoupling appearance from motion: a text-to-image model learns what things look like from paired text-image data, while separate spatiotemporal layers learn how they move from video footage with no associated text. Meta said this reduced the need for paired text-video examples and that the research used publicly available datasets. Meta also described making videos from images and creating new videos similar to existing videos. The base model produces low-resolution, low-frame-rate clips, then dedicated networks interpolate extra frames and upscale spatial resolution. The result was strikingly coherent for its era, though clips were short, blurry, and prone to flicker and warping.
Real-World imuse
Imirara gbolohun asọye kan ṣoṣo sinu agekuru looping kukuru kan fun ifiweranṣẹ awujọ kan
Gbigbe imọran aimi kan bi 'Teddi agbateru kikun aworan kan' si igbesi aye gẹgẹbi apejuwe gbigbe
Ibaṣepọ laarin awọn aworan oluṣamulo meji ti a pese lati ṣẹda fidio iyipada didan
Ṣiṣẹda awọn iyaworan išipopada iyara ti awọn oju iṣẹlẹ ti a riro fun titan itan-akọọlẹ ṣaaju ṣiṣe aworan eyikeyi
Ọjọ iwaju ti Ṣe-A-Fidio Ọrọ-si-Fidio
Ṣe-A-Fidio ká aworan-ṣaaju-plus-unlabeled-išipopada ohunelo irugbin gbogbo ọrọ-si-fidio igbi. Awọn ọmọ rẹ tẹnumọ gigun, ipinnu giga, awọn agekuru iduroṣinṣin igba diẹ pẹlu išipopada kamẹra iṣakoso ati ohun. Reti imọran pataki, atunlo imọ aworan nla ati išipopada ikẹkọ ni olowo poku, lati tẹsiwaju paapaa bi awọn ile ayaworan ṣe yipada si itankale wiwakọ ti o da lori ẹrọ iyipada ati awọn awoṣe iṣọkan ti o tun gba aworan tabi karabosipo fidio fun ṣiṣatunṣe ati itesiwaju.
Fifi o sinu iwa
Kini idi ti o ṣe pataki
- Iyara ati iwọn. Visual AI le ṣe adaṣe adaṣe, wiwa, ati awọn iṣẹ ṣiṣe taagi ni iwọn.
- Kọ awọn yiyan. Awọn ẹgbẹ ẹda le ṣe apẹrẹ awọn imọran yiyara pẹlu awọn atunyẹwo afọwọṣe diẹ.
- Ẹgbẹ ati ṣiṣan iṣẹ. Awọn iṣẹ ṣiṣe le lo aworan ati awọn ifihan agbara fidio ti o nira tẹlẹ lati ṣiṣẹ.
Ṣọra fun
- Awọn ẹtọ aworan ati igbanilaaye le di awọn eewu labẹ ofin ti o ba jẹ afihan.
- Iṣe awoṣe le yatọ kọja ina, awọn ẹda eniyan, ati awọn agbegbe.
- Awọn idaniloju eke le ma ṣe akiyesi ayafi ti a ba ṣe abojuto awọn ala igbẹkẹle.
Next awọn igbesẹ
- Ṣetumo awọn ibeere gbigba fun pipe, iranti, ati awọn idiyele aṣiṣe.
- Ṣe idanwo pẹlu data ti o baamu awọn ipo iṣelọpọ gidi.
- Ṣafikun atunyẹwo eniyan fun igbẹkẹle kekere tabi awọn asọtẹlẹ ipa-giga.
- Tọpinpin awoṣe ki o ṣe tunṣe lẹhin kamẹra tabi awọn ayipada datasetto.
Tesiwaju Ṣiṣawari
Ìwé ìròyìn ọfẹ
Gba ìkànìyàn AI ojoojúmọ́
Ìtàn AI mẹta tó jẹ́rìí ní gbogbo owurọ́ ọjọ́ iṣẹ́, kọ́wé ní Gẹ̀ẹ́sì tó rọrùn. Ọfẹ́ fún gbogbo àkókò, kò sí ìpolówó.
Ìmeèlì kan ní gbogbo ọjọ́ iṣẹ́. Yọkúrò ní ìkànìyàn ní ìkànìyàn kan. A kò ta tàbí pín àdírẹ́sì rẹ.
Ṣe idanwo fun ara rẹ
Take the Make-A-Video Text-to-Video quiz
Ìdáhùn lẹ́sẹ̀kẹsẹ̀ lórí gbogbo ìdáhùn, àti iwe-ẹ̀rí tó lè pin pẹ̀lú ID tó lè jẹ́rìí lẹ́yìn tí o bá kọ́ ẹ̀kọ́.
Ṣe àtìlẹ́yìn ẹ̀kọ́ AI ọfẹ́. AI Understanding jẹ́ àjọ àìní èrè 501(c)(3) — kò sí ìpolówó, kò sí àkúnya owó, ní gbogbo àkókò. Ṣe ẹbun kan
Awọn ibeere ti a beere nigbagbogbo
Kini Ṣe-A-Fidio Ọrọ-si-Fidio?
Make-A-Video jẹ eto 2022 ti Meta ti o yi itọka ọrọ pada si agekuru fidio kukuru laisi ikẹkọ lailai lori awọn orisii ọrọ-fidio ti a samisi. O ṣe pataki nitori pe o fihan pe imọ wiwo inu awọn awoṣe ọrọ-si-aworan le jẹ 'kọwa' lati gbe ni lilo fidio ti ko ni aami nikan.
Kini isọdọtun aarin ti o jẹ ki Ṣe-A-Fidio yago fun iwulo awọn orisii ọrọ-fidio ti a samisi?
Ṣe-A-Video ṣe ipinnu iṣoro naa: awoṣe ọrọ-si-aworan kọ ẹkọ kini awọn nkan ṣe dabi lati awọn aworan ifori, lakoko ti awọn fẹlẹfẹlẹ igba otutu lọtọ kọ ẹkọ išipopada lati aise, fidio ti ko ni aami.
Bawo ni Ṣe-A-Fidio ṣe ṣafikun agbara išipopada si awoṣe aworan kan?
O fa awọn iyipada aaye 2D ati akiyesi pẹlu awọn ipele igba diẹ ti o kọ ẹkọ bii akoonu ṣe yipada lori akoko.
Kí ni fireemu-interpolation ati Super-o ga awọn ipele ṣe?
Lẹhin isunmọ kekere-res, iwọn kekere-fireemu yiyan, interpolation ṣe afikun awọn fireemu ati awọn modulu ipinnu-suga gbe ipinnu naa ga.
Kini aropin aṣoju ti iṣelọpọ Ṣe-A-Fidio?
Awọn agekuru jẹ iṣẹju-aaya diẹ, ipinnu kekere jo, ati itara si flicker igba diẹ ati ipalọlọ.
Besides text prompts, what visual input can Make-A-Video use to create a video?
Meta said Make-A-Video can create videos from images as well as text prompts.
Tesiwaju kikọ
Jẹmọ awọn itọsọna
Awọn itọsọna diẹ sii ti a yan fun koko yii