GUIDE IA visuel

Defar-A-Wideo Bind-ci-Wideo

Defar-A-Wideo mooy sistemu 2022 bu Meta biy soppi benn mbind mu nekk benn wideo bu gàtt te doo musa tàggat ci ñaari mbind-wideo yuñ etikete.

Déglul tegtal biiIA-nettali · ~2 min

Ci xët wii2 simili jàng
  1. Résumé
  2. Plongeur bu xóot
  3. Doxal ci àdduna dëgg
  4. Ëlëgu Defar Wideo Bindu-Ci-Wideo
  5. Teg ko ci jëf
  6. Weyal di banneexu
  7. Laaj yi ñuy faral di laaj

Résumé

It matters because it showed that the visual knowledge inside text-to-image models could be 'taught' to move using only unlabeled video.

Plongeur bu xóot

Make-A-Video, announced by Meta AI in September 2022, generates brief video clips from text prompts. Its key trick is decoupling appearance from motion: a text-to-image model learns what things look like from paired text-image data, while separate spatiotemporal layers learn how they move from video footage with no associated text. Meta said this reduced the need for paired text-video examples and that the research used publicly available datasets. Meta also described making videos from images and creating new videos similar to existing videos. The base model produces low-resolution, low-frame-rate clips, then dedicated networks interpolate extra frames and upscale spatial resolution. The result was strikingly coherent for its era, though clips were short, blurry, and prone to flicker and warping.

Doxal ci àdduna dëgg

Animasioŋ benn frase tegtal ci benn clip bu gàtt ngir publie ci reso sosio

Inndi ab konsept bu fippu bu mel ni 'ursu peluche buy defar nataal' ci dundu ni ap misaal buy yëngu

Def interpolation ci digganté ñaari nataal yu jëfandikukat bi joxe ngir sos wideo bu jaar yoon

Defar ay brochure yu gaaw ci ay seen yuñ xalaat ngir storyboard laataa ñuy filme

Ëlëgu Defar Wideo Bindu-Ci-Wideo

Reset bu Make-A-Video bu nataal-balaa-ak-yëngu-bu-amul etiketu moo jiite vague text-to-video bi yépp. Doomam yi dañuy fësal clip yu gëna gudd, dayo bu gëna kawe, di yàgg, ak mouvement ak audio buñ mëna saytu ci kamera bi. Xaarandil xalaat bu am solo bi, jëfandikoowaat xam-xam nataal bu bari ak jàng yëngu bu yomb, ngir wéy doonte architectures yi dañuy toxu ci diffusion latent bu sukkandiko ci transformateur ak model yuñ boole muy nangu itam nataal wala wideo conditionnement ngir soppali ak wéyal.

Teg ko ci jëf

Lu tax mu am solo

  • Gaawaay ak yaatuwaay. Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
  • Tabax tànneef. Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
  • Ekip ak def liggéey. Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.

Moytul

  • Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
  • Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
  • Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.

Jéego yi ci topp

  1. Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
  2. Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
  3. Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
  4. Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.

Weyal di banneexu

Bulletin bu amul fayda

Jàngal xibaar AI bu bes

Ñatti jaar-jaari IA yuñ firndeel bis bu nekk ci ayu-bis bi, ñu bind leen ci Àngle bu leer. Gratis ba fàww, amul yëgle.

Benn email bis bu nekk ci ayu-bis bi. Benn klik nga dindi abonemaa bi. Dunu musa jaay wala séddoo sa adres.

Nattal sa bopp

Take the Make-A-Video Text-to-Video quiz

Feedback ci saasi ci bépp tontu, ak sertifikaa buñ mëna séddoo ak ID buñ mëna saytu soo jàllee ci njàng mi.

Tambalil quiz

Jàppale njàngum IA te doo fay. AI Understanding mbootaay la buy def te Yàlla tax — amul yëgle, amul paywall, musul am. Defal ab sarax

Laaj yi ñuy faral di laaj

What is Make-A-Video Text-to-Video?

Defar-A-Wideo mooy sistemu 2022 bu Meta biy soppi benn mbind mu nekk benn wideo bu gàtt te doo musa tàggat ci ñaari mbind-wideo yuñ etikete. Dafa am solo ndax dafa wane ni xam-xam bi ñuy gis ci biir xeetu bind-ci-nataal mën nañu ko 'jàngale' toxu ci jëfandikoo wideo bu amul etiket.

Lan mooy jéego yu am solo yi tax Make-A-Video moytu soxla ñaari mbind ak wideo yuñ etikete?

Make-A-Video dafay dindi jafe-jafe bi: xeetu bind-ci-nataal dafay jàng ni mbir yi di nuru ci nataal yiñ bind, ci noonu layer temporal yu wuute yi jàng yëngu ci wideo bu ñor te amul etiket.

naka lay def ba Make-A-Video yokk kàttan yëngu ci modelu nataal?

Dafay yaatal convolution spatial 2D ak bàyyi xel ci ay couche temporale yu bees yuy jàng ni ëmbiit li di soppeekoo ci diir bi.

Lan la interpolaasioŋ kaadar bi ak dayo bu mag bi di def?

Ginaaw ab bordure bu am resolusioŋ bu woyof, ak taxawaayu kaadar bu woyof, interpolaasioŋ dafay yokk kaadar yi, module yu am resolusioŋ bu mag dañuy yokk resolusioŋ bi.

Lan moo nekkoon ay jafe-jafe ci génnug Make-A-Video?

Clip yi ay segond yu néew rek lañu amoon, seen dayo daa tuuti, te dañuy faral di flicker ak distorsion ci diir bu gàtt.

Besides text prompts, what visual input can Make-A-Video use to create a video?

Meta said Make-A-Video can create videos from images as well as text prompts.