Defar-A-Wideo Bind-ci-Wideo
Defar-A-Wideo mooy sistemu 2022 bu Meta biy soppi benn mbind mu nekk benn wideo bu gàtt te doo musa tàggat ci ñaari mbind-wideo yuñ etikete.
Résumé
It matters because it showed that the visual knowledge inside text-to-image models could be 'taught' to move using only unlabeled video.
Plongeur bu xóot
Defar-A-Widewo, bi Meta AI siiwal ci Setammbur 2022, defay defar ay segond yu néew ci benn widewo ci benn wax bu mel ni 'xaj bu sol benn kap buy naaw ci asamaan.' Li gëna am solo mooy dindi melokaan ci yëngu: xeetu bind-ci-nataal (bu ñu tabax ci kaw espace bind-nataal buñ boole CLIP) dafay jàng ni mbir yi di nuru ci ay miliyaar ciy nataal yuñ bind, ci noonu layers spatiotemporal yu wuute di jàngee ni mbir yi di doxee ci wideo bu amul etiketu kese. Loolu mooy moytu ñàkkum mbind ak wideo yu baax. Modèle de base bi dafay defar ay clip yu am resolusioŋ bu woyof, yu am taxawaayu kadre bu woyof, ginaaw ga reso yiñ jagleel dañuy interpole yeneen kadre ak dayo spatial bu yéeg. Resultaa bi méngoo na bu baax ak jamonoom, waaye clip yi dañu gàtt, dañu fësul, te dañuy gaawa flicker ak warping.
Gis-gis xarala
Defar-A-Wideo dafay yokk nataal 2D ak bàyyi xel ci 3D ci yokk ay lalu pseudo-temporal. Poid spatial yiñ njëkka tàggat dañuy gelé wala ñu defar leen bu baax, ci noonu layers temporal yu bees yi di jàng yëngu ci wideo bu ñor, kon soxla wuñu etiketu wideo-tekst. Reseau interpolation-cadre dafay gëna dëgëral kalendriye bi, module diffusion yu am resolusioŋ bu rëy dañuy yokk ay detay ci barab bi, mu soppi ab 16-cadre bu dëgër, resolution bu woyof, mu nekk clip bu gëna nooy, gëna ñaw ci biir benn pipeline cascade.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Defar Wideo Bindu-Ci-Wideo
Reset bu Make-A-Video bu nataal-balaa-ak-yëngu-bu-amul etiketu moo jiite vague text-to-video bi yépp. Doomam yi dañuy fësal clip yu gëna gudd, dayo bu gëna kawe, di yàgg, ak mouvement ak audio buñ mëna saytu ci kamera bi. Xaarandil xalaat bu am solo bi, jëfandikoowaat xam-xam nataal bu bari ak jàng yëngu bu yomb, ngir wéy doonte architectures yi dañuy toxu ci diffusion latent bu sukkandiko ci transformateur ak model yuñ boole muy nangu itam nataal wala wideo conditionnement ngir soppali ak wéyal.
Doxal ci àdduna dëgg
Animasioŋ benn frase tegtal ci benn clip bu gàtt ngir publie ci reso sosio
Inndi ab konsept bu fippu bu mel ni 'ursu peluche buy defar nataal' ci dundu ni ap misaal buy yëngu
Def interpolation ci digganté ñaari nataal yu jëfandikukat bi joxe ngir sos wideo bu jaar yoon
Defar ay brochure yu gaaw ci ay seen yuñ xalaat ngir storyboard laataa ñuy filme
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Make-A-Video Text-to-Video quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Sora ak Bind-ci-Wideo
Laaj yi ñuy faral di laaj
What is Make-A-Video Text-to-Video?
Defar-A-Wideo mooy sistemu 2022 bu Meta biy soppi benn mbind mu nekk benn wideo bu gàtt te doo musa tàggat ci ñaari mbind-wideo yuñ etikete. Dafa am solo ndax dafa wane ni xam-xam bi ñuy gis ci biir xeetu bind-ci-nataal mën nañu ko 'jàngale' toxu ci jëfandikoo wideo bu amul etiket.
Lan mooy jéego yu am solo yi tax Make-A-Video moytu soxla ñaari mbind ak wideo yuñ etikete?
Make-A-Video dafay dindi jafe-jafe bi: xeetu bind-ci-nataal dafay jàng ni mbir yi di nuru ci nataal yiñ bind, ci noonu layer temporal yu wuute yi jàng yëngu ci wideo bu ñor te amul etiket.
naka lay def ba Make-A-Video yokk kàttan yëngu ci modelu nataal?
Dafay yaatal convolution spatial 2D ak bàyyi xel ci ay couche temporale yu bees yuy jàng ni ëmbiit li di soppeekoo ci diir bi.
Lan la interpolaasioŋ kaadar bi ak dayo bu mag bi di def?
Ginaaw ab bordure bu am resolusioŋ bu woyof, ak taxawaayu kaadar bu woyof, interpolaasioŋ dafay yokk kaadar yi, module yu am resolusioŋ bu mag dañuy yokk resolusioŋ bi.
Lan moo nekkoon ay jafe-jafe ci génnug Make-A-Video?
Clip yi ay segond yu néew rek lañu amoon, seen dayo daa tuuti, te dañuy faral di flicker ak distorsion ci diir bu gàtt.