Cascades Wideo Imagen
Wideo Imagen mooy sistem bind-ci-wideo bu 2022 bi AIU_PROTECTED_11_ di tabax clip ci juróom ñaari xeeti diffusion, bu nekk di yokk yeneen kadre wala dayo bu gëna bari.
Résumé
It matters because it showed how stacking specialized stages can produce high-definition, temporally smooth video from a single prompt.
Plongeur bu xóot
Wideo Imagen, bi Gëstub Google dugal ci weeru oktoobar 2022, dafay yaatal gis-gis Imagen bind-ci-nataal ci yëngu. Encodeur text T5 bu liw dafay soppi prompt bi ci embeddings làkk yu am solo yuy indi bépp etap. Benn xeetu diffusion bu njëkk dafay njëkka defar benn wideo bu ndaw, bu am taxawaayu kadre bu woyof, ginaaw ga benn cascade bu yeneen 6 model diffusion ñuy wuutale defar dayo bu mag ci diir bu gàtt (yokk kadre ci diggante yi fi nekk) ak dayo bu mag ci barab (yokkum dayo pixel). Pipeline bi yépp dafay génne lu tollu ci 1280x768 wideo ci 24 kadre ci segond bu nekk, ay segond yu bari ci guddaay. Ndax xam-xam làkk bu xóot bi mingi dundu ci encodeur bi, Imagen Video mën na joxe bind bu leer, estetik artistik bu bari, ak yëngu-yëngu 3D-xam, di wane ni staging bu jaar yoon mooy jéema def lépp ci benn model bu mag.
Gis-gis xarala
Cascade bi dafa xaaj benn jikko bu jafe lool ci ay jafe-jafe yu ndaw yuñ mëna saafara. Juróom ñaari xeeti diffusion dañuy toppalante: benn generatëru base boole ci ñatti xeeti resolusioŋ yu mag ci wàllu barab ak ñatti xeeti jamono. Ku nekk ci ñoom mingi aju ci embedding bu gaaw bi ak ci génnug etap bi njëkk. Pexe yu melni parametrisasioŋ v-prédiction ak distilaasioŋ buy yokk dañuy gaawal jël misaal, ci noonu la tegtal bu amul klassifikatër di gëna dooleel topp gi ci bepp etap ci chain bi.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Cascades Wideo Imagen
Pipeline pixel-space cascade firndeel nañu xalaat bi waaye dañu diis ci xayma te dañu yeex. Doxalin bi dafa toxu bu bari ci diffusion bu nëbbu ak yaxu ndigg transformateur yiy defar ci barab bu kompresse, wàññi njëg yi boole ci baña yàq kalite bi. Ba leegi, njàngale Imagen Wideo, tàqale liggéey yi 'lan,' 'ni muy doxee,' ak 'nimu ñaw,' wéy di joxe leeral ci jëmmal yu bari ak jëmmal, ak stil T5-conditioning bi dafa influensé ci ginaaw ga, generatër yu gëm bind.
Doxal ci àdduna dëgg
Defar ab clip bu leer bu baax ak ay mbind yu leer te leer ci kaw ekraŋ bi ci benn laaj
Rendering benn seen bi ñu leeral ci xeeti art yu bari, dalee ko ci aquarelle ba ci claymation
Defar ay animaasioŋ yu gàtt yu xam 3D lu ci melni yatteef buy wëréelu, di yëngu
Defar ay clip marketing wala konsept yu neex ci 24fps ci ay leeral yuñ bind
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Imagen Video Cascades quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Sora ak Bind-ci-Wideo
Laaj yi ñuy faral di laaj
What is Imagen Video Cascades?
Wideo Imagen mooy sistem bind-ci-wideo bu 2022 bi AIU_PROTECTED_11_ di tabax clip ci juróom ñaari xeeti diffusion, bu nekk di yokk yeneen kadre wala dayo bu gëna bari. Dafa am solo ndax dafa wane ni dajale ay etape yuñ jagleel mën nañu defar wideo bu leer te neex ci diir bu gàtt ci benn laaj.
Ñaata xeetu diffusion ñoo bokk ci wideo Imagen?
Imagen Wideo dafay jëfandikoo juróom ñaari xeeti diffusion: benn generatëru base boole ci ñetti xeeti resolusioŋ yu mag ci barab ak ñetti ci jamono.
Lan la etape super-resolution temporel di def ci cascade bi?
Dayo bu mag bi ci diir bi dafay yokk yeneen kadre ngir yokk viteesu kadre bi, waaye dayo bu mag bi ci barab bi dafay yokk dayo pixel bi.
Ban lëf mooy kode bind bi ci wideo Imagen?
Wideo Imagen, melni Imagen, dafay jëfandikoo encodeur bind T5 bu rëy ngir defar ay embeddment yuy indi bepp etape diffusion.
Lan moo tax ñuy xaaj jamono ci benn cascade moo gën benn model bu mag?
Etap bu nekk dafay saafara liggéey bu gëna ndaw, defar ab bordure bu dëgër, yokk kadre, wala yokk dayo, loolu moo gëna yomba def lépp benn yoon.
Ban kàttan la Imagen Video wane bu baax?
Imagen Video mën na joxe mbind yu neex lire ak xeeti art yu bari te wuute, ndax xam-xam bu dëgër bimu am ci bind T5.