CogWideo ak CogWideoX
CogVideo (2022) mooy xeetu bind-ci-wideo bi njëkka ubbeeku ci escale bu yaatu, ba noppi CogVideoX (2024) mooy xeetu xët wi gëna am kàttan bu bawoo ci Tsinghua/Zhipu AI.
Résumé
They matter because they put high-quality video generation into the hands of the open community, not just big corporate labs.
Plongeur bu xóot
CogVideo, bi ñu génne ci 2022, dafa tabax ci kaw CogView2 transformatëru bind-ci-nataal ba noppi jëfandikoo xeetu kadre yu bari, xeetu autoregressive ngir defar ay clip yu gàtt, nekk xeetu bind-ci-wideo bu mag biñ njëkka génne ci lu ubbeeku, di jàppale Chinois ak Angale. Ki koy wuutu ci 2024, CogVideoX, jëmmal bu mat sëkk la: dafay jëfandikoo autoencoder 3D ngir kompresse wideo ci espace ak temps, ginaaw ga Transformer Expert ak mébetu diffusion buy boole ay mbind ak ay token wideo yuñ boole. Modèle CogVideoX (ci dayo yu melni 2B ak 5B parametre) defar ay segond yu bari yu lëkkaloo, wideo yu am yëngu bu kawe ci dayo yu melni 720x480 ak jàppale nataal-ci-wideo ak wéyal wideo. Lu gëna am solo mooy, poid yi ak kode yi dañuy nekk ci mbooloo mi, di dundal vague de fine-tunes, jumtukaay ak gëstu ci askan wi.
Gis-gis xarala
VAE 3D bu CogVideoX dafay wàññi wideo bu ñor bi ci volume bu nëbbu bu dëgër, dagg limu token yi suko defee transformateur bi mëna modele ay toppalante yu gudd ci njëg yu yomb. Transformer Expert dafay jëfandikoo norm couche adaptive ba noppi boole mbind ak jetons visuel suko defee ñaari modalite yi di toppatoo seen biir directement, gëna baaxal njubluwaay mbind-wideo. Tàggat yaram buy yokk resolusioŋ yi ak guddaay yi, boole ci bind ay done yu jaar yoon, dafay jur yëngu bu gëna neex, gëna dëggu ci wàllu semantik.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
CogVideo ak CogVideoX
CogVideoX, muy benn ci model wideo yu ubbeeku yi gëna am doole, dafay ancre ecosystem buy gaawa màgg ci ay fine-tune, adaptatëru seytu, ak ay extension yu gëna gudd. Xaarandil yokkute yu wéy ci guddaayu clip bi, dayo bi, realisme mouvement bi, ak ni ñu ko mëna doxalee, boole ci boole nataal ak wideo ak soppali liggéey bi. Diisaayam yu ubbeeku yi dañuy tekki ni mbootaay yi amul benn njariñ, gëstukat yi, ak studio yu ndaw yi mën nañu tabax ci kaw wideo frontier-class te duñu am benn buntu, gaawlu gëstub sos ak kaaraange.
Doxal ci àdduna dëgg
Defar ab clip narratif bu gàtt ci benn prompt ci làkku chinois wala anglais di jëfandikoo ay poid yu ubbeeku
Soppi benn nataal buñ yebbi mu nekk wideo buy toxu jaaraleko ci CogVideoX nataal-ci-wideo
Defar bu baax modelu ubbeeku bi ci stil wala personage buñ personaaliseer ngir animation indie
Gëstukat yi dañuy méngale pexe yu bees yi ñuy defaree wideo ak baseline buñ mëna defaraat
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the CogVideo and CogVideoX quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Teg Pix2Pix Tegtal Soppi
Laaj yi ñuy faral di laaj
What is CogVideo and CogVideoX?
CogVideo (2022) mooy xeetu bind-ci-wideo bi njëkka ubbeeku ci escale bu yaatu, ba noppi CogVideoX (2024) mooy xeetu xët wi gëna am kàttan bu bawoo ci Tsinghua/Zhipu AI. Dañu am solo ndax dañu def wideo yu baax yi ci loxo askan wi, du ci loxo liggéeyukaay yu mag yi kese.
Lan moo gëna am solo ci génnug CogVideo ci 2022?
CogVideo mooy xeetu bind-à-wideo bi njëkka génn ci anam wu yaatu, di jàppale laaj yi ci làkku chinois ak àngle yépp.
Lan la VAE 3D bu CogVideoX def?
VAE 3D biy waral wideo bi dafay tënk wideo ci dimension spatial ak temporel yépp, wàññi limu token yi suko defee transformateur bi mëna ko modele bu baax.
naka lay def ba mëna jëfandikoo mbind ak wideo ci CogVideoX?
Expert Transformer dafay boole mbind ak token yuñy gis boole ci normalisasioŋ buy méngoo, gëna suqali yoon wi ci digganté wideo bi gaaw ak wideo biñ defar.
Ban kuréel moo defar CogVideo ak CogVideoX?
Famillu CogVideo mingi cosaanoo ci gëstukat yu bokk ci Daara bu kawe bu Tsinghua ak Zhipu AI.
Lu weesu bind-ci-wideo, ban yeneen mën-mën la CogVideoX jàppale?
CogVideoX mën na animer ab nataal bu taxaw (nataal-ci-wideo) ak yokk clips yi fi nekk (weyal), lu weesu li ñuy laaj ci bind.