I-CogVideo ne-CogVideoX
I-CogVideo (2022) yayiyimodeli yokuqala enkulu evulekile yombhalo-kuya-vidiyo, futhi i-CogVideoX (2024) ingumlandeli wayo ovuleleke kakhulu okwazi ukuvela eTsinghua/Zhipu AI.
Uhlolojikelele
They matter because they put high-quality video generation into the hands of the open community, not just big corporate labs.
I-Deep Dive
I-CogVideo, eyakhishwa ngo-2022, yakhelwe phezu kwe-CogView2 text-to-image transformer futhi yasebenzisa indlela enezinhlaka eziningi, indlela ezenzakalelayo ukuze ikhiqize iziqeshana ezimfushane, ibe imodeli yokuqala enkulu ekhishwa ngokusobala yokuthumela umbhalo-kuya-vidiyo futhi esekela imiyalo yesiShayina nesiNgisi. Umlandeli wayo wango-2024, i-CogVideoX, iklanywe kabusha ngokuphelele: isebenzisa i-3D causal variational autoencoder ukuze iminyanise ividiyo endaweni nesikhathi, bese kuba I-Expert Transformer enenjongo yokusabalalisa ethamela ngokuhlanganyela phezu kombhalo namathokheni wevidiyo ahlanganiswe ndawonye. Amamodeli e-CogVideoX (ngosayizi ofana namapharamitha angu-2B kanye no-5B) akhiqiza imizuzwana embalwa yevidiyo ehambisanayo, enyakazayo ngezinqumo ezinjengo-720x480 futhi isekela isithombe ukuya kuvidiyo nokuqhubeka kwevidiyo. Okubi kakhulu, izisindo nekhodi kusesidlangalaleni, okubhebhezela igagasi lamaculo amahle omphakathi, amathuluzi, nocwaningo.
I-Technical Insight
I-CogVideoX's 3D causal VAE incipha ividiyo eluhlaza ibe yivolumu efihlekile ehlangene, inciphise inani lamathokheni ukuze isiguquli sikwazi ukumodela ukulandelana okude ngendlela ethengekayo. I-Expert Transformer isebenzisa inkambiso yesendlalelo esiguquguqukayo futhi ihlanganisa umbhalo namathokheni abonakalayo ukuze lezi zindlela ezimbili zibhekane ngqo, zithuthukise ukuqondana kombhalo nevidiyo. Ukuqeqeshwa okuqhubekayo ekukhuliseni izinqumo nobude besikhathi, kanye namagama-ncazo wedatha acophelelayo, kuletha ukunyakaza okushelelayo, okuthembekile ngokwezibalo.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa le-CogVideo ne-CogVideoX
Njengenye yamamodeli evidiyo anamandla avulekile, i-CogVideoX isekela i-ecosystem ekhula ngokushesha yamashuni amahle, ama-adaptha okulawula, nezandiso zesikhathi eside. Lindela izinzuzo eziqhubekayo ngobude besiqeshana, ukulungiswa, ukuba ngokoqobo kokunyakaza, nokulawulwa, kanye nokuhlanganiswa okuqinile nesithombe-kuya-kuvidiyo nokugeleza komsebenzi wokuhlela. Izisindo zayo ezivulekile zisho izinhlangano ezingenzi nzuzo, abacwaningi, nezitudiyo ezincane zingakha esizukulwaneni sevidiyo sesigaba esisemngceleni ngaphandle kokugcinwa kwesango lokuphathelene, kusheshiswe kokubili ukuhlola kokudala nokugxile ekuphepheni.
Ukuqaliswa Komhlaba Wangempela
Ikhiqiza isiqeshana esilandisayo esifushane kusuka kumyalo wesiShayina noma wesiNgisi kusetshenziswa izisindo ezivuleke ngokugcwele
Ukuguqula isithombe esisodwa esimile esilayishiwe sibe yividiyo ehambayo ngesithombe se-CogVideoX siye kuvidiyo
Ukulungisa kahle imodeli evuliwe kusitayela sangokwezifiso noma uhlamvu lokugqwayiza kwe-indie
Abacwaningi baqhathanisa izindlela ezintsha zokukhiqiza ividiyo ngokumelene nesisekelo esivulelekayo esiphindayo
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the CogVideo and CogVideoX quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukuhlelwa Kwemiyalo ye-InstructPix2Pix
Imibuzo evame ukubuzwa
What is CogVideo and CogVideoX?
I-CogVideo (2022) yayiyimodeli yokuqala enkulu evulekile yombhalo-kuya-vidiyo, futhi i-CogVideoX (2024) ingumlandeli wayo ovuleleke kakhulu okwazi ukuvela eTsinghua/Zhipu AI. Babalulekile ngoba babeka ukukhiqizwa kwevidiyo yekhwalithi ephezulu ezandleni zomphakathi ovulekile, hhayi nje amalebhu amakhulu ezinkampani.
Yini ephawulekayo ngokukhishwa kwe-CogVideo's 2022?
I-CogVideo yaba imodeli yokuqala enkulu yombhalo-kuya-vidiyo ekhishwe ngokusobala, isekela imiyalo yesiShayina nesiNgisi.
Yini efezwa yi-CogVideoX's 3D causal VAE?
I-3D causal VAE icindezela ividiyo kubo bobabili ubukhulu bendawo neyesikhashana, inciphisa ukubalwa kwamathokheni ukuze isiguquli sikwazi ukuyimodela kahle.
Ngabe i-Expert Transformer ku-CogVideoX iwuphatha kanjani umbhalo nevidiyo?
I-Expert Transformer ihlanganisa umbhalo kanye namathokheni abonakalayo kanye nokujwayela okuguquguqukayo, ukuthuthukisa ukuqondana phakathi kwevidiyo esheshayo nekhiqiziwe.
Iliphi iqembu elithuthukise i-CogVideo ne-CogVideoX?
Umndeni we-CogVideo uvela kubacwaningi abahlobene ne-Tsinghua University kanye ne-Zhipu AI.
Ngaphandle kombhalo kuya kuvidiyo, yimaphi amandla angeziwe asekelwa yi-CogVideoX?
I-CogVideoX ingagqwayiza isithombe esinganyakazi (isithombe-kuya-ividiyo) futhi inwebe iziqeshana ezikhona (ukuqhubeka), ngale kweziyalezo zombhalo ongenalutho.