Izithombe ze-Cascades ze-Imagen
Ividiyo ye-Imagen iyisistimu ka-Google ka-2022 yokuthumela umbhalo kuye kuvidiyo eyakha isiqeshana ngenqwaba yamamodeli ayisikhombisa okusabalalisa, ngalinye lingeza ozimele abaningi noma ukulungiswa okuningi.
Uhlolojikelele
It matters because it showed how stacking specialized stages can produce high-definition, temporally smooth video from a single prompt.
I-Deep Dive
Ividiyo ye-Imagen, eyethulwe ngu-Google Ucwaningo ngo-Okthoba 2022, lunweba indlela ye-Imagen yokuguqula umbhalo uye esithombeni ekunyakazeni. Isishumeki esiqandisiwe sombhalo we-T5 siphendula ukwaziswa kube ukushumeka kolimi okunothile okubeka isimo ngasinye. Imodeli yokusabalalisa isisekelo iqala ikhiqize ividiyo encane, enesilinganiso esiphansi, bese i-cascade yamamodeli ayisithupha e-diffusion ishintshana yenze ukulungiswa okuphezulu kwesikhashana (kwengeza ozimele phakathi kwalaba abakhona) kanye nokulungiswa okuphezulu kwendawo (ukukhula kwephikseli kokulungiswa). Ipayipi eligcwele eliphumayo licishe libe yividiyo engu-1280x768 kumafreyimu angu-24 ngomzuzwana, amasekhondi ambalwa ubude. Ngenxa yokuthi ukuqonda okujulile kolimi kuhlala kusishumeki sombhalo, Ividiyo ye-Imagen inganikeza umbhalo onesitayela ofundekayo, ubuhle bobuciko obuhlukahlukene, nokunyakaza kwento eqaphela i-3D, okubonisa ukuthi amabhithi esiteji acophelelayo azama ukwenza yonke into ngemodeli eyodwa enkulu.
I-Technical Insight
I-cascade ihlukanisa isizukulwane esinzima kakhulu sibe yizinkinga ezincane ezilawulekayo. Amamodeli okusabalalisa ayisikhombisa agijima ngokulandelana: i-base generator eyodwa kanye namamodeli amathathu esikhashana kanye namamodeli amathathu esikhashana angcono kakhulu. Ngayinye ibekwe esimweni sokushumeka ngokushesha kanye nokuphumayo kwesigaba sangaphambilini. Amasu afana ne-v-prediction parameterization kanye ne-progressive distillation kuyasheshisa ukusampula, kuyilapho isiqondiso samahhala se-classifier siqinisa ukubambelela ngokushesha kuzo zonke izigaba zeketango.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa le-Imagen Video Cascades
Amapayipi esikhaleni se-pixel e-Cascaded afakazele lo mqondo kodwa anzima futhi ayanensa. Inkambu ishintshele kakhulu ekuhlukaniseni okucashile kanye ne-transformer backbones ekhiqiza endaweni ecindezelweyo, inciphisa izindleko ngenkathi igcina ikhwalithi. Noma kunjalo, isifundo se-Imagen Video, sihlukanisa imisebenzi yokuthi 'yini,' 'ihamba kanjani,' kanye 'nokuthi ibukhali kangakanani,' iyaqhubeka nokwazisa imiklamo yezigaba eziningi kanye nokucwengwa, futhi isitayela sayo se-T5-conditioning saba nomthelela kamuva, ukuthembeka okuphezulu, amajeneretha athembekile ombhalo.
Ukuqaliswa Komhlaba Wangempela
Ikhiqiza isiqeshana esinencazelo ephezulu enombhalo osesikrinini obhalwe isitayela ofundekayo kusukela ekwazisweni
Inikeza isigcawu esifanayo esichazwe ngezitayela eziningi zobuciko, ukusuka kumbala we-watercolor ukuya ekubumbaneni
Ikhiqiza opopayi bezinto ezimfishane eziqaphela i-3D njengesifanekiso esijikelezayo, esinyakazayo
Ukudala ukumaketha okubushelelezi kwe-24fps noma iziqeshana zomqondo ngokuqondile kusuka encazelweni ebhaliwe
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Imagen Video Cascades quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Sora kanye nokuguqula umbhalo ube yividiyo
Imibuzo evame ukubuzwa
What is Imagen Video Cascades?
Ividiyo ye-Imagen iyisistimu ka-Google ka-2022 yokuthumela umbhalo kuye kuvidiyo eyakha isiqeshana ngenqwaba yamamodeli ayisikhombisa okusabalalisa, ngalinye lingeza ozimele abaningi noma ukulungiswa okuningi. Kubalulekile ngoba kubonise ukuthi ukunqwabelanisa izigaba ezikhethekile kungakhiqiza kanjani ukucaca okuphezulu, ividiyo eshelelayo yesikhashana kusuka ekwazisweni okukodwa.
Mangaki amamodeli okusabalalisa akha i-Imagen Video cascade?
Ividiyo ye-Imagen isebenzisa amamodeli wokusabalalisa ayisikhombisa: i-base generator eyodwa kanye namamodeli amathathu esikhashana namathathu anokulungiswa okuphezulu kwesikhashana.
Senzani isigaba sesikhashana sokulungiswa okuphezulu ku-cascade?
Ukulungiswa okuphezulu kwesikhashana kuhlobanisa ozimele abengeziwe ukuze bakhuphule izinga lozimele, kuyilapho ukulungiswa okuphezulu kwendawo kuphakamisa ukucaca kwephikseli.
Iyiphi ingxenye efaka ukwaziswa kombhalo ku-Imagen Video?
Ividiyo ye-Imagen, njenge-Imagen, isebenzisa isishumeki sombhalo esikhulu esiqandisiwe se-T5 ukukhiqiza ukushumeka okubeka isimo kuzo zonke izigaba zokusabalalisa.
Kungani uhlukanise isizukulwane sibe yi-cascade esikhundleni semodeli eyodwa enkulu?
Isigaba ngasinye sixazulula umsebenzi omncane, ukukhiqiza okusalungiswa okumahhadla, ukungeza amafreyimu, noma ukwengeza ukulungiswa, okuthandeka kakhulu kunokwenza yonke into ngesikhathi esisodwa.
Iliphi ikhono elavezwa yi-Imagen Video ngokuphawulekayo?
Ngenxa yokuqonda kwayo okuqinile kombhalo we-T5, Ividiyo ye-Imagen inganikeza umbhalo onesitayela ofundekayo kanye nezinhlobonhlobo zobuhle bobuciko.