I-VISual AI GUIDE

Izithombe ze-Cascades ze-Imagen

Ividiyo ye-Imagen iyisistimu ka-Google ka-2022 yokuthumela umbhalo kuye kuvidiyo eyakha isiqeshana ngenqwaba yamamodeli ayisikhombisa okusabalalisa, ngalinye lingeza ozimele abaningi noma ukulungiswa okuningi.

Uhlolojikelele

Ividiyo ye-Imagen iyisistimu ka-Google ka-2022 yokuthumela umbhalo kuye kuvidiyo eyakha isiqeshana ngenqwaba yamamodeli ayisikhombisa okusabalalisa, ngalinye lingeza ozimele abaningi noma ukulungiswa okuningi. Kubalulekile ngoba kubonise ukuthi ukunqwabelanisa izigaba ezikhethekile kungakhiqiza kanjani ukucaca okuphezulu, ividiyo eshelelayo yesikhashana kusuka ekwazisweni okukodwa.

I-Imagen Video Cascades ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.

I-Deep Dive

Ividiyo ye-Imagen, eyethulwe ngu-Google Ucwaningo ngo-Okthoba 2022, lunweba indlela ye-Imagen yokuguqula umbhalo uye esithombeni ekunyakazeni. Isishumeki esiqandisiwe sombhalo we-T5 siphendula ukwaziswa kube ukushumeka kolimi okunothile okubeka isimo ngasinye. Imodeli yokusabalalisa isisekelo iqala ikhiqize ividiyo encane, enesilinganiso esiphansi, bese i-cascade yamamodeli ayisithupha e-diffusion ishintshana yenze ukulungiswa okuphezulu kwesikhashana (kwengeza ozimele phakathi kwalaba abakhona) kanye nokulungiswa okuphezulu kwendawo (ukukhula kwephikseli kokulungiswa). Ipayipi eligcwele eliphumayo licishe libe yividiyo engu-1280x768 kumafreyimu angu-24 ngomzuzwana, amasekhondi ambalwa ubude. Ngenxa yokuthi ukuqonda okujulile kolimi kuhlala kusishumeki sombhalo, Ividiyo ye-Imagen inganikeza umbhalo onesitayela ofundekayo, ubuhle bobuciko obuhlukahlukene, nokunyakaza kwento eqaphela i-3D, okubonisa ukuthi amabhithi esiteji acophelelayo azama ukwenza yonke into ngemodeli eyodwa enkulu.

I-Technical Insight

I-cascade ihlukanisa isizukulwane esinzima kakhulu sibe yizinkinga ezincane ezilawulekayo. Amamodeli okusabalalisa ayisikhombisa agijima ngokulandelana: i-base generator eyodwa kanye namamodeli amathathu esikhashana kanye namamodeli amathathu esikhashana angcono kakhulu. Ngayinye ibekwe esimweni sokushumeka ngokushesha kanye nokuphumayo kwesigaba sangaphambilini. Amasu afana ne-v-prediction parameterization kanye ne-progressive distillation kuyasheshisa ukusampula, kuyilapho isiqondiso samahhala se-classifier siqinisa ukubambelela ngokushesha kuzo zonke izigaba zeketango.

I-Mastering Imagen Video Cascades

Ividiyo ye-Imagen iyisistimu ka-Google ka-2022 yokuthumela umbhalo kuye kuvidiyo eyakha isiqeshana ngenqwaba yamamodeli ayisikhombisa okusabalalisa, ngalinye lingeza ozimele abaningi noma ukulungiswa okuningi. Kubalulekile ngoba kubonise ukuthi ukunqwabelanisa izigaba ezikhethekile kungakhiqiza kanjani ukucaca okuphezulu, ividiyo eshelelayo yesikhashana kusuka ekwazisweni okukodwa. I-Imagen Video Cascades ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-Imagen Video Cascades njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa ibhalansi ye-Imagen Video Cascades namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.

Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.

Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa le-Imagen Video Cascades

Amapayipi esikhaleni se-pixel e-Cascaded afakazele lo mqondo kodwa anzima futhi ayanensa. Inkambu ishintshele kakhulu ekuhlukaniseni okucashile kanye ne-transformer backbones ekhiqiza endaweni ecindezelweyo, inciphisa izindleko ngenkathi igcina ikhwalithi. Noma kunjalo, isifundo se-Imagen Video, sihlukanisa imisebenzi yokuthi 'yini,' 'ihamba kanjani,' kanye 'nokuthi ibukhali kangakanani,' iyaqhubeka nokwazisa imiklamo yezigaba eziningi kanye nokucwengwa, futhi isitayela sayo se-T5-conditioning saba nomthelela kamuva, ukuthembeka okuphezulu, amajeneretha athembekile ombhalo.

Ukuqaliswa Komhlaba Wangempela

Ikhiqiza isiqeshana esinencazelo ephezulu enombhalo osesikrinini obhalwe isitayela ofundekayo kusukela ekwazisweni

Inikeza isigcawu esifanayo esichazwe ngezitayela eziningi zobuciko, ukusuka kumbala we-watercolor ukuya ekubumbaneni

Ikhiqiza opopayi bezinto ezimfishane eziqaphela i-3D njengesifanekiso esijikelezayo, esinyakazayo

Ukudala ukumaketha okubushelelezi kwe-24fps noma iziqeshana zomqondo ngokuqondile kusuka encazelweni ebhaliwe

Amaphethini Okusebenzisa

I-Imagen Video Cascades iyasebenza

Ikhiqiza isiqeshana esinencazelo ephezulu enombhalo osesikrinini obhalwe isitayela ofundekayo kusukela ekwazisweni.

Ukukhiqiza isiqeshana esinencazelo ephezulu enombhalo osesikrinini obhalwe isitayela ofundekayo kusukela ekwazisweni Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Imagen Video Cascades iyasebenza

Inikeza isigcawu esifanayo esichazwe ngezitayela eziningi zobuciko, ukusuka kumbala we-watercolor ukuya ekubumbaneni.

Ukunikeza indawo efanayo echazwe ngezitayela eziningi zobuciko, kusukela kumbala we-watercolor kuya ku-claymation Amathimba ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Imagen Video Cascades iyasebenza

Ikhiqiza opopayi bezinto ezimfishane eziqaphela i-3D njengesifanekiso esijikelezayo, esinyakazayo.

Ukukhiqiza opopayi bezinto ezimfishane eziqaphela i-3D ezifana nesithombe esibaziwe esizungezayo, esinyakazayo ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-Imagen Video Cascades iyasebenza

Ukudala ukumaketha okubushelelezi kwe-24fps noma iziqeshana zomqondo ngokuqondile kusuka encazelweni ebhaliwe.

Ukudala ukumaketha okubushelelezi kwe-24fps noma iziqeshana zomqondo ngokuqondile encazelweni ebhaliwe Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, agcine indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.

!

Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.

!

Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.

Ukuqalisa Umhlahlandlela

1

Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.

Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Hlola ngedatha efana nezimo zangempela zokukhiqiza.

Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.

Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.

Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole