Uhlolojikelele
I-Muse iyimodeli yombhalo uye esithombeni evela ku-Google eyenza izithombe ngokugcwalisa amathokheni esithombe esifihlekile ngesikhathi esisodwa, okuyenza isheshe kakhulu kunokusabalalisa kwesinyathelo nesinyathelo. Ibalulekile ngoba ikhombisile ukuthi ungathola izithombe ezisezingeni eliphezulu, eziqondaniswe kahle ngaphandle kokuphimisela okuphindaphindayo okunensayo amajeneretha amaningi athembele kukho.
I-Muse Masked Generative Imaging ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.
I-Deep Dive
I-Muse isebenza endaweni yethokheni eqondile yesithombe. I-VQGAN eqeqeshwe kusengaphambili iphendula isithombe sibe igridi yamathokheni aphelele, njengesigama samabhulokhi okwakha abonakalayo. Ngesikhathi sokuqeqeshwa, ingxenye enkulu yala mathokheni iyafihlwa, futhi i-Transformer ifunda ukubikezela ukuthi ibuyele emuva, ifakwe esimweni sokushumeka kombhalo kusuka kumodeli yolimi oluqandisiwe (T5-XXL). Ngesikhathi sokukhiqiza i-Muse iqala kugridi efihlwe yonke into futhi ihlukanise imizuliswano ehambisanayo, ibikezela amathokheni amaningi ngesinyathelo ngasinye futhi iphinde ifihle lawo angazethembi kangako. Idizayini enezigaba ezimbili iqala ikhiqize igridi yethokheni enokulungiswa okuphansi, bese imodeli yokuxazulula okuphezulu igcwalisa igridi yokulungiswa okuphezulu. Ngenxa yokuthi inqwaba yamathokheni ixazulula ngesikhathi esisodwa, amamodeli epharamitha angu-900M kanye ne-3B akhiqiza isithombe samaphikseli angu-256 noma angu-512 ngamaphasi ambalwa kuphela.
I-Technical Insight
Iqhinga eliyisisekelo liwukwenza amakhodi okuhambisanayo nokuphinda kwenziwe okusekelwe ukuzethemba, okuvame ukubizwa ngokuthi isampula lesitayela se-MaskGIT. Esikhundleni sokubikezela ithokheni eyodwa ngesikhathi (i-autoregressive) noma i-denoising izikhathi ezingamakhulu (ukusabalalisa), uMuseu ubikezela wonke amathokheni ambozwe ubuso, agcine aqiniseka kakhulu, futhi aphinde avale amanye emzuliswaneni olandelayo. Ukusebenzisa isifaki khodi sombhalo esifriziwe se-T5-XXL kunikeza ukuqonda okuqinile kolimi mahhala, futhi ukusebenza ngamathokheni ahlukene kuvumela imodeli ukuthi icabange mayelana nezithombe njengamagama.
I-Mastering Muse Masked Generative Imaging
I-Muse iyimodeli yombhalo uye esithombeni evela ku-Google eyenza izithombe ngokugcwalisa amathokheni esithombe esifihlekile ngesikhathi esisodwa, okuyenza isheshe kakhulu kunokusabalalisa kwesinyathelo nesinyathelo. Ibalulekile ngoba ikhombisile ukuthi ungathola izithombe ezisezingeni eliphezulu, eziqondaniswe kahle ngaphandle kokuphimisela okuphindaphindayo okunensayo amajeneretha amaningi athembele kukho. I-Muse Masked Generative Imaging ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-Muse Masked Generative Imaging njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi ye-Muse Masked Generative Imaging enamaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Amabhodi wobuciko bomqondo osheshayo namabhodi wemizwa lapho iciko lidinga ukuhluka kwezithombe eziningi ngamasekhondi kunemizuzu.
Ukupenda okungasho lutho, okufana nokukhipha into kanye nokwenza imodeli igcwalise indawo efihlekile ngokuhambisana nendawo ezungezile.
Ukupenda ngaphandle ukuze kunwetshwe isithombe sidlule imingcele yaso yasekuqaleni ukuze uthole ama-banner noma i-aspect ratio ehlukile.
Ukuhlela okungenamaski, njengokushintsha umbala wenja noma isibhakabhaka ekushoneni kwelanga ngokuhlela umbhalo kanye nokubhala kabusha amathokheni athintekile.
Amaphethini Okusebenzisa
I-Muse Masked Generative Imaging in practice
Amabhodi wobuciko bomqondo osheshayo namabhodi wemizwa lapho iciko lidinga ukuhluka kwezithombe eziningi ngamasekhondi kunemizuzu.
Amabhodi womqondo osheshayo namabhodi wemizwa lapho iciko lidinga ukuhluka kwezithombe eziningi ngemizuzwana kunemizuzu Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Muse Masked Generative Imaging in practice
Ukupenda okungasho lutho, okufana nokukhipha into kanye nokwenza imodeli igcwalise indawo efihlekile ngokuhambisana nendawo ezungezile.
Ukupenda okungasho lutho, okufana nokukhipha into kanye nokwenza imodeli igcwalise isifunda esimboziwe ngokuhambisana nendawo ezungezile Amaqembu ngokuvamile athola imiphumela engcono lapho echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Muse Masked Generative Imaging in practice
Ukupenda ngaphandle ukuze kunwetshwe isithombe sidlule imingcele yaso yasekuqaleni ukuze uthole ama-banner noma i-aspect ratio ehlukile.
Ukupenda ngaphandle ukuze kunwetshwe isithombe sibe ngaphezu kwemingcele yaso yokuqala ukuze uthole izibhengezo noma izilinganiso ezihlukile zamathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Muse Masked Generative Imaging in practice
Ukuhlela okungenamaski, njengokushintsha umbala wenja noma isibhakabhaka ekushoneni kwelanga ngokuhlela umbhalo kanye nokubhala kabusha amathokheni athintekile.
Ukuhlela okungenamaski, njengokushintsha umbala wenja noma isibhakabhaka ekushoneni kwelanga ngokuhlela umbhalo bese ubhala kabusha amathokheni athintekile Amaqembu ngokuvamile athola imiphumela engcono uma echaza imikhawulo yekhwalithi ngaphambili, agcine indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.