I-Muse Masked Generative Imaging
I-Muse iyimodeli yombhalo uye esithombeni evela ku-Google eyenza izithombe ngokugcwalisa amathokheni esithombe esifihlekile ngesikhathi esisodwa, okuyenza isheshe kakhulu kunokusabalalisa kwesinyathelo nesinyathelo.
Uhlolojikelele
It matters because it showed you can get high-quality, well-aligned images without the slow iterative denoising that most generators rely on.
I-Deep Dive
I-Muse isebenza endaweni yethokheni eqondile yesithombe. I-VQGAN eqeqeshwe kusengaphambili iphendula isithombe sibe igridi yamathokheni aphelele, njengesigama samabhulokhi okwakha abonakalayo. Ngesikhathi sokuqeqeshwa, ingxenye enkulu yala mathokheni iyafihlwa, futhi i-Transformer ifunda ukubikezela ukuthi ibuyele emuva, ifakwe esimweni sokushumeka kombhalo kusuka kumodeli yolimi oluqandisiwe (T5-XXL). Ngesikhathi sokukhiqiza i-Muse iqala kugridi efihlwe yonke into futhi ihlukanise imizuliswano ehambisanayo, ibikezela amathokheni amaningi ngesinyathelo ngasinye futhi iphinde ifihle lawo angazethembi kangako. Idizayini enezigaba ezimbili iqala ikhiqize igridi yethokheni enokulungiswa okuphansi, bese imodeli yokuxazulula okuphezulu igcwalisa igridi yokulungiswa okuphezulu. Ngenxa yokuthi inqwaba yamathokheni ixazulula ngesikhathi esisodwa, amamodeli epharamitha angu-900M kanye ne-3B akhiqiza isithombe samaphikseli angu-256 noma angu-512 ngamaphasi ambalwa kuphela.
I-Technical Insight
Iqhinga eliyisisekelo liwukwenza amakhodi okuhambisanayo nokuphinda kwenziwe okusekelwe ukuzethemba, okuvame ukubizwa ngokuthi isampula lesitayela se-MaskGIT. Esikhundleni sokubikezela ithokheni eyodwa ngesikhathi (i-autoregressive) noma i-denoising izikhathi ezingamakhulu (ukusabalalisa), uMuseu ubikezela wonke amathokheni ambozwe ubuso, agcine aqiniseka kakhulu, futhi aphinde avale amanye emzuliswaneni olandelayo. Ukusebenzisa isifaki khodi sombhalo esifriziwe se-T5-XXL kunikeza ukuqonda okuqinile kolimi mahhala, futhi ukusebenza ngamathokheni ahlukene kuvumela imodeli ukuthi icabange mayelana nezithombe njengamagama.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Le-Muse Masked Generative Imaging
Ukukhipha amakhodi okufihlwe okuhambisanayo okufihlwe kukhomba kumajeneretha okuyikhwalithi ephezulu futhi ashesha ngempela, okubalulekile ekuhleleni okusebenzisanayo nasekusetshenzisweni kudivayisi. Lindela umbono wokubikezela ithokheni ukuze uhlangane nezindlela zevidiyo ezisabalalisa nezingalawuleki, futhi unike amandla ukupenda okusheshayo, ukupenda ngaphandle, kanye nokuhlela okungenamaski. Njengoba amathokheni ahlukile athuthuka, izithombe ezifihle ubuso zinganwetshwa ngokuhlanzekile zibe yividiyo ne-3D, lapho ukukhishwa kwekhodi okufanayo kungase kwehlise ngokuphawulekayo izindleko zokukhiqiza amafreyimu amaningi noma ukubuka.
Ukuqaliswa Komhlaba Wangempela
Amabhodi wobuciko bomqondo osheshayo namabhodi wemizwa lapho iciko lidinga ukuhluka kwezithombe eziningi ngamasekhondi kunemizuzu.
Ukupenda okungasho lutho, okufana nokukhipha into kanye nokwenza imodeli igcwalise indawo efihlekile ngokuhambisana nendawo ezungezile.
Ukupenda ngaphandle ukuze kunwetshwe isithombe sidlule imingcele yaso yasekuqaleni ukuze uthole ama-banner noma i-aspect ratio ehlukile.
Ukuhlela okungenamaski, njengokushintsha umbala wenja noma isibhakabhaka ekushoneni kwelanga ngokuhlela umbhalo kanye nokubhala kabusha amathokheni athintekile.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Muse Masked Generative Imaging quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ama-Autoencoder Afihliwe
Imibuzo evame ukubuzwa
What is Muse Masked Generative Imaging?
I-Muse iyimodeli yombhalo uye esithombeni evela ku-Google eyenza izithombe ngokugcwalisa amathokheni esithombe esifihlekile ngesikhathi esisodwa, okuyenza isheshe kakhulu kunokusabalalisa kwesinyathelo nesinyathelo. Ibalulekile ngoba ikhombisile ukuthi ungathola izithombe ezisezingeni eliphezulu, eziqondaniswe kahle ngaphandle kokuphimisela okuphindaphindayo okunensayo amajeneretha amaningi athembele kukho.
Yini uMuse ayibikezela ngesikhathi sokukhiqiza esikhundleni sokuchaza amaphikseli?
I-Muse isebenza endaweni yethokheni ecacile, ibikezela amathokheni esithombe esifihliwe akhiqizwa ithokheni ye-VQGAN esikhundleni sokusebenza ngamaphikseli ngokuqondile.
Kungani i-Muse ngokuvamile ishesha kunamamodeli ajwayelekile okusabalalisa?
I-Muse igcwalisa amathokheni amaningi ambozwe ngasikhathi sinye futhi idinga kuphela imijikelezo embalwa yokukhipha amakhodi, ngokungafani nezinyathelo eziningi zokuhlukanisa umsindo ezilandelanayo.
I-Muse ikutholaphi ukuqonda kwayo kokwaziswa kombhalo?
Ukwakhiwa kwezimo ze-Muse ekushumekeni kombhalo kusuka kumodeli yolimi eqandisiwe ye-T5-XXL eqandisiwe, ikunikeza ukuqonda okuqinile kolimi.
Iyini indima yokuphinda kusekelwe ukuzethemba ku-Muse?
Ngemuva kokubikezela ngakunye okufanayo, uMuse ugcina amathokheni azethemba kakhulu futhi avale kabusha lawo azethemba kancane ukuze acwenge emizuliswaneni elandelanayo.
I-Muse ikusingatha kanjani ukukhiqiza izithombe ezinokulungiswa okuphezulu?
I-Muse kuqala ikhiqiza igridi yethokheni enokulungiswa okuphansi, bese imodeli yesibili yokulungiswa okuphezulu ikhiqiza igridi yethokheni yokulungiswa okuphezulu.