Muse Masked Generative Imaging
Muse imhando yemavara-kune-mufananidzo kubva Google inogadzira mapikicha nekuzadza masiki emifananidzo tokeni zvese kamwechete, zvichiita kuti ikurumidze kupfuura nhanho-ne-nhanho kupararira.
Pfupiso
It matters because it showed you can get high-quality, well-aligned images without the slow iterative denoising that most generators rely on.
Kudzika Kwakadzika
Muse inoshanda munzvimbo yakasarudzika yemufananidzo. VQGAN yakadzidziswa inoshandura pikicha kuita gidhi yematokeni akazara, semazwi ezvivharo zvekuvaka. Panguva yekudzidziswa, chikamu chikuru chezviratidzo izvi chinovharwa kunze, uye Transformer inodzidza kufanotaura kuti idzoke, inomisikidzwa pazvinyorwa zvakadzikiswa kubva kumhando yemutauro wakaoma nechando (T5-XXL). Panguva yechizvarwa Muse anotanga kubva kune-akafukidzwa gidhi uye anodhirodha mumatenderedzwa akafanana, achifanotaura akawanda ma tokeni padanho uye nekumisazve avo vasina chivimbo. Dhizaini-matanho maviri inotanga kuburitsa yakaderera-resolution token grid, ipapo super-resolution modhi inozadza yakakwira-resolution grid. Nekuti akawanda ematokeni anogadzirisa panguva imwe chete, iyo 900M uye 3B parameter modhi inoburitsa 256 kana 512 pixel mufananidzo mune mashoma mashoma ekupfuura.
Technical Insight
Iyo yakakosha trick inofanana decoding nekuvimba-kwakavakirwa remasking, inowanzonzi MaskGIT-maitiro sampling. Panzvimbo pekufanotaura chiratidzo chimwe chete panguva (autoregressive) kana kubudisa mazana enguva (kupararira), Muse anofanotaura zviratidzo zvose zvakavharwa, anochengeta avo vane chivimbo zvikuru, uye anovhara zvakare mamwe ose kutenderera kunotevera. Kushandisa yakaomeswa T5-XXL mavara encoder inopa kunzwisisa kwakasimba kwemutauro mahara, uye kushanda pane discrete tokeni kunoita kuti modhi ikonzere nezvemifananidzo senge mazwi.
Strategic Impact
Kumhanya uye chiyero
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Vaka sarudzo
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Team uye workflow
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Ramangwana reMuse Masked Generative Imaging
Masked parallel decoding point kune majenareta ari ese emhando yepamusoro uye anokurumidza kukurumidza, izvo zvakakosha pakugadzirisa kunopindirana uye kushandiswa kwepa-mudziyo. Tarisira iyo token-prediction idea kuti ibatane nekupararira uye autoregressive nzira dzevhidhiyo, uye kupa simba ipapo pendi, kupenda kunze, uye masiki-yemahara editing. Sezvo discrete tokenizer inovandudza, kufungidzira kwakavharidzirwa kunogona kuwedzera zvakachena muvhidhiyo uye 3D, uko kudhirodha kwakafanana kunogona kuderedza zvakanyanya mutengo wekugadzira akawanda mafuremu kana maonero.
Real-World Implementation
Rapid concept art uye mood board uko muimbi anoda misiyano mizhinji mumasekonzi kwete maminetsi.
Zero-kupfura pendi, sekubvisa chinhu uye kuita kuti modhi izadze nzvimbo yakafukidzwa zvinoenderana nenzvimbo dzakatenderedza.
Outpainting yekuwedzera foto kupfuura miganhu yayo yepakutanga yemabhana kana akasiyana mareshiyo.
Kugadzirisa pasina masiki, sekuchinja ruvara rwembwa kana denga kuti rinyure nekugadzirisa zvinyorwa nekumisikidza zvakare ma tokeni akanganisa.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Muse Masked Generative Imaging quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Masked Autoencoders
Mibvunzo inowanzo bvunzwa
What is Muse Masked Generative Imaging?
Muse imhando yemavara-kune-mufananidzo kubva Google inogadzira mapikicha nekuzadza masiki emifananidzo tokeni zvese kamwechete, zvichiita kuti ikurumidze kupfuura nhanho-ne-nhanho kupararira. Izvo zvine basa nekuti zvakaratidza kuti iwe unogona kuwana yepamusoro-mhando, yakanyatsoenderana mifananidzo pasina inononoka iterative denoising iyo majenareta mazhinji anovimba nayo.
Chii chinofanotaurwa naMuse panguva yechizvarwa panzvimbo yekushoropodza pixels?
Muse inoshanda munzvimbo ine discrete token space, ichifanotaura masked image tokens inogadzirwa neVQGAN tokenizer pane kushanda pamapikisi zvakananga.
Nei Muse achiwanzo kukurumidza kupfuura akajairwa madhizaini mamodheru?
Muse inozadza ma tokeni akawanda akafukidzwa panguva imwe chete uye inongoda mashoma edecoding rounds, kusiyana nematanho akawanda anoteedzana ekuita denoising.
Muse anowana kupi kunzwisisa kwayo kwechinyorwa chekukurumidza?
Muse mamiriro ekugadzira pamusoro pezvinyorwa zvakanamirwa kubva kune yakaomeswa nechando yemhando yemutauro weT5-XXL, ichipa kunzwisisa kwakasimba kwemutauro.
Ndeipi basa rekuvimba-kwakavakirwa remasking muMuse?
Mushure mekufanotaura kwega kwega kunoenderana, Muse anochengeta zviratidzo zvine chivimbo uye anovhara zvakare avo vasina chivimbo kuti vakwenenzvera pamatenderedzwa anoteedzana.
Muse inobata sei kugadzira mifananidzo yakakwira-resolution?
Muse inotanga kugadzira yakaderera-resolution token grid, kozoti yechipiri super-resolution modhi inogadzira yakakwirira-resolution token grid.