Muse Masked Nataal Generatif
Muse xeetu bind-ci-nataal la bu bawoo ci Google buy defar nataal ci feesal ay token nataal yuñ maskeer benn yoon, muy gëna gaaw ci diffusion jéego ci jéego.
Résumé
It matters because it showed you can get high-quality, well-aligned images without the slow iterative denoising that most generators rely on.
Plongeur bu xóot
Muse dafay liggéey ci espace token bu diskret ci benn nataal. VQGAN buñu tàggat bu njëkk dafay soppi nataal ci griy bu ay token yu mat, melni vocabulaire bu ay bloku tabax yuñy xool. Ci diiru tàggat, dañuy maskeer paccum jeton yu bari, ba noppi Transformer jàng ni ñu leen di delloo, te loolu dafay aju ci bind yu bawoo ci xeetu làkk bu yaatu (T5-XXL). Ci jamonoy generation Muse dafay tàmbali ci griy bu maskeer lépp ba noppi dekode ci rond yu paralel, di wax lu bari ci jéego bu nekk ba noppi maskewaat ñi gëna néew wóolu seen bopp. Design bu am ñaari etap dafay njëkka defar griy token bu am resolusioŋ bu woyof, ginaaw ga model bu am resolusioŋ bu mag dafay feesal griy bu am resolusioŋ bu gëna kawe. Ndax ay fukki-fukki jeton dañuy saafara benn yoon, xeetu parametre 900M ak 3B yi dañuy defar nataalu 256 wala 512 pixel ci ay paas yu néew.
Gis-gis xarala
Li gëna am solo mooy dekodage paralel ak remasking bu sukkandiko ci wóolu sa bopp, ñu koy faral di woowe sampling bu nuroo ak MaskGIT. Duñu wax luy waaja am benn jeton ci saa si (autoregressive) wala denoising téemeeri yoon (diffusion), Muse dafay wax luy am ci jeton yu maske yépp, denc ñi gëna wóolu seen bopp, ba noppi maskewaat ñeneen ñi ngir turne bi ci topp. Jëfandikoo ab encoder text T5-XXL bu liw dafay joxe xam-xam bu dëgër ci làkk te doo fay, te jëfandikoo ci ay token yu wuute dafay tax model bi xalaat ci nataal yi gëna melni kàddu.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Muse Masked Nataal Generatif
Maske parallèle decodage poñ ci generatër yu am kalite bu kawe ak gaaw dëgg, lu am solo ci soppali interaktiif ak jëfandikoo ci aparey. Xaarandil xalaatu wax luy am ci token ngir boole ak pexe wideo diffusion ak autoregressive, ak ngir mëna defar ci saasi, defar ci biti, ak soppali bu amul mask. Lu tokenizers yu diskret yi di gëna mëna dem, nataal yu maskeer yi mën nañu dem ba sell ci wideo ak 3D, fu decodage parallel mëna wàññi bu baax njëgu defar kadre yu bari wala gis-gis.
Doxal ci àdduna dëgg
Concept art bu gaaw ak tablo humeur fu artist bi soxla coppite nataal yu bari ci ay segond te du ay simili.
Zero-shot inpainting, lu melni dindi benn mbir ba noppi nga fexe ba model bi fees gox biñ maske mu méngoo ak li ko wër.
Outpainting ngir yokk nataal bi bamu weesu limu njëkka am ngir am ay banner wala ay ratio aspect yu wuute.
Soppi bu amul mask, lu melni soppi melo xaj bi wala asamaan ngir jant ba so ci soppali bind bi ak dekodewaat token yiñ laal.
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Muse Masked Generative Imaging quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Autoencodeurs masqués
Laaj yi ñuy faral di laaj
What is Muse Masked Generative Imaging?
Muse xeetu bind-ci-nataal la bu bawoo ci Google buy defar nataal ci feesal ay token nataal yuñ maskeer benn yoon, muy gëna gaaw ci diffusion jéego ci jéego. Dafa am solo ndax dafa wane ni mën nga am nataal yu baax, yu méngoo bu baax te du am denoising iteratif bu yeex bi generatër yu bari di gëm.
Lan la Muse di wax ci jamonoy defar ludul dindi pixel yi?
Muse dafay liggéey ci barabu token bu wuute, di wax luy waaja am ci token nataal yu maske yi tokenizer VQGAN defar moo gën ñuy liggéey ci pixel yi ci saasi.
Lu tax Muse di gëna gaaw model diffusion yiñ miin?
Muse dafay feesal jeton yu bari yuñ maskeer benn yoon, te soxlawul ludul ay rond decodage yu néew, wuute na ak diffusion yu bari yu toppalante ci denoising.
Fan la Muse jëlee xam-xam bi ci bind bi?
Muse dafay santaane defar ay mbind yu juge ci xeetu làkk T5-XXL buñ tàggat bu njëkk, loolu dina ko may xam-xam bu dëgër ci làkk wi.
Lan mooy wareefu remasking bu lalu ci wóolu sa bopp ci Muse?
Ginaaw bépp prediction parallel, Muse dafay tëye token yi gëna wóolu seen bopp ba noppi maskewaat ñi gëna néew wóolu seen bopp ngir setal ci rond yu toppalante.
naka la ko Muse di def ngir defar ay nataal yu am resolusioŋ bu gëna kawe?
Muse dafay njëkka defar ab griy token bu am dayo bu woyof, ginaaw ga ñaareelu model bu am dayo bu mag defar ab griy token bu am dayo bu gëna kawe.