MaskGIT Iringaniza Token Decoding
MaskGIT itanga amashusho muguhanura ibimenyetso byinshi icyarimwe no kuzuza ibyiringiro byambere, gusimbuza buhoro buhoro ibumoso-iburyo hamwe nintoki zintambwe yihuse.
Kwibira cyane
MaskGIT (Masked Generative Image Transformer), kuva Google muri 2022, yongeye gutekereza uburyo moderi yerekana amashusho yerekana ibimenyetso. Impinduka zambere nka VQGAN zabyaye ibimenyetso byikora, kimwekimwe murutonde rwa raster, kikaba gitinda kandi kidasanzwe kumashusho 2D. MaskGIT ahubwo ihugura ifite intego yo kwerekana icyitegererezo nka BERT: uduce duto duto twerekana amashusho twihishe kandi icyitegererezo cyiga guhanura icyarimwe ukoresheje ibitekerezo byombi. Mugihe cyibisekuru bitangirira kuri gride yuzuye yuzuye kandi igashiramo umubare uteganijwe wo gusubiramo (akenshi 8 kugeza 12). Buri ntambwe ihanura buri kimenyetso gipfundikijwe, igumya guhanura-ibyiringiro byinshi, kandi ikongera ikagaragaza ibisigaye kumurongo ukurikira. Ibi bitanga amashusho yujuje ubuziranenge hafi ya gahunda yubunini buke ugereranije na decode ya autoregressive.
Ubushishozi
Ikintu cyingenzi ningengabihe ishingiye ku masike. Gahunda ya cosine ihitamo umubare wikimenyetso cyo kwerekana buri itera, gutangira buhoro kandi byihuse. Because attention is bidirectional, every token sees the whole partial image, so committing the most confident predictions first lets later steps condition on solid context, much like solving the easy parts of a puzzle before the ambiguous ones.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka MaskGIT Kuringaniza Token Decoding
MaskGIT ibangikanye na decoding decoding yahumekeye imashini itanga amashanyarazi adasanzwe, harimo MUSE kumyandiko-ku-shusho hamwe nuburyo bwihishe kuri videwo. Igishushanyo, guhanura ibimenyetso mu buryo bubangikanye no gutunganya intambwe nkeya, bicara hagati ya GAN imwe imwe no gukwirakwiza intambwe nyinshi, bitanga ubuziranenge bwihuse-bwihuse. Tegereza ibimenyetso byerekana ibimenyetso byerekana ibimenyetso kugirango ukomeze kugaragara muri moteri yihuta ya moteri nyinshi hamwe na sisitemu yo guhindura aho gushushanya no kuzuza ibintu ari ibintu bisanzwe.
Gushyira mu bikorwa Isi
Gukora ishusho yuzuye muburyo bugera kuri 8 kugeza kuri 12 aho kuba amagana ya autoregressive token
Gushushanya agace gafunze ifoto wongeye guhanura gusa ibimenyetso byihishe hamwe nibidukikije
Urwego-rwerekana ishusho synthesis kuri ImageNet kurwego rwiza rwo guhatana hamwe na moderi zitinda cyane
Gukora nkumugongo wa decoding ya sisitemu yinyandiko-shusho nka __AIU_PROTECTED_11 __ 'MUSE ikeneye ibisekuruza byihuse
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the MaskGIT Parallel Token Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Skeleton-y-Igitekerezo Iringaniza Decoding
Ibibazo bikunze kubazwa
What is MaskGIT Parallel Token Decoding?
MaskGIT itanga amashusho muguhanura ibimenyetso byinshi icyarimwe no kuzuza ibyiringiro byambere, gusimbuza buhoro buhoro ibumoso-iburyo hamwe nintoki zintambwe yihuse.
Nigute MaskGIT yerekana ibimenyetso byamashusho bitandukanye na transformateur ya VQGAN?
MaskGIT ihanura ibimenyetso byose bipfundikijwe icyarimwe hamwe no kwitondera ibyerekezo byombi, bitandukanye na VQGAN itinda ibumoso-iburyo-autodegressive decoding.
Niyihe ntego yo guhugura MaskGIT itira muburyo bw'ururimi?
MaskGIT ihisha uduce duto duto twikimenyetso kandi yiga kubihanura, intego yo kwerekana icyitegererezo isa na BERT.
Mugihe cyibisekuru, ni ibihe bimenyetso MaskGIT ikora kuri buri itera?
Buri ntambwe ikomeza ibyiringiro byizewe kandi ikongera ikabitwikira ibisigaye, nyuma rero intambwe igahinduka kumiterere yizewe.
Hafi ya zingahe zisubiramo MaskGIT ikenera kubyara ishusho?
MaskGIT decode mumubare muto uhamye wintambwe, akenshi 8 kugeza 12, munsi cyane ugereranije na autoregressive cyangwa diffusion.
Nihe gahunda igenzura ibimenyetso bingahe MaskGIT ihishura buri ntambwe?
Gahunda ya cosine igaragaza ibimenyetso bike hakiri kare na nyuma, kuringaniza ubuziranenge n'umuvuduko ukabije.