MaskGIT Parallel Token Decoding
MaskGIT yana haifar da hotuna ta hanyar tsinkayar alamu da yawa a lokaci ɗaya kuma yana cika waɗanda suka fi ƙarfin farko, tare da maye gurbin jinkirin tsarar hagu zuwa dama tare da ɗimbin matakai daidai gwargwado.
Zurfafa nutsewa
MaskGIT (Masked Generative Hoto Transformer), daga Google a cikin 2022, yana sake tunanin yadda tushen tushen hoto ke yanke lamba. Tsoffin masu taswira kamar VQGAN sun haifar da alamu kai tsaye, ɗaya bayan ɗaya a cikin tsari na raster, wanda yake jinkirin da rashin ɗabi'a ga hotunan 2D. MaskGIT a maimakon haka yana horar da maƙasudin ƙirar ƙira kamar BERT: bazuwar ɓangarori na alamun hoto suna ɓoye kuma ƙirar ta koyi tsinkayar su duka a lokaci guda ta amfani da hankali biyu. A lokacin tsara yana farawa daga cikakken abin rufe fuska kuma yana yanke ƙididdiga a ƙayyadadden adadin maimaitawa (sau da yawa 8 zuwa 12). Kowane mataki yana tsinkaya kowane alamar abin rufe fuska, yana kiyaye tsinkayar amincewa mafi girma, kuma ta sake rufe sauran don zagaye na gaba. Wannan yana samar da hotuna masu inganci a kusan tsari na girman matakai kaɗan fiye da yanke yankewa ta atomatik.
Fahimtar Fasaha
Muhimmin sashi shine tsarin amincewa da tsarin masking. Jadawalin cosine yana yanke hukunci nawa alamu don bayyana kowane juzu'i, farawa a hankali da hanzari. Saboda hankali yana da juzu'i biyu, kowane alama yana ganin gabaɗayan hoto mai ban sha'awa, don haka aikata mafi girman ƙwaƙƙwaran tsinkaya da farko yana ba da damar matakai na gaba akan ingantaccen mahallin, kamar warware sassauƙan ɓangarorin wasan wasa a gaban waɗanda ba su da tabbas.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar MaskGIT Parallel Token Decoding
MaskGIT's daidaitaccen gyaran gyare-gyaren gyare-gyaren ya yi wahayi zuwa ga guguwar janareta marasa ƙarfi, gami da MUSE don rubutu-zuwa hoto da hanyoyin rufe fuska don bidiyo. Tsarin, tsinkayar alamu a cikin layi daya da kuma daidaitawa kan ƴan matakai, yana zaune tsakanin GANs-harbi ɗaya da yaɗuwar matakai da yawa, yana ba da ingantaccen ciniki mai saurin gaske. Yi tsammanin zazzage alamar abin rufe fuska don ci gaba da bayyana a cikin saurin janareta na multimodal da tsarin gyare-gyare inda a ciki-zane-zane da cikewar yanayi suka dace da yanayi.
Aiwatar da Gaskiyar Duniya
Samar da cikakken hoto a cikin kusan matakai guda 8 zuwa 12 maimakon ɗaruruwan hasashe na alamar autoregressive
Zana wani yanki mai rufe fuska na hoto ta hanyar sake yin tsinkaya kawai alamun ɓoye tare da mahallin kewaye
Haɗin hoto na yanayin aji akan ImageNet a gasa mai inganci tare da ƙira mai yawa a hankali
Yin aiki azaman ƙashin baya don tsarin rubutu-zuwa hoto kamar Google's MUSE waɗanda ke buƙatar haɓaka da sauri.
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the MaskGIT Parallel Token Decoding quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ƙwararren Ƙwararren-Tunani
Tambayoyin da ake yawan yi
What is MaskGIT Parallel Token Decoding?
MaskGIT yana haifar da hotuna ta hanyar tsinkayar alamu da yawa a lokaci ɗaya kuma yana cika waɗanda suka fi ƙarfin farko, tare da maye gurbin jinkirin tsarar hagu zuwa dama tare da ɗimbin matakai daidai gwargwado.
Ta yaya MaskGIT ke yanke alamomin hoto daban da na'urar wuta ta VQGAN?
MaskGIT yana annabta duk alamun rufe fuska lokaci guda tare da kulawa ta biyu, sabanin VQGAN na jinkirin yanke hukunci daga hagu zuwa dama.
Wace manufar horarwa ce MaskGIT ke aro daga ƙirar harshe?
MaskGIT yana ɓoye ɓangarori na alamun bazuwar kuma ya koyi tsinkaya su, makasudin ƙirar abin rufe fuska mai kama da BERT.
A lokacin tsarawa, wadanne alamomi ne MaskGIT ke aikatawa a kowane juzu'i?
Kowane mataki yana kiyaye mafi ƙarfin tsinkaya kuma ya sake rufe sauran, don haka daga baya matakan yanayin akan abin dogara.
Kusan yawan maimaitawa MaskGIT yawanci yana buƙatar ƙirƙirar hoto?
MaskGIT yana yanke hukunci a cikin ƙaramin ƙayyadadden matakai na matakai, sau da yawa 8 zuwa 12, ƙasa da ƙasa da hanyoyin jujjuyawar kai ko watsawa.
Wane tsari ne ke sarrafa alamomi nawa MaskGIT ke bayyana kowane mataki?
Jadawalin cosine yana bayyana ƴan alamu da wuri da ƙari daga baya, daidaita inganci da sauri a cikin abubuwan da suka faru.