Incamake
VQGAN ikanda amashusho murusobe rwibimenyetso byihariye byakuwe mu gitabo cyize, kureka transformateur ikabyara amashusho nkuko imiterere yindimi itanga inyandiko.
VQGAN na Codebook Ishusho Synthesis ni iyumurimo wa mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga.
Kwibira cyane
VQGAN, yatangijwe mu mpapuro 2021 'Taming Transformers for High-Resolution Image Synthesis,' ikomatanya ibinyabiziga byitwa autoencoder (VQVAE) hamwe n'amahugurwa yo guhangana no gushishoza. Kodegisi ishushanya ishusho kuri gride ntoya yibiranga; buri vector ifatirwa kumurongo wegereye muri codebook yize ya, tuvuge, 1024 code yihariye, ihindura ishusho murukurikirane rwibimenyetso byuzuye. Decoder yubaka ishusho kuva kuri ibyo bimenyetso, yatojwe hamwe nivangura rya GAN hamwe nigihombo cyo kwiyumvisha kuburyo kwiyubaka bisa nkibikabije aho kuba ibicucu. Kuberako amashusho ubu arikimenyetso cyerekana ibimenyetso, transformateur autoregressive irashobora kubigereranya nkururimi, guhanura ibimenyetso umwe umwe. VQGAN izwi cyane gukoresha ibikoresho byambere-by-amashusho ibikoresho byubuhanzi iyo bihujwe nubuyobozi bwa CLIP.
Ubushishozi
Igikorwa cyibanze ni ingano ya vector: ibisubizo bya kodegisi ikomeza gusimburwa na codebook yegeranye cyane, hamwe na 'igororotse-inyuze' igereranya rya gradient kugirango kodegisi irashobora kwiga nubwo idashakisha itandukaniro. Ongeraho ibice bishingiye kuri GAN ivangura hejuru ya autoencoder nibyo bituma VQGAN ikoresha gride ntoya cyane (urugero 16x16) kuruta VQVAE mugihe igumisha imiterere, bigatuma moderi ya transformateur ikurikirana.
Kumenya VQGAN hamwe na Codebook Ishusho Synthesis
VQGAN ikanda amashusho murusobe rwibimenyetso byihariye byakuwe mu gitabo cyize, kureka transformateur ikabyara amashusho nkuko imiterere yindimi itanga inyandiko. VQGAN na Codebook Ishusho Synthesis ni iyumurimo wa mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekanwa kubisesengura, ibikorwa, no guhanga. Kugirango wubake byimbitse, fata VQGAN na Codebook Image Synthesis nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha VQGAN na Codebook Ishusho Synthesis iringaniza neza hamwe nibikorwa bifatika nkubwiza bwamakuru, itandukaniro ryamatara, hamwe nibirango bihoraho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego.
AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa-Isi
Gushyira ifoto muri gride ya 16x16 yerekana ibimenyetso bya codebook kugirango transformateur ibashe kwerekana no kuyisubiramo
Guhuza VQGAN hamwe nubuyobozi bwa CLIP kugirango ukore ibihangano bya 'VQGAN + CLIP' ibihangano bya AI byagaragaye muri 2021
Gucomeka amashusho muburyo bworoshye bwo kubika cyangwa guhugura neza
Gukora nkibishusho bya tokenizer imbere nini nini ya generator nka MaskGIT na transformateur ya multimodal
Uburyo bwo Gushyira mu bikorwa
VQGAN na Codebook Ishusho Synthesis mubikorwa
Gushyira ifoto muri 16x16 ya grid ya kode ya codebook kugirango transformateur ibashe kwerekana no kuyisubiramo.
Gushyira ifoto muri gride ya 16x16 yerekana ibimenyetso bya codebook kugirango transformateur ibashe kwerekana no kuyivugurura Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
VQGAN na Codebook Ishusho Synthesis mubikorwa
Guhuza VQGAN hamwe nubuyobozi bwa CLIP bwo gukora ibihangano bya AI 'VQGAN + CLIP' AI yagiye ahagaragara muri 2021.
Guhuza VQGAN hamwe nubuyobozi bwa CLIP kugirango habeho ibihangano bya AI 'VQGAN + CLIP' ibihangano bya AI byagaragaye cyane mumwaka wa 2021 Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamuka kwabantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
VQGAN na Codebook Ishusho Synthesis mubikorwa
Gucomeka amashusho muburyo bworoshye bwo kubika cyangwa guhugura neza.
Gufata amashusho muburyo bworoshye bwo kubika neza cyangwa guhugura neza kubyara amahugurwa Amakipe akunze kubona umusaruro mwiza mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.
VQGAN na Codebook Ishusho Synthesis mubikorwa
Gukora nkibishusho tokenizer imbere nini nini yerekana amashanyarazi nka MaskGIT na transformateur ya multimodal.
Gukora nkibishusho byerekana imbere mumashanyarazi manini ashingiye kuri generator nka MaskGIT hamwe na transformateur ya Multimodal Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.