Defar nataal yuy dellu ginaaw
Defar nataal buy dellu ginaaw dafay tabax nataal benn-benn, di wax luy waaja am ci token bu nekk ci lépp luñu ko defaree balaa muy defar.
Résumé
It matters because the same next-token machinery powering language models can produce coherent, controllable images.
Plongeur bu xóot
Defar nataal buy dellu ginaaw dafay jàppee nataal bi ni ab toppalante ba noppi diko wax luy waaja am élément par élément, foofu élément bu bees bu nekk dafay aju ci yi ko jiitu yépp. Liggéey yu njëkk yu melni PixelRNN ak PixelCNN dañu daan wax luy waaja am ci nataal yi benn pixel bu ñor benn yoon, di skane liiñ ci liiñ, te loolu dafa yeex waaye ci theorie set la. Sistem yu bees yi dañuy njëkka kompresse ab nataal ci benn griy bu ay jeton yu wuute di jëfandikoo encodeur bu nuroo ak VQ-VAE, ginaaw ga Transformer di wax luy waaja am ci token yooyu cammoy-ndeyjoor. DALL-E 1 bu OpenAI ak Parti bu Google topp nañu rëset bii, ñu defar ay token nataal yuñ laaj ci benn bind balaa ñu leen di dekodewaat ci pixel yi. Njariñ li gëna mag mooy modeling bi gëna jub ak architecture buñ boole muy làkk. Njëgglangi toppalante, sampling bu yeex.
Gis-gis xarala
Modèle bi dafay factoriser probabilite bu boole jeton yépp ci benn produit bu am sart: p(x) = produit bu p(x_i jox x_1...x_{i-1}). Transformer bu am bàyyi xel ci sabab (maske) dafay fexe ba position bu nekk gis ay token yu njëkk. Ci diiru tàggat-yaram, dafay wax luy waaja am ci token bu nekk ci paralel, jëfandikoo forsu jàngalekat, waaye ci inference dafa wara sample benn token benn yoon, di dundal ku nekk ci ñoom. Codebook bi ñu jàng, dafay jël token yi dellu ci patch nataal yi, decoder bi dafay sample ci pixel yu mujj.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu defar nataal yuy dellu ginaaw
Gaawaay mooy toolu xare bi ci digg bi. Pexe yu melni dekodaasu token paralel ak maske (MaskGIT, Muse) dañuy defar token yu bari benn yoon, ba noppi dekodaasu speculatif biñ leble ci xeetu làkk yi ñu ngi koy méngale ak nataal yi. Gëstukat yi dañuy boole mbind ak nataal ci benn yax buy dellu ginaaw suko defee benn model mëna jàng ak rëdd, ni ñu ko gise ci sistem multimodal yi. Xaarandi xalaati autoregressif ak diffusion ñu wéy di jaxasoo, ak xeetu hybrid yuy jàpp ni ñuy doxalee ci jeton yi ak kalite diffusion bi.
Doxal ci àdduna dëgg
DALL-E 1 dafa defar ay nataal ci di wax luy am ci boppam ab griy bu ay token nataal yu wuute ci ab mbind.
Parti Google dafa yokk ab soppikaayu bind-ci-nataal buy dellu ci boppam ba 20 milyaari paràmetre ngir am seen yu leer te gaaw.
PixelCNN ak PixelRNN dañu wane pixel-by-pixel bu ñor te ba leegi ñu ngi leen di jëfandikoo ngir jàngale xeetu njàngale yu lalu ci mën mën.
MaskGIT ak Muse dañuy jëfandikoo dekodaasu jeton maske paralel ngir gaawlu synthese nataal bu lalu ci jeton boole ci wéy di tàggat ci stil autorégressif.
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Autoregressive Image Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
IA defar nataal
Laaj yi ñuy faral di laaj
What is Autoregressive Image Generation?
Defar nataal buy dellu ginaaw dafay tabax nataal benn-benn, di wax luy waaja am ci token bu nekk ci lépp luñu ko defaree balaa muy defar. Dafa am solo ndax benn masin token bi ci topp biy doxal xeetu làkk yi mën na defar nataal yu lëkkaloo te ñu mëna saytu.
Luy 'autoregressive' ci wàllu defar nataal?
Modèle autorégresif yi dañuy factoriser nataal bi ci anam wu ñuy toppalante, di wax luy waaja am ci token bu nekk wala pixel bu sukkandiko ci élément yi ko jiitu.
Ak naka la xeetu nataali autoregressif yu bees yu melni DALL-E 1 di wane nataal balaa ñu koy wax luy am?
Sistem yu bees yi dañuy tënk nataal bi ci ay token yu wuute (ñuy faral di jaar ci encodeur bu nuroo ak VQ-VAE), ba noppi ñu wax luy toppalante token yi ak Transformer.
Yan model yu njëkk ñoo defar nataal benn pixel bu ñor benn yoon?
PixelRNN ak PixelCNN ñoo njëkka amal xeetu otorégressif yuy skane ak seetlu nataal yi pixel par pixel.
Ban mekaniism mooy tax Transformer bi di toppatoo jeton yu njëkk yi ci jamonoy defar autorégresif?
maskeer causal dafay tere position bu nekk dem ci token yi ci kanam, di jaay doole factorisation cammo-ci-ndijoor.
Lan mooy njariñ li gëna mag ci sampling nataal autorégressif?
Ndax token bu nekk mingi aju ci yi ko jiitu, inference dafa wara daw token par token, suko defee generation bi di yeex.