Mwongozo wa AI unaoonekana

Uteuzi wa Tokeni Sambamba ya MaskGIT

MaskGIT generates images by predicting many tokens at once and selecting high-confidence predictions for subsequent refinement, replacing left-to-right generation with parallel iterations.

Sikiliza mwongozo huuInaonyeshwa na AI · ~2 min

Katika ukurasa huudk 2 kusoma
  1. Muhtasari
  2. Dive ya kina
  3. Utekelezaji wa Ulimwengu Halisi
  4. Mustakabali wa Uteuzi wa Tokeni Sambamba wa MaskGIT
  5. Kuiweka katika vitendo
  6. Endelea Kuchunguza
  7. Maswali yanayoulizwa mara kwa mara

Muhtasari

Confidence is a model score used for selection, not a guarantee that a token is correct.

Dive ya kina

MaskGIT (Masked Generative Image Transformer), from Google in 2022, rethinks how token-based image models decode. Earlier transformers such as VQGAN generate tokens autoregressively, one at a time in raster order. MaskGIT instead trains with a masked modeling objective like BERT: random subsets of image tokens are hidden and the model learns to predict them simultaneously using bidirectional attention. At generation time it starts from a masked grid and decodes over a configured number of refinement iterations; the original paper reports examples using roughly 8 to 12 steps, but the count depends on the setup rather than defining the algorithm. Each step predicts masked tokens, keeps selected high-confidence predictions, and re-masks other positions. Confidence ranks candidates for the next iteration; it does not prove a prediction is correct.

Utekelezaji wa Ulimwengu Halisi

Kutoa taswira kamili katika takriban hatua 8 hadi 12 zinazolingana badala ya mamia ya utabiri wa tokeni unaojirudia.

Kupaka eneo lililofichwa la picha kwa kutabiri tena ishara zilizofichwa zenye muktadha unaoizunguka

Usanisi wa picha zenye masharti ya darasa kwenye ImageNet kwa ubora wa ushindani na miundo ya polepole zaidi

Inatumika kama uti wa mgongo wa kusimbua mifumo ya kubadilisha maandishi hadi picha kama MUSE ya Google ambayo inahitaji uundaji wa haraka

Mustakabali wa Uteuzi wa Tokeni Sambamba wa MaskGIT

Usimbuaji wa kurudia sawia wa MaskGIT ulihimiza wimbi la jenereta zisizo za moja kwa moja, ikijumuisha MUSE kwa maandishi-kwa-picha na mbinu zilizofichwa za video. Mchoro, unaotabiri tokeni sambamba na uboreshaji kwa hatua chache, hukaa kati ya GAN za risasi moja na uenezaji wa hatua nyingi, ukitoa ubadilishanaji wa kasi wa ubora unaoweza kubadilishwa. Tarajia usimbaji wa tokeni zilizofichwa ili kuendelea kuonekana katika jenereta za haraka za modi nyingi na mifumo ya kuhariri ambapo kupaka rangi na kujazwa kwa masharti kunafaa kiasili.

Kuiweka katika vitendo

Kwa nini ni muhimu

  • Kasi na kiwango. Visual AI inaweza kufanya ukaguzi, ugunduzi na kazi za kuweka lebo kiotomatiki kwa kiwango.
  • Tengeneza chaguzi. Timu bunifu zinaweza kuiga dhana kwa haraka zaidi na masahihisho machache ya mikono.
  • Timu na mtiririko wa kazi. Uendeshaji unaweza kutumia ishara za picha na video ambazo hapo awali zilikuwa ngumu kuchakata.

Jihadharini na

  • Haki za picha na idhini zinaweza kuwa hatari za kisheria ikiwa asili haiko wazi.
  • Utendaji wa muundo unaweza kutofautiana katika mwangaza, idadi ya watu na mazingira.
  • Chanya za uwongo zinaweza kutotambuliwa isipokuwa viwango vya uaminifu vifuatiliwe.

Hatua zinazofuata

  1. Bainisha vigezo vya kukubalika vya usahihi, kumbukumbu na gharama za makosa.
  2. Jaribu kwa kutumia data inayolingana na hali halisi ya uzalishaji.
  3. Ongeza ukaguzi wa kibinadamu kwa utabiri wa chini au utabiri wa athari kubwa.
  4. Fuatilia mtindo wa kuteleza na uthibitishe upya baada ya mabadiliko ya kamera au mkusanyiko wa data.

Endelea Kuchunguza

Jarida halali

Pata taarifa ya kila siku ya AI

Hadithi tatu za AI zilizothibitishwa kila asubuhi ya wiki, zimetengenezwa kwa Kiingereza rahisi. Bila malipo daima, hakuna matangazo.

Barua pepe moja kila siku ya wiki. Jiondoe kwa bonyeza moja. Hatutauza au kushiriki anwani yako.

Jijaribu mwenyewe

Take the MaskGIT Parallel Token Decoding quiz

Maoni ya haraka juu ya kila jibu, na cheti kinachoweza kushirikishwa na kitambulisho kinachoweza kuthibitishwa baada ya kupita kozi.

Anza chemsha bongo

Changia elimu ya AI bila malipo. AI Understanding ni 501(c)(3) isiyo na faida — hakuna matangazo, hakuna kizuizi cha malipo, daima. Toa mchango

Maswali yanayoulizwa mara kwa mara

Uainishaji wa Tokeni Sambamba ya MaskGIT ni nini?

MaskGIT generates images by predicting many tokens at once and selecting high-confidence predictions for subsequent refinement, replacing left-to-right generation with parallel iterations. Confidence is a model score used for selection, not a guarantee that a token is correct.

MaskGIT huamuaje ishara za picha tofauti na kibadilishaji cha VQGAN?

MaskGIT hutabiri tokeni zote zilizofichwa kwa wakati mmoja kwa uangalifu wa pande mbili, tofauti na usimbaji otomatiki wa polepole wa VQGAN kutoka kushoto kwenda kulia.

Je, MaskGIT inakopa lengo gani la mafunzo kutoka kwa mifano ya lugha?

MaskGIT huficha seti ndogo za ishara nasibu na hujifunza kuzitabiri, lengo la kielelezo lililofichwa sawa na BERT.

Wakati wa kizazi, ni ishara gani MaskGIT hufanya kwa kila iteration?

At each iteration, MaskGIT retains the predictions with the highest model confidence and re-masks other positions. Confidence is a ranking signal for selecting tokens, not proof that each selected token is correct.

In the original MaskGIT generation examples, roughly how many refinement iterations were often used?

The guide cites roughly 8 to 12 steps as an example from the original paper’s image-generation setups; the count is configuration-dependent rather than a universal requirement.

Je! ni ratiba gani inayodhibiti ni tokeni ngapi za MaskGIT zinaonyesha kila hatua?

Ratiba ya cosine huonyesha tokeni chache mapema na baadaye zaidi, kusawazisha ubora na kasi katika marudio.