Kurumidza-kune-Prompt Cross-Attention Editing
Prompt-to-Prompt inogadziridza mufananidzo wakagadzirwa nekugadzirisa iwo mavara nekukurumidza uchishandisa zvakare mepu yekutarisisa yemukati memodhi, saka kushandura izwi rimwe chete rinochinjanisa chinhu ichi uchichengeta chasara chiitiko.
Pfupiso
It is editing through words, not pixels.
Kudzika Kwakadzika
Prompt-to-Prompt (Hertz et al., 2022) inzira yekudzidzira-yemahara yekunyora-inotyairwa editing mumamodhi ekupararira. Muono wakakosha ndewekuti mamepu ekutarisisa, ayo anoudza modhi kuti ndeapi matunhu izwi rega rega rinofanira kupesvedzera, encode marongero enzvimbo yechiitiko. Kana iwe uchigadzira patsva mufananidzo nekagadziridzwa zvishoma, nzira inopinza iyo yepakutanga yekutarisisa mepu mukuita kutsva. Kutsiva izwi, taura 'bhasikoro' ne'mudhudhudhu', chinjanisa chinhu ichi uchichengetedza kuumbwa uye kumashure. Kuwedzera izwi kunopinza kutarisa chete kune asina kuchinjika tokens, saka hunhu hutsva hunoonekwa pasina kudzoreredza zvese. Iwe unogona zvakare reweight kutarisisa kwechiratidzo kusimbisa kana kuderedza kushanda kwayo. Nekuti haidi kurongeka kana masiki, yakava nheyo yekuvaka yeakawanda akazotevera ekugadzirisa nzira, kusanganisira InstructPix2Pix's data chizvarwa.
Technical Insight
Munguva yedenoising, kuyambuka-kutarisisa computes, kune imwe neimwe chiratidzo, mepu yenzvimbo yekwainopinda mumufananidzo. Prompt-to-Prompt inokopa mamepu aya kubva kuchizvarwa chepakutanga kuenda kune yakagadziridzwa yematokeni akagovaniswa. Kuchinjana kwemazwi kunoisa pfungwa pakati pezviratidzo zvinoenderana; pamashoko akawedzerwa inochengetedza mamepu ekare uye inongobvumira zviratidzo zvitsva kuti zvigadzire kutarisa kutsva; kuremerwa kunongoyera kukosha kwechiratidzo, kuwedzera kana kudzikamisa maitiro ayo ekuona.
Strategic Impact
Kumhanya uye chiyero
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Vaka sarudzo
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Team uye workflow
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Ramangwana reKurumidza-ku-Kukurudzira Muchinjikwa-Kutarisisa Kugadziriswa
Muchinjikwa-kutarisisa manipulation iko zvino kunosimbisa mhuri yese yezvishandiso zvinodzoreka zvechizvarwa, uye mazano anotambanudzira kune kutarisisa kutarisisa mumagadzirirwo matsva uye kupararira kwevhidhiyo kwekugadzirisa kwechinguvana. Tarisira kubatanidzwa kwakasimba ne-chaiyo-image editing kuburikidza neinversion, kubata kwakasimba kwekuchinja kukuru kwechimiro, uye kusanganisa nemamodheru ekuraira kuitira kuti manomano ekutarisa afambe zvisingaonekwe pasi pechimiro chakareruka chemutauro wechisikigo.
Real-World Implementation
Mugadziri anochinja 'motokari tsvuku mumugwagwa' kuita 'motokari yebhuruu mumugwagwa' uye inoramba ichinyatsoenderana nemamiriro ezvinhu.
Mufananidzi anoremesa izwi rekuti 'chando' kuita kuti nzvimbo iwedzere kutonhorera pane zvakasiyana.
Mutauri wengano anochinjanisa 'shumba' kuti 'tiger' nekukurumidza kuti arambe aine chimiro chakafanana uye kumashure kwebepa remavara.
Muongorori anoishandisa kugadzira akapetwa pamberi / mushure memifananidzo sedhata rekudzidzisa remupepeti anotevera rairo.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt-to-Prompt Cross-Attention Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Cross-Attention
Mibvunzo inowanzo bvunzwa
What is Prompt-to-Prompt Cross-Attention Editing?
Prompt-to-Prompt inogadziridza mufananidzo wakagadzirwa nekugadzirisa iwo mavara nekukurumidza uchishandisa zvakare mepu yekutarisisa yemukati memodhi, saka kushandura izwi rimwe chete rinochinjanisa chinhu ichi uchichengeta chasara chiitiko. Iko kugadzirisa kuburikidza nemazwi, kwete pixels.
Ndeupi ruzivo rwemukati rwunoshandiswa zvakare nePrompt-to-Prompt kuchengetedza chiitiko?
Mepu-yekutarisisa mamepu anokodha apo izwi rega rega rinopesvedzera mufananidzo, saka kuvashandisa zvakare kunochengeta dhizaini inoenderana panguva yekugadziriswa.
Ko Prompt-to-Prompt inoda kunyatsogadzirisa modhi?
Inoshandura kutarisisa panguva yekufungidzira uye haidi imwe kudzidziswa.
Chii chinoita kuti kuremerwa kwechiratidzo chechiratidzo?
Kuyera kukosha kwechiratidzo kunowedzera kana kudzima kuti pfungwa iyoyo inoratidzika sei.
Nei Prompt-to-Prompt ichionekwa senzira yekutanga?
Yayo yekudzidzira-yemahara yekutarisisa yakava chivakwa chekuvaka chakashandiswa zvakare patsvakiridzo yekugadzirisa yakatevera.