RairaPix2Pix Murairo Kugadzirisa
InstructPix2Pix inokutendera kuti ugadzirise foto nekunyora murairo wakajeka senge 'ita nguva yechando' kana 'shandura katsi kuita imbwa', hapana masiki kana maturusi ekusarudza anodiwa.
Pfupiso
It taught a diffusion model to follow editing instructions directly.
Kudzika Kwakadzika
InstructPix2Pix (Brooks et al., 2023) imodhi yekuparadzira yakanyatso kurongedzwa kuti itore mufananidzo wekuisa pamwe nekuraira mameseji uye unoburitsa mufananidzo wakagadziridzwa mune imwechete yekupfuura. Hungwaru hwayo hunyengeri idata rekudzidzisa: vanyori vakashandisa GPT-3 kugadzira isati-uye-mushure memusoro wenyaya, ndokuzoshandisa Prompt-to-Prompt neStable Diffusion kubatanidza kufananidzwa pamberi / mushure memifananidzo peya. Izvo zvakavapa dhatabheti hombe ye (yekutanga mufananidzo, rairo, yakagadziridzwa mufananidzo) katatu kudzidzira pairi, ese asina manyorero ekunyora. Nekuti mirairo inotsanangura shanduko pane chiitiko chakazara, modhi inochengetedza zvikamu zvisina kutaurwa zvemufananidzo. Inoshandisa zviyero zviviri zvekutungamira, imwe yekuti inonyatsotevera sei kuraira uye imwe yekuti inonamatira sei kumufananidzo wepakutanga, ichirega vashandisi vachitengeserana nekugadzirisa simba kurwisa kutendeka.
Technical Insight
Mamiriro emodhi pane ese ari maviri mufananidzo uye rairo, uchishandisa classifier-yemahara nhungamiro pamwe nematemo maviri. Chikero chimwe chinoyera murairo wezvinyorwa, chimwe chinoyera mufananidzo wekuisa. Kusimudza chikero chemufananidzo kunochengeta yakawanda yepakutanga yakasimba, uku kusimudza chiyero chemavara kunoita kuti kugadziridzwa kuve nehasha. Iyi nhungamiro yehuviri ndiyo inoita kuti murayiridzo mumwe chete wegeneric uchinje chikamu chimwe chete uchisiya imwe foto ichizivikanwa.
Strategic Impact
Kumhanya uye chiyero
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Vaka sarudzo
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Team uye workflow
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Iyo Ramangwana reMurairoPix2Pix Yekuraira Kugadziriswa
Kurongeka-kwakavakirwa pakuraira kuri kuita iyo yekusarudzika interface yezvishandiso zvemifananidzo, ikozvino yakabikwa mumapurogiramu makuru uye vatevedzeri vakaita seMagicBrush uye vari kusimukira multi-turn edhita. Tarisira kuchengetedzwa kuri nani kweruzivo rwakanaka, kubata kwakavimbika kwemirairo yenzvimbo senge 'fambisa mwenje kuruboshwe', uye isina musono yekuwedzera kuvhidhiyo, apo murairo mumwe unogadzirisa clip yese. Kubatanidza mamodheru aya nevamiriri vemitauro kunogona kukuita kuti utsanangure chikamu chakazara chekugadzirisa nekutaura.
Real-World Implementation
A blogger anonyora 'wedzera mashizha ekudonha' kuti atorezve mufananidzo wechirimo wenzvimbo yemwaka.
Mutengesi we e-commerce anoraira 'shandura ruvara rwehembe kuti ive navy' kuti ibudise mavara echigadzirwa kubva pane imwe pfuti.
Mudzidzisi anogadzirisa mufananidzo wenhoroondo ne 'colorize this' kuti aite kuti chifananidzo chitema-ne-chena chive chakajeka pachidzidzo.
Mugadziri wememe anoraira 'kuisa magirazi ezuva pambwa' pasina kuvhara kumeso kwembwa.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the InstructPix2Pix Instruction Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
DragGAN Interactive Editing
Mibvunzo inowanzo bvunzwa
What is InstructPix2Pix Instruction Editing?
InstructPix2Pix inokutendera kuti ugadzirise foto nekunyora murairo wakajeka senge 'ita nguva yechando' kana 'shandura katsi kuita imbwa', hapana masiki kana maturusi ekusarudza anodiwa. Yakadzidzisa modhi yekuparadzira kutevedzera mirairo yekugadzirisa zvakananga.
Unoudza sei InstructPix2Pix zvekuchinja?
Unongotaipa rairo yakaita sekuti 'ita nguva yechando'; hapana masiki kana sarudzo yedunhu inodiwa.
Iyo InstructPix2Pix's data yekudzidziswa yakagadzirwa sei?
Vanyori vakabatanidza GPT-3-yakagadzirwa caption pairs ne Prompt-to-Prompt image synthesis kuti ivake katatu otomatiki.
Chii chinonzi InstructPix2Pix's maviri ekutungamira zviyero zvinodzora?
Chikero chimwe chinotonga kuti kupepetwa kunotevera sei murairo; imwe yacho inodzora kuti yakawanda sei yemufananidzo wakachengetedzwa.
Sei modhi yacho ichiwanzosiya zvikamu zvisina kutaurwa zvemufananidzo wega?
Murairo wakanangana neshanduko chaiyo, saka modhi inochengetedza matunhu murairo usingatauri.
Mangani ekupfuura anodiwa neInstructPix2Pix kugadzira editing?
Iyo imwe chete inomisikidzwa diffusion modhi inotora mufananidzo uye rairo pamwe chete uye inoburitsa iyo edit.