Ukuhlelwa Kwemiyalo ye-InstructPix2Pix
I-InstructPix2Pix ikuvumela ukuthi uhlele isithombe ngokuthayipha umyalo ongenalutho njengokuthi 'yenza kube busika' noma 'ukuguqula ikati libe yinja', awekho imaski noma amathuluzi okukhetha adingekayo.
Uhlolojikelele
It taught a diffusion model to follow editing instructions directly.
I-Deep Dive
I-InstructPix2Pix (i-Brooks et al., 2023) iyimodeli yokusabalalisa ecushwe kahle ukuze ithathe isithombe sokufaka kanye nomyalelo wombhalo futhi ikhiphe isithombe esihleliwe ngephasi eyodwa eya phambili. Ubuqili bayo bedatha yokuqeqeshwa: ababhali basebenzise i-GPT-3 ukuze benze amapheya wamagama-ncazo ngaphambi nangemuva, base besebenzisa i-Prompt-to-Prompt with Stable Diffusion ukuze bahlanganise okufanayo ngaphambi/ngemuva kokupheya kwesithombe. Lokho kubanike idathasethi enkulu (isithombe sangempela, imiyalelo, isithombe esihleliwe) kathathu ukuze baziqeqeshe, konke ngaphandle kokulebula okwenziwa ngesandla. Ngenxa yokuthi imiyalelo ichaza ushintsho kunesigcawu esigcwele, imodeli igcina izingxenye zesithombe ezingashiwongo. Isebenzisa izikali ezimbili zokuqondisa, esisodwa esokuthi iwulandela eduze kangakanani umyalelo kanye nokuthi inamathela ngokwethembeka kangakanani esithombeni sokuqala, ivumela abasebenzisi ukuthi bahwebe ngokuhlela amandla ngokumelene nokwethembeka.
I-Technical Insight
Izimo zemodeli kukho kokubili isithombe somthombo kanye nomyalelo, kusetshenziswa isiqondiso samahhala se-classifier kanye nezimbazo ezimbili. Isikali esisodwa sikala isiyalo sombhalo, esinye sikala isithombe sokufaka. Ukuphakamisa isikali sesithombe kugcina okuningi koqobo kungaguquki, kuyilapho ukuphakamisa isikali sombhalo kwenza ukuhlela kube nolaka. Lesi siqondiso esikabili yiso esivumela umyalo owodwa ojwayelekile ukuthi uguqule ngokuthembekile isici esisodwa ngenkathi ushiya sonke isithombe sibonakala.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lokuhlela Imiyalelo ye-InstructPix2Pix
Ukuhlela okusekelwe emiyalweni kuba isixhumi esibonakalayo esizenzakalelayo samathuluzi esithombe, manje esibhakwe ezinhlelweni zokusebenza ezivamile nabalandelayo njengeMagicBrush nabahleli abashintshashintshashintshayo abasafufusa. Lindela ukulondolozwa okungcono kwemininingwane emihle, ukuphatha okuthembekile kwemiyalelo yendawo efana nokuthi 'gudluza isibani kwesokunxele', kanye nesandiso esingenazihibe kuvidiyo, lapho umyalo owodwa uhlela sonke isiqeshana. Ukuhlanganisa lawa mamodeli nabasebenzeli bolimi kungakuvumela ukuthi uchaze isikhathi sokuhlela esigcwele ngengxoxo.
Ukuqaliswa Komhlaba Wangempela
I-blogger ithayipha 'engeza amahlamvu ekwindla' ukuze ikhiphe kabusha isithombe sezwe sasehlobo ukuze sithunyelwe ngesizini.
Umthengisi we-e-commerce uyala 'ukushintsha umbala wehembe ube yi-navy' ukuze ukhiqize okuhlukile kombala womkhiqizo kusuka kushuthi elilodwa.
Uthisha uhlela isithombe somlando 'ngokufaka umbala lokhu' ukuze enze isithombe sengobo yomlando esimnyama nokumhlophe sicace esifundweni.
Umdali we-meme uyala ukuthi 'beka izibuko zelanga enja' ngaphandle kokufihla ubuso benja mathupha.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the InstructPix2Pix Instruction Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-DragGAN Interactive Editing
Imibuzo evame ukubuzwa
What is InstructPix2Pix Instruction Editing?
I-InstructPix2Pix ikuvumela ukuthi uhlele isithombe ngokuthayipha umyalo ongenalutho njengokuthi 'yenza kube busika' noma 'ukuguqula ikati libe yinja', awekho imaski noma amathuluzi okukhetha adingekayo. Ifundise imodeli yokusabalalisa ukulandela imiyalelo yokuhlela ngokuqondile.
Uyitshela kanjani i-InstructPix2Pix ukuthi ishintshe?
Umane uthayiphe umyalelo njengokuthi 'wenze ubusika'; awekho amamaski noma ukukhetha kwesifunda okudingekayo.
Yadalwa kanjani idatha yokuqeqeshwa ye-InstructPix2Pix?
Ababhali bahlanganise ipheya yamagama-ncazo akhiqizwe i-GPT-3 ne-Prompt-to-Prompt synthesis yesithombe ukuze bakhe ngokuphindwe kathathu ngokuzenzakalela.
Zilawulani izikali ezimbili ze-InstructPix2Pix?
Isikali esisodwa silawula ukuthi ukuhlela kuwulandela ngokuqinile kangakanani umyalelo; enye ilawula ukuthi singakanani isithombe somthombo esigciniwe.
Kungani imodeli ivame ukushiya izingxenye ezingashiwongo zesithombe zodwa?
Umyalelo uqondise kushintsho oluthile, ngakho imodeli igcina izifunda lapho imiyalelo ingashiwo khona.
Mangaki amaphasi aya phambili i-InstructPix2Pix ewadingayo ukuze enze ukuhlela?
Kuyimodeli eyodwa yokusabalalisa enemibandela ethatha isithombe nomyalelo ndawonye bese ikhipha ukuhlela.