Ukuhlelwa Kokunakwa Okusheshayo
I-Prompt-to-Prompt ihlela isithombe esikhiqiziwe ngokulungisa umbhalo waso ngenkathi kusetshenziswa kabusha amamephu wokunaka angaphakathi emodeli, ngakho-ke ukushintsha igama elilodwa kushintshanisa leyo element ngenkathi kugcina sonke isigameko sinjalo.
Uhlolojikelele
It is editing through words, not pixels.
I-Deep Dive
I-Prompt-to-Prompt (Hertz et al., 2022) iyindlela yamahhala yokuqeqesha yokuhlela okuqhutshwa umbhalo kumamodeli okusabalalisa. Ukuqonda okubalulekile ukuthi amamephu agxile kakhulu, atshela imodeli ukuthi iziphi izifunda zesithombe igama ngalinye okufanele libe nalo, abethele ukwakheka kwendawo yesehlakalo. Uma ukhiqiza kabusha isithombe ngomyalo oshintshwe kancane, indlela ifaka ukunaka kwamamephu wokwaziswa kwasekuqaleni ekusebenzeni okusha. Ukushintsha igama, ithi 'ibhayisikili' ngokuthi 'isithuthuthu', ishintshanisa leyo nto kuyilapho ilondoloza ukwakheka nengemuva. Ukwengeza igama kubangela ukunaka kuphela kumathokheni angashintshiwe, ngakho-ke isici esisha sivela ngaphandle kokuhlenga kabusha yonke into. Ungakwazi futhi ukunciphisa ukunaka kwethokheni ukuze uqinise noma wenze buthaka umphumela walo. Ngenxa yokuthi ayidingi ukulungiswa kahle noma imaski, ibe isisekelo sokwakha izindlela eziningi zokuhlela kamuva, okuhlanganisa ukukhiqizwa kwedatha ye-InstructPix2Pix.
I-Technical Insight
Phakathi ne-denoising, ukunakwa okuphambene kuyabala, kuthokheni ngayinye, imephu yendawo lapho ihlanganyela khona esithombeni. I-Prompt-to-Prompt ikopisha lawa mamephu ukusuka esizukulwaneni sokuqala ukuya kwehleliwe yamathokheni abiwe. Ngokushintshana kwamagama kuveza ukunaka phakathi kwamathokheni ahambisanayo; emagameni engeziwe igcina amamephu amadala futhi ivumela kuphela amathokheni amasha akhe ukunaka okusha; ukukala kabusha kukala amanani okunaka ethokheni, kuqinise noma kuthulise umthelela walo obonakalayo.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lokunakwa Okusheshayo Kokushesha
Ukukhohlisa okugxilile manje kusekela wonke umndeni wamathuluzi okukhiqiza alawulekayo, futhi imibono inweba ekulawuleni ukunaka ekwakhiweni okusha nokusatshalaliswa kwevidiyo ukuze kube nokuhlelwa okungashintshi kwesikhashana. Lindela ukuhlanganiswa okuqinile nokuhlela kwesithombe sangempela ngokuguquguquka, ukuphathwa okuqinile kwezinguquko ezinkulu zesakhiwo, kanye nokuhlanganiswa namamodeli wemiyalelo ukuze amaqhinga okunaka asebenze ngokungabonakali ngaphansi kwesixhumi esibonakalayo esilula solimi lwemvelo.
Ukuqaliswa Komhlaba Wangempela
Umklami ushintsha 'imoto ebomvu emgwaqeni' ibe 'imoto eluhlaza okwesibhakabhaka emgwaqeni' futhi ugcina isakhiwo sesigcawu esifanayo.
Umdwebi wezithombe ulinganisa kabusha igama elithi 'iqhwa' ukuze enze isimo sezwe sibe ubusika ngokuqhubekayo phakathi kokuhluka.
Umxoxi wezindaba ushintshanisa 'ibhubesi' elithi 'tiger' ngokushesha ukuze agcine ukuma okufanayo nesizinda seshidi labalingiswa.
Umcwaningi uyisebenzisela ukukhiqiza izithombe ezibhanqiwe ngaphambi/ngemuva kwalokho njengedatha yokuqeqesha yomhleli olandela imiyalelo.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prompt-to-Prompt Cross-Attention Editing quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukunakwa
Imibuzo evame ukubuzwa
What is Prompt-to-Prompt Cross-Attention Editing?
I-Prompt-to-Prompt ihlela isithombe esikhiqiziwe ngokulungisa umbhalo waso ngenkathi kusetshenziswa kabusha amamephu wokunaka angaphakathi emodeli, ngakho-ke ukushintsha igama elilodwa kushintshanisa leyo element ngenkathi kugcina sonke isigameko sinjalo. Ihlela ngamagama, hhayi ngamaphikseli.
Yiluphi ulwazi lwangaphakathi oluphinda lusetshenziswe i-Prompt-to-Prompt ukuze kugcinwe isigcawu?
Amamephu agxile kakhulu afaka ikhodi lapho igama ngalinye lithonya isithombe, ngakho ukuphinda ukuwasebenzisa kugcina isakhiwo singashintshi ngesikhathi sokuhlelwa.
Ingabe i-Prompt-to-Prompt idinga ukulungiswa kahle kwemodeli?
Ilawula ukunakwa ngesikhathi esinqunyiwe futhi ayidingi ukuqeqeshwa okwengeziwe.
Yini ezuzisa ukunakwa kwethokheni?
Ukukala amanani okunaka kwethokheni kuqinisa noma kuthulisa ukuthi lowo mqondo ubonakala uqine kangakanani.
Kungani i-Prompt-to-Prompt ithathwa njengendlela eyisisekelo?
Ukukhohliswa kokunaka kwamahhala kokuqeqeshwa kube yisakhiwo esakhiwe kabusha ocwaningweni lonke lokuhlela olwalandela.