I-VISual AI GUIDE

Ukuhlelwa Kokuqaphela Okubalulekile

I-Prompt-to-Prompt ihlela isithombe esikhiqiziwe ngokulungisa umbhalo waso ngenkathi kusetshenziswa kabusha amamephu wokunaka angaphakathi emodeli, ngakho-ke ukushintsha igama elilodwa kushintshanisa leyo element ngenkathi kugcina sonke isigameko sinjalo.

Uhlolojikelele

I-Prompt-to-Prompt ihlela isithombe esikhiqiziwe ngokulungisa umbhalo waso ngenkathi kusetshenziswa kabusha amamephu wokunaka angaphakathi emodeli, ngakho-ke ukushintsha igama elilodwa kushintshanisa leyo element ngenkathi kugcina sonke isigameko sinjalo. Ihlela ngamagama, hhayi ngamaphikseli.

I-Prompt-to-Prompt Cross-Attention Editing ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.

I-Deep Dive

I-Prompt-to-Prompt (Hertz et al., 2022) iyindlela yamahhala yokuqeqesha yokuhlela okuqhutshwa umbhalo kumamodeli okusabalalisa. Ukuqonda okubalulekile ukuthi amamephu agxile kakhulu, atshela imodeli ukuthi iziphi izifunda zesithombe igama ngalinye okufanele libe nalo, abethele ukwakheka kwendawo yesehlakalo. Uma ukhiqiza kabusha isithombe ngomyalo oshintshwe kancane, indlela ifaka ukunaka kwamamephu wokwaziswa kwasekuqaleni ekusebenzeni okusha. Ukushintsha igama, ithi 'ibhayisikili' ngokuthi 'isithuthuthu', ishintshanisa leyo nto kuyilapho ilondoloza ukwakheka nengemuva. Ukwengeza igama kubangela ukunaka kuphela kumathokheni angashintshiwe, ngakho-ke isici esisha sivela ngaphandle kokuhlenga kabusha yonke into. Ungakwazi futhi ukunciphisa ukunaka kwethokheni ukuze uqinise noma wenze buthaka umphumela walo. Ngenxa yokuthi ayidingi ukulungiswa kahle noma imaski, ibe isisekelo sokwakha izindlela eziningi zokuhlela kamuva, okuhlanganisa ukukhiqizwa kwedatha ye-InstructPix2Pix.

I-Technical Insight

Phakathi ne-denoising, ukunakwa okuphambene kuyabala, kuthokheni ngayinye, imephu yendawo lapho ihlanganyela khona esithombeni. I-Prompt-to-Prompt ikopisha lawa mamephu ukusuka esizukulwaneni sokuqala ukuya kwehleliwe yamathokheni abiwe. Ngokushintshana kwamagama kuveza ukunaka phakathi kwamathokheni ahambisanayo; emagameni engeziwe igcina amamephu amadala futhi ivumela kuphela amathokheni amasha akhe ukunaka okusha; ukukala kabusha kukala amanani okunaka ethokheni, kuqinise noma kuthulise umthelela walo obonakalayo.

Ingcweti ekuhleleni i-Cross-Attention esheshayo

I-Prompt-to-Prompt ihlela isithombe esikhiqiziwe ngokulungisa umbhalo waso ngenkathi kusetshenziswa kabusha amamephu wokunaka angaphakathi emodeli, ngakho-ke ukushintsha igama elilodwa kushintshanisa leyo element ngenkathi kugcina sonke isigameko sinjalo. Ihlela ngamagama, hhayi ngamaphikseli. I-Prompt-to-Prompt Cross-Attention Editing ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-Prompt-to-Prompt Cross-Attention Editing njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi ye-Prompt-to-Prompt Cross-Attention Editing namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.

I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.

Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.

Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa Lokunakwa Okusheshayo Kokushesha

Ukukhohlisa okugxilile manje kusekela wonke umndeni wamathuluzi okukhiqiza alawulekayo, futhi imibono inweba ekulawuleni ukunaka ekwakhiweni okusha nokusatshalaliswa kwevidiyo ukuze kube nokuhlelwa okungashintshi kwesikhashana. Lindela ukuhlanganiswa okuqinile nokuhlela kwesithombe sangempela ngokuguquguquka, ukuphathwa okuqinile kwezinguquko ezinkulu zesakhiwo, kanye nokuhlanganiswa namamodeli wemiyalelo ukuze amaqhinga okunaka asebenze ngokungabonakali ngaphansi kwesixhumi esibonakalayo esilula solimi lwemvelo.

Ukuqaliswa Komhlaba Wangempela

Umklami ushintsha 'imoto ebomvu emgwaqeni' ibe 'imoto eluhlaza okwesibhakabhaka emgwaqeni' futhi ugcina isakhiwo sesigcawu esifanayo.

Umdwebi wezithombe ulinganisa kabusha igama elithi 'iqhwa' ukuze enze isimo sezwe sibe ubusika ngokuqhubekayo phakathi kokuhluka.

Umxoxi wezindaba ushintshanisa 'ibhubesi' elithi 'tiger' ngokushesha ukuze agcine ukuma okufanayo nesizinda seshidi labalingiswa.

Umcwaningi uyisebenzisela ukukhiqiza izithombe ezibhanqiwe ngaphambi/ngemuva kwalokho njengedatha yokuqeqesha yomhleli olandela imiyalelo.

Amaphethini Okusebenzisa

Ukuhlela Okusheshayo-kuya-Ukusheshisa Ukunaka Okuphambanayo kuyasebenza

Umklami ushintsha 'imoto ebomvu emgwaqeni' ibe 'imoto eluhlaza okwesibhakabhaka emgwaqeni' futhi ugcina isakhiwo sesigcawu esifanayo.

Umklami ushintsha 'imoto ebomvu emgwaqeni' ibe 'imoto eluhlaza okwesibhakabhaka emgwaqeni' futhi agcine isimo esifanayo ncamashí nesakhiwo sesigcawu Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukuhlela Okusheshayo-kuya-Ukusheshisa Ukunaka Okuphambanayo kuyasebenza

Umdwebi wezithombe ulinganisa kabusha igama elithi 'iqhwa' ukuze enze isimo sezwe sibe ubusika ngokuqhubekayo phakathi kokuhluka.

Umdwebi ulinganisa kabusha igama elithi 'iqhwa' ukuze enze isimo sezwe sibe ubusika obuningi ngokuqhubekayo kuzo zonke izinhlobo Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukuhlela Okusheshayo-kuya-Ukusheshisa Ukunaka Okuphambanayo kuyasebenza

Umxoxi wezindaba ushintshanisa 'ibhubesi' elithi 'tiger' ngokushesha ukuze agcine ukuma okufanayo nesizinda seshidi labalingiswa.

Umxoxi wezindaba ushintshanisa 'ibhubesi' elithi 'tiger' ngokushesha ukuze agcine ukuma okufanayo nesizinda seshidi labalingiswa Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Ukuhlela Okusheshayo-kuya-Ukusheshisa Ukunaka Okuphambanayo kuyasebenza

Umcwaningi uyisebenzisela ukukhiqiza izithombe ezibhanqiwe ngaphambi/ngemuva kwalokho njengedatha yokuqeqesha yomhleli olandela imiyalelo.

Umcwaningi uyisebenzisela ukukhiqiza izithombe ezibhanqiwe ngaphambi/ngemuva kwezithombe njengedatha yokuqeqesha yomhleli olandela imiyalelo Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.

!

Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.

!

Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.

Ukuqalisa Umhlahlandlela

1

Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.

Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Hlola ngedatha efana nezimo zangempela zokukhiqiza.

Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.

Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.

Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole