Uhlolojikelele
I-DragGAN ikuvumela ukuthi uhlele isithombe ngokuhudula amaphoyinti ngokoqobo: bamba indawo bese usihudulela lapho uqondiswe khona, futhi isithombe sonakala ngokwangempela, sishintsha ukuma, ukuma, noma indlela yokukhuluma. Ibalulekile ngoba yenza ukukhohlisa kwesithombe okunembayo, okunembile kwenzeke ngaphandle kwezilayidi, imaski, noma ukwaziswa kombhalo.
I-DragGAN Interactive Editing ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.
I-Deep Dive
U-DragGAN, ovela ku-Pan, Tewari, Leimkuhler kanye nozakwabo bakwa-Max Planck kanye nozakwethu (SIGGRAPH 2023), wethule ukuhlelwa okusekelwe ephuzwini okusebenzisanayo kwezithombe ezikhiqizwe i-GAN. Umsebenzisi ubeka iphuzu elilodwa noma ngaphezulu 'lokubamba' esithombeni kanye nephoyinti 'eliqondiwe' elihambisanayo lapho kufanele bathuthele khona. I-DragGAN bese igudluza ngokuphindaphindiwe ikhodi efihlekile ukuze okuqukethwe ngaphansi kwesibambo ngasinye kushelele kuqondiswe lapho sonke isithombe sihlala sihlangene. Ungakwazi ukunweba imilenze yesilwane, wenze umuntu amamatheke, uzungezise imoto, noma ushintshe amakhonsathi ezwe, konke ngokuhudula. Okubaluleke kakhulu, ukuhlela kuhlonipha inqwaba yesithombe esifundiwe, ngakho imiphumela ihlala ingokoqobo kunokugcoba amaphikseli. Imaski ongayikhetha ikhawulela ukuthi yiziphi izifunda ezivunyelwe ukuhamba, inikeze ukulawula okuhle kwendawo.
I-Technical Insight
I-DragGAN isebenza esikhaleni esicashile se-GAN esiqeqeshelwe ngaphambili. Isebenzisa izinyathelo ezimbili ezishintshanayo: ukugadwa kokunyakaza, okushintsha ikhodi efihlekile ukuze izici eduze kwesibambo ngasinye ziye endaweni eqondiwe, nokulandelela iphoyinti, okuthutha isibambo ukuze silandele isici ebesigxiliswe kuso kusetshenziswa ukusesha komakhelwane oseduze kumamephu wesici. Ukuphinda lezi zinyathelo kuhambisa isithombe ngakunye kwe-GAN, kukhiqiza ama-deformation abushelelezi, namaqiniso.
Ukufundisa Ukuhlela Okusebenzisanayo kwe-DragGAN
I-DragGAN ikuvumela ukuthi uhlele isithombe ngokuhudula amaphoyinti ngokoqobo: bamba indawo bese usihudulela lapho uqondiswe khona, futhi isithombe sonakala ngokwangempela, sishintsha ukuma, ukuma, noma indlela yokukhuluma. Ibalulekile ngoba yenza ukukhohlisa kwesithombe okunembayo, okunembile kwenzeke ngaphandle kwezilayidi, imaski, noma ukwaziswa kombhalo. I-DragGAN Interactive Editing ingeyokugeleza komsebenzi okubonwa ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-DragGAN Interactive Editing njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi ye-DragGAN Interactive Editing namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukulungisa indlela yokuma kwesithombe, indlela umuntu abuka ngayo, noma isitayela sezinwele ngokuhudula amaphoyinti obuso
Ukushintsha ukuma kwesilwane noma imoto nokuma kwayo, njengokuzungezisa imoto noma ukubeka kabusha ikhanda lebhubesi.
Ukulolonga kabusha izithombe zomkhiqizo (ukunwetshwa, ukunwetshwa, noma ukumisa kabusha izinto) kuma-mockups wedizayini
Ukulungiswa kahle kwezwe noma izithombe zemfashini ngokuhudula amakhonto, njengokushintsha izimo zentaba noma ukulingana kwengubo
Amaphethini Okusebenzisa
I-DragGAN Interactive Editing in practice
Ukulungisa indlela yokuma kwesithombe, indlela umuntu abuka ngayo, noma isitayela sezinwele ngokuhudula amaphoyinti obuso.
Ukulungisa indlela yokuma kwesithombe, indlela yokubuka, noma izitayela zezinwele ngokuhudula amaphuzu obuso Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-DragGAN Interactive Editing in practice
Ukushintsha ukuma kwesilwane noma imoto nokuma kwayo, njengokuzungezisa imoto noma ukubeka kabusha ikhanda lebhubesi.
Ukushintsha ukuma kwesilwane noma imoto, njengokuzungezisa imoto noma ukubeka kabusha ikhanda lebhubesi Amaqembu ngokuvamile athola imiphumela engcono lapho echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-DragGAN Interactive Editing in practice
Ukulolonga kabusha izithombe zomkhiqizo (ukunwetshwa, ukunwetshwa, noma ukumisa kabusha izinto) kuma-mockups wedizayini.
Ukulolonga kabusha izithombe zomkhiqizo (ukunwetshwa, ukunwetshwa, noma ukumisa kabusha izinto) okwenzelwe ama-mockups edizayini Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-DragGAN Interactive Editing in practice
Ukulungiswa kahle kwezwe noma izithombe zemfashini ngokuhudula amakhonto, njengokushintsha izimo zentaba noma ukulingana kwengubo.
Ukushuna kahle kwezwe noma izithombe zemfashini ngokuhudula amakhonsathi, njengokushintsha izimo zentaba noma ukulingana kwengubo Amaqembu ngokuvamile athola imiphumela engcono lapho echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.