Uhlolojikelele
Ukulahlekelwa komqondo kulinganisa ukuthi izithombe ezimbili ezifanayo zibukeka kanjani kubantu ngokuqhathanisa izici ezijulile zenethiwekhi ye-neural esikhundleni samaphikseli aluhlaza. Kubalulekile ngoba ukuqhathanisa kwe-pixel-by-pixel kujezisa ngokungalungile izinguquko ezincane kanye nokufiphalisa imininingwane, kuyilapho ukulahlekelwa kombono kuklomelisa imiphumela ebukhali, engokoqobo.
I-Perceptual Loss kanye ne-LPIPs okokugeleza komsebenzi wokubona ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.
I-Deep Dive
Ukulahlekelwa okuvamile okufana ne-L2 (iphutha eliyisikwele) kuqhathanisa izithombe nge-pixel-by-pixel, ukuze ukushintsha kwephikiseli eyodwa noma ukuthungwa okuhluke kancane kubukeke njengephutha elikhulu nakuba abantu bengaboni. Ukulahlekelwa kombono esikhundleni salokho kusebenzisa zombili izithombe ngenethiwekhi eqeqeshwe kusengaphambili (ngokuvamile i-VGG) futhi kuqhathanise ukuqaliswa okuvela kungqimba olumaphakathi. Ngenxa yokuthi lezo zici zihlanganisa imiphetho, indlela yokwenza, nezingxenye zento esikhundleni samavelu ephikseli anembile, ukulahlekelwa kuhambisana kangcono nokwahlulela komuntu, okukhuthaza ukuphuma okubukhali, okuthembekile ngokwezibalo. I-LPIPS (Ukufana Kwesiqeshana Sesithombe Esifundiwe), yethulwe ngu-Zhang et al. ngo-2018, yenza lokhu kube ngokusemthethweni: ikhipha izici ezijulile, izenze zibe jwayelekile, futhi isebenzise izisindo ezifundiwe ezilinganiswe nezinkulungwane zezahlulelo zokufana kwabantu, ikhiqize isikolo sebanga elilodwa lapho okuphansi kusho okufanayo ngokuqonda.
I-Technical Insight
I-LPIPS idlulisa zombili izithombe ngomgogodla ogxilile (VGG, AlexNet, noma SqueezeNet), iyunithi-yenza kusebenze isiteshi ngendlela evamile ezendlalelo ezimbalwa, bese ithatha umehluko oyisikwele endaweni ngayinye yendawo. Isethi encane yezisindo ezifundiwe zesiteshi ngasinye ikala lowo mehluko ngaphambi kokuthi ulinganiswe ngokwendawo futhi ufingqwe kuzo zonke izendlalelo. Lezo zisindo zaqeqeshwa kudathasethi ye-BAPPS yezahlulelo zokukhetha okubili okuphoqelelwe, ngakho-ke imethrikhi ibonisa lokho abantu abakubonayo ngempela kunebanga lesici esingavuthiwe.
Ukuqonda Ukulahleka Kombono kanye ne-LPIPs
Ukulahlekelwa komqondo kulinganisa ukuthi izithombe ezimbili ezifanayo zibukeka kanjani kubantu ngokuqhathanisa izici ezijulile zenethiwekhi ye-neural esikhundleni samaphikseli aluhlaza. Kubalulekile ngoba ukuqhathanisa kwe-pixel-by-pixel kujezisa ngokungalungile izinguquko ezincane kanye nokufiphalisa imininingwane, kuyilapho ukulahlekelwa kombono kuklomelisa imiphumela ebukhali, engokoqobo. I-Perceptual Loss kanye ne-LPIPs okokugeleza komsebenzi wokubona ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-Perceptual Loss kanye ne-LPIPS njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho uhlelo olungakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa i-Perceptual Loss kanye nokunemba kwebhalansi ye-LPIPS namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukuqeqesha amanethiwekhi anokulungiswa okungaphezulu (isb., i-SRGAN) ukuze izithombe eziphakeme zibukeke zibukhali futhi zenziwe ngendlela efanayo kunokufiphala.
Ihlola ukuminyaniswa kwesithombe namakhodekhi ngokuthola ukuthi isithombe esikhishiwe sisondele kangakanani kwesangempela.
Ukudluliswa kwesitayela esiqondisayo, lapho okuqukethwe kufaniswe nezici ezijulile ze-VGG kunamaphikseli aqondile.
I-GAN yokulinganisa kanye namajeneretha esithombe esisabalalisiwe ngokubika ibanga le-LPIPS phakathi kwezithombe ezikhiqiziwe nezangempela.
Amaphethini Okusebenzisa
Ukulahlekelwa Kombono kanye ne-LPIPS ekusebenzeni
Ukuqeqesha amanethiwekhi anokulungiswa okungaphezulu (isb., i-SRGAN) ukuze izithombe eziphakeme zibukeke zibukhali futhi zenziwe ngendlela efanayo kunokufiphala.
Ukuqeqesha amanethiwekhi anesinqumo esihle kakhulu (isb., i-SRGAN) ukuze izithombe eziphakeme zibukeke zibukhali futhi zenziwe ngendlela efanayo kunokuba ifiphele Amathimba ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka komuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukulahlekelwa Kombono kanye ne-LPIPS ekusebenzeni
Ihlola ukuminyaniswa kwesithombe namakhodekhi ngokuthola ukuthi isithombe esikhishiwe sisondele kangakanani kwesangempela.
Ukuhlola ukuminyanisa kwesithombe namakhodekhi ngokuthola ukuthi isithombe esiqoshwe sicishe sisondele kangakanani kumaQembu okuqala ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukulahlekelwa Kombono kanye ne-LPIPS ekusebenzeni
Ukudluliswa kwesitayela esiqondisayo, lapho okuqukethwe kufaniswe nezici ezijulile ze-VGG kunamaphikseli aqondile.
Ukudluliswa kwesitayela esiqondisayo, lapho okuqukethwe kuhlotshaniswa nezici ezijulile ze-VGG esikhundleni samaphikseli aqondile Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Ukulahlekelwa Kombono kanye ne-LPIPS ekusebenzeni
I-GAN yokulinganisa kanye namajeneretha esithombe esisabalalisiwe ngokubika ibanga le-LPIPS phakathi kwezithombe ezikhiqiziwe nezangempela.
I-GAN yokulinganisa kanye namajeneretha ezithombe ezisabalalisayo ngokubika ibanga le-LPIPS phakathi kwezithombe ezikhiqiziwe nezangempela Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.