Uhlolojikelele
I-Gaussian Splatting imele isigcawu se-3D njengezigidi zamabhulabhu amancane, anemibala, abonisa ngale anganikezwa ngesikhathi sangempela. Iletha i-photorealism efana ne-NeRF ngenkathi isebenza ngokushesha ngokwanele ukuze ubuke ngokuhlanganyela.
I-Gaussian Splatting ingeyokugeleza komsebenzi wokubona ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule.
I-Deep Dive
Yethulwe ku-SIGGRAPH 2023, i-3D Gaussian Splatting yakha kabusha izigcawu ezivela ezithombeni ezifana ne-NeRF kodwa isebenzisa isethulo esisobala esikhundleni senethiwekhi ye-neural efihliwe. Isigcawu ngasinye siyifu lama-Gaussians e-3D, ama-ellipsoidal blobs angacacile, futhi ibhulobhu ngalinye ligcina indawo, usayizi nomumo (i-covariance yalo), ukufiphala, nombala. Esikhundleni sokudubula imisebe kancane kancane ngenethiwekhi, indlela "i-splats" lawa mabhulobhu ngokuqondile esikrinini futhi iwahlanganise, inqubo eseduze ne-rasterization evamile futhi ngenxa yalokho ishesha kakhulu. Ukuqeqeshwa kuqala efwini lephoyinti eliyinqayizivele elikhiqizwe ukulinganisa kwekhamera, bese kuthuthukisa ama-blobs kuyilapho ngokuguquguqukayo kwengeza imininingwane lapho isigameko singakhiwe kabusha kancane futhi kuthenwa lapho kugcwele khona kakhulu. Umphumela uwukunikezwa kwesikhathi sangempela ku-1080p ngekhwalithi eqhudelana nama-NeRF angcono kakhulu, yingakho kusabalala ngokushesha ngezithombe namathuluzi wokuthwebula.
I-Technical Insight
Ukhiye uyi-rasterizer esekwe kuthayela ehlukanisekayo. I-3D Gaussians ifanekiselwa ku-2D, ihlungwe ngokujula, futhi ihlanganiswe ne-alpha ngethayela lesikrini ngasinye, ngakho ukunikezela kugwema imashi ye-per-pixel ray eyenza i-NeRF ingasheshi. Umbala ugcinwa ngama-harmonics ayindilinga, uvumela ibhaloshi ngalinye lishintshe ukubukeka nge-engeli yokubuka ukuze lithwebule ukuboniswa. Ngenxa yokuthi wonke amapayipi ayahlukaniseka, ukwehla okufanayo kwe-gradient okufanisa isithombe okusetshenziswe yi-NeRF kuthuthukisa izindawo ze-blob, umumo, ukukhanya, nemibala, kuyilapho isinyathelo sokuminyana sikhula noma sihlukanisa ama-Gaussian ukuze kwengeze imininingwane engekho.
Ubuciko be-Gaussian Splatting
I-Gaussian Splatting imele isigcawu se-3D njengezigidi zamabhulabhu amancane, anemibala, abonisa ngale anganikezwa ngesikhathi sangempela. Iletha i-photorealism efana ne-NeRF ngenkathi isebenza ngokushesha ngokwanele ukuze ubuke ngokuhlanganyela. I-Gaussian Splatting ingeyokugeleza komsebenzi wokubona ngekhompyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, futhi isungule. Ukuze wakhe ukuqonda okujulile, phatha i-Gaussian Splatting njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi ye-Gaussian Splatting namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukudala izithombe ze-3D zesikhathi sangempela, ezihlolekayo zamagumbi noma imikhiqizo yewebhu
Ukukhiqizwa okubonakalayo kanye nokubukwa kuqala kwefilimu nge-photorealistic, amasethi akwazi ukuhamba
Ukuskena okusheshayo kwe-3D kwezinto nendawo kusuka ocingweni noma kuvidiyo ye-drone
Ukwakha izigcawu ezisebenzisanayo ze-AR/VR ezisebenza kahle ku-hardware yabathengi
Amaphethini Okusebenzisa
Gaussian Splatting in practice
Ukudala izithombe ze-3D zesikhathi sangempela, ezihlolekayo zamagumbi noma imikhiqizo yewebhu.
Ukudala ukuthwebula kwe-3D kwesikhathi sangempela, okuhlolekayo kwe-3D kwamagumbi noma imikhiqizo Yamaqembu ewebhu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Gaussian Splatting in practice
Ukukhiqizwa okubonakalayo kanye nokubukwa kuqala kwefilimu nge-photorealistic, amasethi akwazi ukuhamba.
Ukukhiqizwa okubonakalayo kanye nokubukwa kuqala kwefilimu nge-photorealistic, amasethi angakwazi ukuzulazula Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Gaussian Splatting in practice
Ukuskena okusheshayo kwe-3D kwezinto nendawo kusuka ocingweni noma kuvidiyo ye-drone.
Ukuskena okushesha kwe-3D kwezinto nezindawo ocingweni noma kuvidiyo ye-drone Amaqembu ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Gaussian Splatting in practice
Ukwakha izigcawu ezisebenzisanayo ze-AR/VR ezisebenza kahle ku-hardware yabathengi.
Ukwakha izigcawu ze-AR/VR ezisebenza ngokushelelayo kumaQembu we-Hardware yabathengi ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, agcine indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.