I-Gaussian Splatting
I-Gaussian Splatting imele isigcawu se-3D njengezigidi zamabhulabhu amancane, anemibala, abonisa ngale anganikezwa ngesikhathi sangempela.
Uhlolojikelele
It delivers NeRF-like photorealism while running fast enough for interactive viewing.
I-Deep Dive
Yethulwe ku-SIGGRAPH 2023, i-3D Gaussian Splatting yakha kabusha izigcawu ezivela ezithombeni ezifana ne-NeRF kodwa isebenzisa isethulo esisobala esikhundleni senethiwekhi ye-neural efihliwe. Isigcawu ngasinye siyifu lama-Gaussians e-3D, ama-ellipsoidal blobs angacacile, futhi ibhulobhu ngalinye ligcina indawo, usayizi nomumo (i-covariance yalo), ukufiphala, nombala. Esikhundleni sokudubula imisebe kancane kancane ngenethiwekhi, indlela "i-splats" lawa mabhulobhu ngokuqondile esikrinini futhi iwahlanganise, inqubo eseduze ne-rasterization evamile futhi ngenxa yalokho ishesha kakhulu. Ukuqeqeshwa kuqala efwini lephoyinti eliyinqayizivele elikhiqizwe ukulinganisa kwekhamera, bese kuthuthukisa ama-blobs kuyilapho ngokuguquguqukayo kwengeza imininingwane lapho isigameko singakhiwe kabusha kancane futhi kuthenwa lapho kugcwele khona kakhulu. Umphumela uwukunikezwa kwesikhathi sangempela ku-1080p ngekhwalithi eqhudelana nama-NeRF angcono kakhulu, yingakho kusabalala ngokushesha ngezithombe namathuluzi wokuthwebula.
I-Technical Insight
Ukhiye uyi-rasterizer esekwe kuthayela ehlukanisekayo. I-3D Gaussians ifanekiselwa ku-2D, ihlungwe ngokujula, futhi ihlanganiswe ne-alpha ngethayela lesikrini ngasinye, ngakho ukunikezela kugwema imashi ye-per-pixel ray eyenza i-NeRF ingasheshi. Umbala ugcinwa ngama-harmonics ayindilinga, uvumela ibhaloshi ngalinye lishintshe ukubukeka nge-engeli yokubuka ukuze lithwebule ukuboniswa. Ngenxa yokuthi wonke amapayipi ayahlukaniseka, ukwehla okufanayo kwe-gradient okufanisa isithombe okusetshenziswe yi-NeRF kuthuthukisa izindawo ze-blob, umumo, ukukhanya, nemibala, kuyilapho isinyathelo sokuminyana sikhula noma sihlukanisa ama-Gaussian ukuze kwengeze imininingwane engekho.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Le-Gaussian Splatting
I-Gaussian Splatting ihamba ngokushesha isuka ocwaningweni iye emikhiqizweni yokuthwebula i-3D, imephu, nokukhiqizwa okubonakalayo, ngokwengxenye ngenxa yokuthi inikezela ngesikhathi sangempela kuma-GPU wabathengi ngisho neziphequluli. Umsebenzi osebenzayo uqondise ukunciphisa osayizi bamafayela (izigcawu zingaba zinkulu), ukuphatha izigcawu eziguqukayo nezinyakazayo, ukukhanya kabusha, nokuhlela izinto ngazinye. Lindela ukuhlanganiswa okuqinile ngezinjini zegeyimu ne-AR/VR, izindlela ezixubile ezihlanganisa ama-splats namameshi, futhi uthwebule kuvidiyo yefoni. Ibonakala ngokuqhubekayo njengokuphelelisa okusebenzayo, noma ukumiselela, i-NeRF nomaphi lapho isivinini esisebenzisanayo sibalulekile.
Ukuqaliswa Komhlaba Wangempela
Ukudala izithombe ze-3D zesikhathi sangempela, ezihlolekayo zamagumbi noma imikhiqizo yewebhu
Ukukhiqizwa okubonakalayo kanye nokubukwa kuqala kwefilimu nge-photorealistic, amasethi akwazi ukuhamba
Ukuskena okusheshayo kwe-3D kwezinto nendawo kusuka ocingweni noma kuvidiyo ye-drone
Ukwakha izigcawu ezisebenzisanayo ze-AR/VR ezisebenza kahle ku-hardware yabathengi
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Gaussian Splatting quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Izinqubo ze-Gaussian
Imibuzo evame ukubuzwa
What is Gaussian Splatting?
I-Gaussian Splatting imele isigcawu se-3D njengezigidi zamabhulabhu amancane, anemibala, abonisa ngale anganikezwa ngesikhathi sangempela. Iletha i-photorealism efana ne-NeRF ngenkathi isebenza ngokushesha ngokwanele ukuze ubuke ngokuhlanganyela.
I-Gaussian Splatting imelela kanjani isigcawu se-3D?
Isigcawu siyifu elisobala lama-Gaussians e-3D, ngalinye liyi-ellipsoid efiphele enesimo, umumo, ukufiphala, kanye nombala.
Kungani i-Gaussian Splatting ishesha kakhulu ukunikeza kune-NeRF yasekuqaleni?
Ukuklama nokuhlanganisa ama-blobs kusetshenziswa i-rasterization esekelwe kuthayela kugwema ukuhamba kancane kwe-NeRF per-pixel ray, okuvumela isivinini sesikhathi sangempela.
Iluphi ulwazi olugcina i-3D Gaussian ngayinye?
Ibhuloho ngalinye liphethe isikhundla, i-covariance (usayizi nokuma), ukufiphala, nolwazi lombala.
Yini esetshenziselwa ukuvumela umbala we-blob ushintshe nge-engeli yokubuka?
Umbala ubhalwe nge-harmonics eyindilinga, ngakho-ke i-Gaussian ngayinye ingavela ihlukile ezindleleni ezihlukene, ithwebula ukuboniswa.
Ukuqeqeshwa kuvamise ukuqala kanjani ku-Gaussian Splatting?
Iqala ngamaphoyinti ayingcosana ukusuka ekulinganisweni kwekhamera yesakhiwo-kusuka-enyakazayo, bese ilungiselela ama-Gaussians ukusuka lapho.