I-Plenoxels kanye ne-Voxel Radiance Fields
I-Plenoxels ibonise ukuthi ungakwazi ukwakha kabusha isigcawu se-3D ngemiphumela yekhwalithi ye-NeRF ngaphandle kwanoma iyiphi inethiwekhi ye-neural nhlobo — igridi nje yama-voxels egcina umbala nokuminyana.
Uhlolojikelele
The result trains roughly 100x faster than the original NeRF while matching its visual quality.
I-Deep Dive
I-NeRF ifinyelela i-photorealism kodwa ihamba kancane ngoba yonke isampula idinga ukudlula phambili kunethiwekhi ye-neural ejulile, futhi ukuqeqeshwa kungathatha amahora noma izinsuku. I-Plenoxels (uSara Fridovich-Keil, u-Alex Yu et al., 2022) ubuze umbuzo ovusa inkanuko: ingabe inethiwekhi iyadingeka? Impendulo yabo yathi cha. Bamele indawo njengegridi ye-voxel ye-3D egqagqene. I-voxel ngayinye esetshenziswayo igcina inani le-opacity elilodwa kanye nama-harmonic coefficients ayindilinga ahlanganisa umbala oncike ekubukeni. Ukuze inikeze iphikseli, isistimu ihlobanisa lawa manani ngomugqa ongunxantathu ku-ray futhi iwahlanganise ngokunikezwa kwevolumu evamile. Ngenxa yokuthi ayikho inethiwekhi, yonke into ithuthukiswa ngokuqondile ngokwehla kwe-gradient kumanani e-voxel, ajwayele ukushelela. Umphumela wesihloko: ikhwalithi eqhathaniswa ne-NeRF, eqeqeshwe ngamaminithi ku-GPU eyodwa.
I-Technical Insight
Umbala oncike ekubukeni uyingxenye ehlakaniphile. Esikhundleni senethiwekhi ekhipha i-RGB nge-engeli ngayinye yokubuka, i-voxel ngayinye igcina isethi encane yamakhoefiyenti ayindilinga e-harmonic (SH) ngeshaneli ngayinye yombala. Ukuhlola isisekelo se-SH esiqondisweni somsebe kwakha kabusha ukuthi umbala walelo phuzu ushintsha kanjani ngombono - kuthwebula okuvelele okukhethekile nokuboniswa. I-Opacity incike ekuqondeni. Ukuhumusha okuhlukene kwemigqa emithathu kanye nokunikezwa kwevolumu kwenza lonke inani le-voxel liqeqesheke ngokuqondile, ngakho ukuthuthukiswa kuwukulingana okuqondile, okungenayo inethiwekhi-isitayela esincane sesikwele.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa lama-Plenoxels kanye ne-Voxel Radiance Fields
I-Plenoxels ifakazele ukuthi ukumelwa, hhayi inethiwekhi ye-neural, eshayela ikhwalithi ye-NeRF - okutholakele okumise kabusha inkambu. Ikhuthaze ngokuqondile izindlela ezicacile nezixubile njengamagridi e-Hashi e-Instant-NGP futhi, ekugcineni, i-3D Gaussian Splatting, manje ebusa ukunikezwa kokukhanya kwesikhathi sangempela. Lindela umnyakazo oqhubekayo ubheke ezintweni zokuqala ezicacile, ezisebenziseka kalula ze-GPU eziqeqesha ngemizuzwana futhi zisebenza ngesikhathi sangempela, ngamanethiwekhi emizwa asetshenziswa ngokukhetha esikhundleni sesitolo sesigameko esiyinhloko.
Ukuqaliswa Komhlaba Wangempela
Ukwakha kabusha ngokushesha into ethathiwe ibe yimpahla ye-3D ngamaminithi we-e-commerce noma imnyuziyamu yokwenza idijithali, esikhundleni samahora okulinda.
I-prototyping esheshayo yokuhlanganisa kokubuka inoveli ku-GPU yomthengi oyedwa ukuze kwenziwe ucwaningo nemfundo.
Ikhiqiza izigcawu ze-voxel ezihlelekayo, ezisobala amaciko angakwazi ukuzihlola futhi azithene, ngokungafani nezisindo zenethiwekhi ezingacacile.
Ukukhonza njengesibonelo sokufundisa ukuthi ukumelwa kwesigcawu, hhayi ukufunda okujulile, yikho okukhiqiza imiphumela ye-photorealistic.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Plenoxels and Voxel Radiance Fields quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Izinkambu ze-Neural Radiance
Imibuzo evame ukubuzwa
What is Plenoxels and Voxel Radiance Fields?
I-Plenoxels ibonise ukuthi ungakwazi ukwakha kabusha isigcawu se-3D ngemiphumela yekhwalithi ye-NeRF ngaphandle kwanoma iyiphi inethiwekhi ye-neural nhlobo — igridi nje yama-voxels egcina umbala nokuminyana. Umphumela uqeqesha cishe u-100x ngokushesha kune-NeRF yasekuqaleni kuyilapho ufanisa ikhwalithi yayo yokubuka.
Iluphi uhlobo lomklamo olumangaza kakhulu kuma-Plenoxels uma luqhathaniswa ne-NeRF?
I-Plenoxels igcina isigameko ngokuqondile kugridi ye-voxel futhi ithuthukisa lawo manani, ngaphandle kwenethiwekhi ye-neural esendleleni.
Ngabe i-voxel ngayinye esetshenziswayo ku-Plenoxels igcina ini ukuze ithwebule umbala oncike ekubukeni?
I-voxel ngayinye ibamba ukukhanya kanye namakhoyefiyenti ayindilinga ayindilinga ngesiteshi sombala ngamunye, afaka ikhodi ukuthi umbala ushintsha kanjani lapho ubuka khona.
I-Plenoxels iqeqeshe ngokushesha kangakanani uma iqhathaniswa ne-NeRF yasekuqaleni?
Ngokususa amaphasi enethiwekhi esampula ngayinye, ama-Plenoxel aqeqeshwa ngokulandelana kwezikhathi eziyi-100 ngokushesha, aqeda ngemizuzu.
Alandwa kanjani amanani kugridi ye-voxel ngomsebe?
I-Plenoxels isebenzisa ukuhumusha kwemigqa emithathu ehlukene ukuze ifunde umbala nokufiphaza kahle phakathi kwezikhungo ze-voxel.
Isiphi isiphetho esibanzi esaboniswa yi-Plenoxels ensimini?
Ngokufanisa ikhwalithi ye-NeRF ngaphandle kwenethiwekhi, i-Plenoxels ibonise ukumelwa nokwenza kahle, hhayi i-MLP, eyayinesibopho semiphumela.