Overview
Instant-NGP inzira yeNVIDIA inodzidzisa Neural Radiance Fields uye mamwe neural graphics primitives mumasekonzi panzvimbo yemaawa nekuchengeta zvinodzidzwa maficha mune multiresolution hashi tafura. Izvo zvine basa nekuti yakaita yemhando yepamusoro 3D chiitiko kubatwa nekukurumidza kuti unzwe kunge uchipindirana.
Instant-NGP Hash Encoding ndeyekombuta-yekuona workflows inodudzira kana kugadzira midhiya yekuona yekuongorora, mashandiro, uye kugadzira.
Deep Dive
Instant Neural Graphics Primitives (NVIDIA, 2022) inorwisa bhodhoro guru reNeRFs: iyo MLP hombe inofanirwa kubvunzwa mamirioni enguva. Panzvimbo pekuisa 3D chinzvimbo chine yakagadziriswa sinusoidal maficha uye kuvimba netiweki hombe, Instant-NGP inoshandisa multiresolution hash encoding. Nzvimbo yakafukidzwa nemagridi akati wandei pazvisarudzo zvakasiyana; mepu yega yega maseru maseru, kuburikidza nenzvimbo yehashi basa, mune compact tafura yeanodzidzika maficha mavector. Kukodha imwe poindi, sisitimu inotarira kumusoro uye nemitsara mitatu inodudzira maficha kubva kune yega yega nhanho yekugadziriswa, inoabatanidza, uye inodyisa iyo mudiki MLP. Nekuti mazhinji eanomiririra anomiririra anogara mumatafura ekutarisa uye chete network diki inosara, kudzidziswa uye kupa inova maodha ehukuru nekukurumidza, kazhinji achishandura maawa kuita masekonzi.
Technical Insight
Chikamu chakangwara chiri kurega kudhumhana kwehashi kuchiitika nemaune. Iyo tafura yehashi ine saizi yakagadziriswa, saka akawanda grid maseru anogona mepu kune imwechete yekupinda; iyo diki MLP uye gradient kudzika dzidza kusanzwisisa kudhumhana nekuti akakosha, ane-akakwirira matunhu anoburitsa akasimba magradients uye zvinobudirira kuhwina akagovaniswa slots. Multiresolution mazinga anoreva kuti coarse mazinga haana kudhumhana-asi mazinga akanaka achigovera mapindiro, kuenzanisa ruzivo kubva mundangariro.
Kubata Instant-NGP Hash Encoding
Instant-NGP inzira yeNVIDIA inodzidzisa Neural Radiance Fields uye mamwe neural graphics primitives mumasekonzi panzvimbo yemaawa nekuchengeta zvinodzidzwa maficha mune multiresolution hashi tafura. Izvo zvine basa nekuti yakaita yemhando yepamusoro 3D chiitiko kubatwa nekukurumidza kuti unzwe kunge uchipindirana. Instant-NGP Hash Encoding ndeyekombuta-yekuona workflows inodudzira kana kugadzira midhiya yekuona yekuongorora, mashandiro, uye kugadzira. Kuti uvake kunzwisisa kwakadzama, bata Instant-NGP Hash Encoding semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodiwa, kujekesa fungidziro, uye patsanura izvo zvingaitwe nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa Instant-NGP Hash Encoding chiyero chechokwadi nezvinhu zvekushanda semhando yedata, kusiyana kwemwenje, uye kuenderana kwemazita. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero. Panguva imwecheteyo, kodzero dzeMufananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana hunhu husina kujeka. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Kutora chinhu chaicho kana kamuri muNeRF mumasekonzi kubva pane seti yemifananidzo yefoni
Kugonesa neural yakasainwa chinhambwe basa rekukurumidza 3D chimiro chinomiririra
Kumanikidza uye kumiririra mufananidzo wegigapixel senge inoenderera neural field
Kupa simba nekukurumidza kuvakwa kwechiitiko mukati mekutsvaga maturusi ekushandisa uye VFX previsualization
Maitiro Ekuita
Instant-NGP Hash Encoding mukuita
Kutora chinhu chaicho kana kamuri muNeRF mumasekonzi kubva pane seti yemifananidzo yefoni.
Kutora chinhu chaicho kana kamuri muNeRF mumasekonzi kubva paseti yemafoto efoni Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Instant-NGP Hash Encoding mukuita
Kugonesa neural yakasainwa chinhambwe basa rekukurumidza 3D chimiro chinomiririra.
Kukodzera neural yakasainwa chinhambwe basa rekukurumidza 3D chimiro chinomiririra Matimu anowanzo kuwana zvirinani mhedzisiro kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Instant-NGP Hash Encoding mukuita
Kumanikidza uye kumiririra mufananidzo wegigapixel senge inoenderera neural field.
Kudzvanya uye kumiririra mufananidzo wegigapixel seanoenderera mberi neural field Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Instant-NGP Hash Encoding mukuita
Kupa simba nekukurumidza kuvakwa kwechiitiko mukati mekutsvaga maturusi ekushandisa uye VFX previsualization.
Kusimbisa kukurumidza kuvakwa kwechiitiko mukati mezvishandiso zvekutsvagisa uye VFX previsualization Matimu anowanzo kuwana mhedzisiro iri nani kana ivo vachitsanangudza zvemhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.