Ukunikezwa Okuhlukile
Ukunikezwa okuhlukile kwenza inqubo yokuguqula isigcawu se-3D sibe isithombe se-2D sihlukaniseke ngokugcwele, ukuze ukwazi ukubala ama-gradients ukusuka kumaphikseli anikeziwe ubuyisele kumapharamitha wesigcawu.
Uhlolojikelele
This lets you optimize geometry, materials, lighting, and camera using gradient descent.
I-Deep Dive
Ukunikezwa kwendabuko kuyindlela eyodwa: okuphakelayo ngejometri, izinto zokwakha, izibani, nekhamera, namaphikseli aphumayo. Ukunikeza okuhlukile kubuyisela emuva okugelezayo ngokubala ikhompuyutha ukuthi iphikseli ngalinye lokukhiphayo lishintsha kanjani ngokuphathelene nepharamitha ngayinye yokokufaka. Ngalawo ma-gradient, i-optimizer ingalungisa umumo we-3D noma ukwakheka kwayo kuze kube yilapho isithombe esinikeziwe sifana nesithombe esiqondiwe, okuyinhliziyo yokunikezwa okuphambene nokuhlaziya-by-synthesis. Ubunzima obuyinhloko ukuthi ukunikezela kuhilela ukungaqhubeki, ikakhulukazi kuma-silhouette ento kanye nemiphetho evalekile, lapho iphikseli igxuma kungazelelwe isuka ngaphambili iye ngemuva. Izindlela ezifana ne-rasterization ethambile (i-SoftRas), isampula enqenqemeni (i-redner ka-Li et al), kanye ne-rasterizer ku-PyTorch3D iphatha lokhu ngokuhlanganisa okushelelayo noma okubalulekile komngcele. Ukuqeqeshwa kwe-NeRF kanye ne-3D Gaussian splatting yizinhlelo zokusebenza ezidumile.
I-Technical Insight
Inselele eyinhloko ukungaqhubeki kokubonakala. Ku-silhouette yento i-pixel ihlwitha isuka ngaphambili iye ngemuva, ngakho okuphuma kokungenangqondo kunguziro cishe yonke indawo futhi ayichazwa onqenqemeni, okunganikezi i-gradient ewusizo mayelana nokuma. Izixazululo zingathambisa ukumbozwa ukuze onxantathu banikele ngokushelela, ukufiphala kwezinyawo kumaphikseli aseduze (i-rasterization ethambile) noma isampula esobala emaphethelweni ukuze kubalwe itemu lomngcele lokuhlanganisa kokunikezela (isampula yomphetho).
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lokuhumusha Okuhlukile
Ukunikezwa okuhlukile kuba izicubu ezixhumene phakathi kwezithombe nokufunda okujulile. Njengoba abanikezeli abahlukanisekayo besikhathi sangempela namaphayiphi a-Gaussian-splatting avuthiwe, lindela izihibe eziqinile zokwakhiwa kabusha kwe-3D kusuka ezithombeni, ukuthwebula okubalulekile kwe-neural, ukulingisa amarobhothi ngefiziksi efundekayo, namasistimu asuka ekupheleni lapho ukulahlekelwa okukodwa kugeleza kusuka esithombeni sokugcina kuze kufike kumapharamitha wesigcawu. Ukulandela umkhondo okuhlukile kokukhanya okugcwele komhlaba wonke kuwumngcele wocwaningo osebenzayo oqhubekela ekusebenzeni.
Ukuqaliswa Komhlaba Wangempela
Ukwakha kabusha umumo nokuthungwa kwento ye-3D kusuka ezithombeni ezimbalwa ngokulungiselela imodeli kuze kube ukunikezwa kufana nezithombe (ukunikezwa okuphambene).
I-Training NeRFs kanye ne-3D Gaussian splats, lapho ama-gradient asuka ekubukeni okunikeziwe abuyekeza ukumelwa kwesehlakalo.
Ukulinganisa izinto ezibonakalayo zento (ukumahhadla, ukubukeka) ngokufanisa okuvelele okunikeziwe nesithombe sangempela.
Ukulinganisa kwekhamera nokuma kumarobhothi, kufaka imodeli eyaziwayo ye-3D esithombeni sekhamera ukuze kubuyiselwe indawo yayo.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Differentiable Rendering quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-DDSP Differentiable Audio Synthesis
Imibuzo evame ukubuzwa
What is Differentiable Rendering?
Ukunikezwa okuhlukile kwenza inqubo yokuguqula isigcawu se-3D sibe isithombe se-2D sihlukaniseke ngokugcwele, ukuze ukwazi ukubala ama-gradients ukusuka kumaphikseli anikeziwe ubuyisele kumapharamitha wesigcawu. Lokhu kukuvumela ukuthi ulungiselele i-geometry, izinto zokwakha, ukukhanya, nekhamera usebenzisa ukwehla kwe-gradient.
Ukunikezwa okuhlukanisekayo kukuvumela ukuthi ubale ini?
Ngokwenza ukunikezela kuhlukaniseke, uthola ama-gradient ageleza ukusuka kumaphikseli abuyele kokufakwayo kwesigcawu, okunika amandla ukuthuthukiswa okusekelwe ku-gradient.
Kungani ama-silhouette ento ewubunzima bokuhumusha okuhlukanisekayo?
Ku-silhouette i-pixel iqhasha phakathi kwengaphambili nengemuva, ngakho okuphuma kokunye okuwuziro kunguziro noma akuchazwanga futhi akuphethe ulwazi lomumo.
I-rasterization ethambile ibhekana kanjani nenkinga yokuyeka ukuqhubeka?
I-Soft rasterization (isb., i-SoftRas) ithambisa ukumbozwa ukuze unxantathu ngamunye abe nomthelela ngokushelela kumaphikseli azungezile, akhiqize ama-gradient asebenzisekayo.
Kuyini 'ukunikezwa okuphambene'?
Ukunikezwa okuphambene kusebenzisa ukunikezwa okuhlukanisayo ukuze kuthuthukiswe amapharamitha esigcawu kuze kube yilapho isithombe esihlanganisiwe sifana nesithombe esiboniwe.
Iyiphi indlela yesimanjemanje encike ekunikezelweni okuhlukanisekayo kokuqeqeshwa?
Kokubili ama-NeRF kanye ne-3D Gaussian splatting athuthukiswa ngokulahleka kwesikhala sesithombe esisakaza emuva ngesinikezeli esihlukanisayo.