Amabwiriza ya AI

Gutanga Bitandukanye

Guhindura bitandukanye bituma inzira yo guhindura 3D igaragara mumashusho ya 2D itandukanye rwose, urashobora rero kubara gradients kuva pigiseli yatanzwe igasubira mubintu byerekana.

2 min somaIbiherutse kuvugururwa

Incamake

This lets you optimize geometry, materials, lighting, and camera using gradient descent.

Kwibira cyane

Guhindura gakondo ni umuhanda umwe: kugaburira geometrie, ibikoresho, amatara, na kamera, na pigiseli birasohoka. Itandukaniro ritandukanye rihindura ibyo bitemba mukubara uburyo buri bisohoka pigiseli ihinduka kubijyanye na buri kintu cyinjiza. Hamwe na gradients, optimizer irashobora guhindura imiterere ya 3D cyangwa imiterere yayo kugeza ishusho yatanzwe ihuye nifoto yagenewe, ikaba umutima woguhindura no gusesengura-by-synthesis. Ingorabahizi nyamukuru nuko guhindura birimo guhagarika, cyane cyane kubintu bya silhouettes no kuruhande, aho pigiseli isimbuka gitunguranye kuva imbere kugeza inyuma. Uburyo nka rasterisation yoroshye (SoftRas), sample-sampling (Li et al .'s redner), hamwe na rasterizer muri PyTorch3D ikora ibi hamwe no koroshya cyangwa imipaka idasanzwe. Amahugurwa ya NeRF hamwe na 3D Gaussian splatting nibisabwa bizwi.

Ubushishozi

Ikibazo nyamukuru ni uguhagarikwa kugaragara. Kuri silhouette yikintu ikintu cya pigiseli gifata uhereye imbere ukagera inyuma, bityo inkomoko ya naive ni zeru hafi ya hose kandi idasobanuwe kumpera, idatanga igipimo cyingirakamaro kijyanye nimiterere. Ibisubizo byoroshya gukwirakwiza kuburyo mpandeshatu zitanga ikirenge cyoroshye, kijimye kuri pigiseli yegeranye (rasterisation yoroshye) cyangwa icyitegererezo cyerekanwe kumpande kugirango ubare igihe ntarengwa cyo gutanga integral (sample sampling).

Ingaruka z'Ingamba

Umuvuduko n'igipimo

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.

Build choices

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Itsinda hamwe nakazi

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Igihe kizaza cyo gutanga ibintu bitandukanye

Guhindura bitandukanye bigenda bihinduka ibice bihuza ibishushanyo no kwiga byimbitse. Nkuko ibihe nyabyo bitandukanyirizwa hamwe na Gaussian-splatting imiyoboro ikuze, tegereza imirongo ikarishye yo kongera kwiyubaka kwa 3D uhereye kumafoto, gufata ibikoresho bya neural, kwigana robotike hamwe na fiziki yiga, hamwe na sisitemu yanyuma-iherezo aho igihombo kimwe kiva mumashusho yanyuma kugeza kumiterere yibintu. Inzira zinyuranye zikurikirana kumurika kwisi yose nubushakashatsi bukora imipaka igana mubikorwa.

Gushyira mu bikorwa Isi

Kongera kubaka imiterere yikintu cya 3D hamwe nimiterere uhereye kumafoto make mugutezimbere icyitegererezo kugeza igihe bihinduye bihuye namashusho (guhinduranya).

Guhugura NeRFs na 3D Gaussian splats, aho gradients ziva mubitekerezo byatanzwe zivugurura ibyerekanwe.

Kugereranya ibintu bifatika (ububi, kwigaragaza) muguhuza ibyerekanwe kumafoto nyayo.

Kamera no gushiraho kalibrasi muri robo, ihuza moderi izwi ya 3D kumashusho ya kamera kugirango igarure umwanya wacyo.

Ingaruka & Kurinda

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Differentiable Rendering quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

DDSP Itandukanyirizo ryamajwi

Ibibazo bikunze kubazwa

What is Differentiable Rendering?

Guhindura bitandukanye bituma inzira yo guhindura 3D igaragara mumashusho ya 2D itandukanye rwose, urashobora rero kubara gradients kuva pigiseli yatanzwe igasubira mubintu byerekana. Ibi bigufasha guhitamo geometrie, ibikoresho, kumurika, na kamera ukoresheje buhoro buhoro.

Ni ubuhe buryo butandukanye bwo guhindura bukwemerera kubara?

Mugukora impinduka zitandukanye, ubona gradients zitemba ziva kuri pigiseli zigaruka kumurongo winjiza, bigafasha gradient-ishingiye kumurongo.

Ni ukubera iki ikintu silhouettes ari ingorabahizi yo gutandukanya ibintu?

Kuri silhouette pigiseli ifata hagati yimbere ninyuma, bityo inkomoko ya naive ni zeru cyangwa idasobanuwe kandi ntigutwara amakuru yimiterere.

Nigute rasterisation yoroheje ikemura ikibazo cyo guhagarika akazi?

Kwiyoroshya byoroshye (urugero, SoftRas) byoroshya gukwirakwiza kuburyo buri mpandeshatu igira ingaruka nziza kuri pigiseli ikikije, itanga gradients zikoreshwa.

'Guhindura inverse' ni iki?

Guhindura ibinyuranye bikoresha uburyo butandukanye kugirango uhindure ibipimo byerekana kugeza igihe ishusho ihuye nifoto yagaragaye.

Ni ubuhe buhanga bugezweho bushingiye ku buryo butandukanye bwo guhugura?

Byombi NeRFs na 3D Gaussian splatting itezimbere mugusubiza inyuma ishusho-umwanya wabuze binyuze muburyo butandukanye.