Plenoxel yi ak Voxel yi
Plenoxels dafa wane ni mën nga tabaxaat ab seen 3D ak ay resultaa yu baax NeRF te amul benn reso neuronal - ab griy voxels buy denc melo ak dëgëraay.
Résumé
Resultaa bi dafay tàggat lu tollu ci 100x lu gëna gaaw NeRF bi njëkk, fekk mingi méngoo ak kalite bimuy gis.
Plongeur bu xóot
NeRF dafay yegg ci fotorealism waaye daa yeex ndax bépp misaal dafay laaj jàll ci kanam ci reso neuronal bu xóot, te tàggat mën na jël ay waxtu wala ay fan. Plenoxels (Sara Fridovich-Keil, Alex Yu ak ñeneen, 2022) laaj nañu ab laaj buy yee nit ñi: ndax reso bi mënul ñàkk? Seen tontu mooy déet. Dañuy wane seen bi ni griy voxel 3D bu néew. Voxel bu nekk dafay denc benn valeur opacité boole ci koeffisien harmonique sphérique yuy kode melo bi aju ci xool bi. Ngir rendu benn pixel, sistem bi dafay boole valeur yooyu ci rayon bi ci anam wu trilinear ba noppi boole leen ci rendu volume buñ miin. Ndax amul reso, mbir mi yépp ñu ngi koy gëna defar ci saasi ak wàccinu gradient ci kaw valeur voxel yi, ñu yamale ko ngir gëna nooy. Resultaa bi gëna am solo: kalite bu méngoo ak NeRF, ñu tàggat ko ci ay simili ci benn GPU.
Gis-gis xarala
Kulòor bi aju ci ni ngay gisee mooy li gëna am xel. Lu moy ab reso buy genne RGB ci angle bu nekk, voxel bu nekk dafay denc ay koeffisien harmonic spherique (SH) yu ndaw ci chaine bu nekk ci melo yi. Dañu jàngat SH ci wàllu rayon bi, dafay wane ni melo point bi di soppikoo ak point de vue - di jàpp ay highlight ak reflection speculaire. Opacity mënul aju ci yoon wi. Interpolation trilineaire buñ mëna wuutale ak rendu volume dafay tax valeur voxel bu nekk mën nañu ko tàggat ci saasi, kon optimisation bi nekk na xeetu kaare bu gëna ndaw te amul reso.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Plenoxel yi ak Voxel yi
Plenoxels dafa firndeel ni représentation bi, du reso neuronal bi, mooy dawal kalite NeRF - muy gis-gis bu soppi jëmmu barab bi. Dafa inspiré ci saasi pexe yu leer ak yu boole yu melni griy hash yu Instant-NGP ak, ci gàttal, 3D Gaussian Splatting, biy jiite leegi rendu radiance ci jamono dëgg. Xaarandil wéy di dem ci primitif yu leer, xaritoo ak GPU yuy tàggat ci ay segond ba noppi di render ci jamono dëgg, ak reso neuronal yu ñuy jëfandikoo ci tànneef moo gën ñu koy jëfandikoo ci dencukaay seen bu mag.
Doxal ci àdduna dëgg
Gaaw defaraat ab mbir buñu kapte ci ab asset 3D ci ay simili ngir e-commerce wala digitalisation museum, ludul ay waxtu di xaar.
Prototyping bu gaaw bu synthese gis-gis bu bees ci benn GPU konsomatër ngir gëstu ak njàngale.
Defar ay seen voxel yuñ mëna soppali, yu leer, yu artist yi mëna saytu ak dagg ci saasi, wuute na ak diisaayu reso bu opaque.
Dafay nekk misaal buy jàngale ni représentation scene, du jàng bu xóot, mooy jur resultaa fotorealist.
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Plenoxels and Voxel Radiance Fields quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Radiance neuronal
Laaj yi ñuy faral di laaj
Luy Plenoxels ak Voxels?
Plenoxels dafa wane ni mën nga tabaxaat ab seen 3D ak ay resultaa yu baax NeRF te amul benn reso neuronal - ab griy voxels buy denc melo ak dëgëraay. Resultaa bi dafay tàggat lu tollu ci 100x lu gëna gaaw NeRF bi njëkk, fekk mingi méngoo ak kalite bimuy gis.
Lan mooy tànneef bi gëna yéeme ci Plenoxels buñu ko méngale ak NeRF?
Plenoxels dafay denc seen bi ci benn griy voxel ba noppi gëna xéewale valeur yooyu, te amul benn reso neuronal ci pipeline bi.
Lan la voxel bu nekk ci Plenoxels yi di denc ngir jàpp melo bi aju ci gis-gis bi?
Voxel bu nekk dafay tëye opacite ak koeffisien harmonic sphérique ci chaine melo bu nekk, loolu mooy kode ni melo bi di soppikoo ak yoon wi ñuy xoole.
Lu tollu ci ban gaawaay la Plenoxels di tàggat sunu ko méngale ak NeRF bi njëkk?
Bi ñu dindie paas reso bu nekk, Plenoxels tàggat ci 100 yoon lu gëna gaaw, jeexal ci ay simili.
naka lañuy jëlee valeur yi ci griy voxel bi ci rayon bi?
Plenoxels dafay jëfandikoo interpolaasioŋ trilineer buñ mëna wuutale ngir jàng melo yi ak opacite bi ci diggante voxel yi.
Ban conclusion bu gëna yaatu la Plenoxels wane ci terrain bi?
Bi ñu méngale kalite NeRF ak amul reso, Plenoxels dafa wane ni li waral njariñ yi mooy li ñuy wane ak njariñ li, du MLP.