DUSt3R Tabaxaat 3D bu dëgër
DUSt3R dafay defaraat geometrie 3D bu dëgër ci ay nataal yu bari te soxlawul xam barabu kamera bi wala etalonnage.
Résumé
It collapses the traditional multi-step photogrammetry pipeline into a single neural network that just outputs 3D points.
Plongeur bu xóot
Tabaxwaat 3D bu yàgg (jaarale ci yëngu boole ci stéréo yu bari di xool) chaine bu yomba dagg la: gis man-man yi, méngale leen, xayma pose kameraa bi, triangulate, ba noppi densifier. Bépp etap mën na lajj, te dangay soxla nataal yu bari yuy jaxasoo ak intrinsèques camera yu xam. DUSt3R (Wang ak ñeneen, 2024) dafay soppi jafe-jafe bi yépp. Soo joxee ñaari nataal kese, reso bu sukkandiko ci transformatër dafay delloo ci saasi benn 'pointmap' ngir bu nekk - ab coordonnée 3D bu dëgër ci pixel bu nekk, ñoom ñaar ñu ngi feeñ ci benn kaadar coordonnée. Ci kàrtu poñ yiñ tolloo mën nga jàng xóotaayu, pose kamera yi ak match yi daanaka doo fay. Lu ëpp ñaari nataal, DUSt3R dafay def benn yoon buy boole kàrtu poñ yépp ci benn niir poñ bu méngoo. Dafay dox sax ak kamera yuñ kalibrewul ak gis-gis yu néew, yu yaatu.
Gis-gis xarala
Li gëna am solo mooy kàrtu poñ bi: kàrtu 2D-to-3D bu dëgër buy def pixel bu nekk ci nataal bi ci barab bu leer ci 3D, ak ñaari nataali ñaar ñu dellu ci kaadaru koordinaa bi njëkk ci kamera bi. Ndax korespondans bi dafa nekk ci coordonnées 3D yiñ bokk, xayma pose ak méngale nekk nañu li ñuy jàng ci suuf, duñu nekk luñu wara njëkka def. Transformatëru gis-gis bu am cross-attention ci diggante ñaari car yi ci nataal yi dafay may reso bi mu xalaat ci ñaari gis-gis yi, jàng geometrie ci done yu bari yuñ def ci nataal yi.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu DUSt3R Dense 3D Tabaxaat
DUSt3R taxna liggéey bu gaaw - MASt3R yokk matching dense bu dëgër, ak topp-topp push ci jamono dëgg ak scalability yu bari. Ni mbir yi di demee leer na: geometrie buñ jàngee ba ci njeexte gi mooy wecci gasoduc yiñ defaree loxo te yomba dagg. Xaarandil ni xeetu pointmap yii di duggu ci SLAM, robotik, AR, ba ci tàmbali Gaussian-splatting, defar nataali telefon yu yomb yu doy ngir génne metric, 3D bu méngoo ak daanaka bépp kapte.
Doxal ci àdduna dëgg
Soppi yenn nataali telefon yu yomb ci néeg wala mbir ci niir poñ 3D buñ mëna jëfandikoo te doo xool barabu kameraa bi.
Defaraat pose ak xóotaayu kamera ngir tàmbali tabaxaat 3D wala splatting Gaussian ci nataal yu néew te kalibrewul.
Tabaxaat seen yu bawoo ci nataali archive wala ci internet fu done yu etalonnage kamera yi amul.
Def xayma yu gaaw ci geometri ngir robotik ak navigaasioŋ AR ci ñaar wala ñetti poñ yu ñuy xoole.
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DUSt3R Dense 3D Reconstruction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Tuyob bind-ci-3D Magic3D
Laaj yi ñuy faral di laaj
What is DUSt3R Dense 3D Reconstruction?
DUSt3R dafay defaraat geometrie 3D bu dëgër ci ay nataal yu bari te soxlawul xam barabu kamera bi wala etalonnage. Dafay dindi pipeline fotogrametri bu yàgg bi ci benn reso neuronal buy génne ay poñ 3D.
Ban leeral bu am solo la DUSt3R soxlawul muy dugal, bu wuute ak structure-from-motion bu yàgg bi?
DUSt3R dafay liggéey ak kamera yuñ kalibrewul ak pose yuñu xamul; Dafay xayma geometrie ci nataal yu ñor yi.
Lan mooy génnug digg bi reso DUSt3R di regresse ci nataal bu nekk?
DUSt3R dafay wax luy waaja am ci kàrtu poñ, di jox pixel bu nekk benn coordonnée 3D bu dëgër, ak ñaari nataali ñaar ci benn kaadar coordonnée buñ bokk.
Ci biir ñaari nataal DUSt3R, ci ban kaadar coordonnée la ñaari kàrtu poñ yi di fësalee?
Ñari kàrtu poñ yi dañu leen di delloo ci kaadar coordonnée bi njëkk ci kamera bi, loolu mooy tax seen geometrie mën nañu ko méngale.
naka lay def ba DUSt3R am pose ak pixel yu méngoo?
Ndax korespondans bi dafa nekk ci coordonnée 3D yiñ bokk, pose yi ak match yi dañu leen di jàng ci pointmap yi, duñu njëkka saafara.
naka lay def ba DUSt3R mëna jëfandikoo lu ëpp ñaari nataal yuñ dugal?
Ngir gis-gis yu bari, DUSt3R dafay doxal benn yoon buy boole kàrtu poñ yépp ci benn niir poñ bu méngoo.