DUSt3R Kwiyubaka 3D
DUSt3R yubaka geometrike yuzuye ya 3D uhereye kumafoto asanzwe adakeneye imyanya ya kamera izwi cyangwa kalibrasi.
Incamake
It collapses the traditional multi-step photogrammetry pipeline into a single neural network that just outputs 3D points.
Kwibira cyane
Iyubakwa rya 3D rya kera (imiterere-kuva-yimuka wongeyeho stereo-nyinshi-reba stereo) ni urunigi rworoshye: gutahura ibiranga, kubihuza, kugereranya kamera ya kamera, mpandeshatu, hanyuma ikuzura. Buri cyiciro kirashobora kunanirwa, kandi mubisanzwe ukeneye amashusho menshi arengana hamwe na kamera izwi. DUSt3R (Wang et al., 2024) yongeye gukemura ikibazo cyose. Uhaye amashusho abiri gusa, umuyoboro ushingiye kuri transformateur usubiza mu buryo butaziguye 'pointmap' kuri buri - umurongo wuzuye kuri pigiseli ya 3D ihuza, byombi bigaragazwa muburyo bumwe. Uhereye kuri ibyo bishushanyo mbonera urashobora gusoma byimbitse, kamera yerekana, kandi bihuye kubusa. Kumashusho arenze abiri, DUSt3R ikora ihuza ryisi yose idoda ibice byombi byerekanwe muburyo bumwe. Ikora ndetse na kamera zidakurikiranwa hamwe na bike cyane, bigaragara cyane.
Ubushishozi
Ibisohoka byibanze ni ingingo yerekana: ikarita ya 2D-kuri-3D ishushanya buri pigiseli yishusho ahantu hagaragara 3D, hamwe namashusho yombi yabantu basubijwe mumashusho ya kamera ya mbere. Kuberako inzandiko zandikirwa mubikorwa bya 3D bisangiwe, kugereranya no guhuza bihinduka ibisomwa byo hasi aho kuba ibisabwa. Iyerekwa rya Vision hamwe no guhuza ibitekerezo hagati yamashami abiri yishusho areka urusobekerane rwibitekerezo hamwe kubyerekeranye byombi, wiga geometrie biturutse kumibare minini yerekana amashusho.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka DUSt3R Ubwinshi bwa 3D Kwiyubaka
DUSt3R yatangije umurongo wihuta wakazi - MASt3R yongeramo imbaraga zihuye neza, hamwe nibikurikiranwa bisunika mugihe nyacyo kandi kinini-cyerekana ubunini. Icyerekezo kirasobanutse: impera-iherezo-yize geometrie isimbuza imiyoboro ikozwe n'intoki. Tegereza iyi moderi yerekana uburyo bwo kugaburira muri SLAM, robotics, AR, ndetse no gutangiza Gaussian-splatting, gukora amafoto ya terefone bisanzwe bihagije kugirango ubyare metric, ihamye 3D uhereye kubantu bose bafashwe.
Gushyira mu bikorwa Isi
Guhindura amashusho make ya terefone yicyumba cyangwa ikintu mubicu bikoreshwa bya 3D point utabanje gusuzuma aho kamera ihagaze.
Kugarura kamera yifoto nuburebure kugirango bootstrap yamanutse hasi ya 3D yongeye kwiyubaka cyangwa Gaussian itandukana kuva amashusho make, adahujwe.
Kongera kubaka amashusho yo mububiko cyangwa amafoto ya enterineti aho amakuru ya kalibrasi ataboneka.
Gutanga igereranya ryihuse rya robotics hamwe na AR kugendagenda kubintu bibiri cyangwa bitatu gusa.
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DUSt3R Dense 3D Reconstruction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Magic3D Umwandiko-Kuri-3D Umuyoboro
Ibibazo bikunze kubazwa
What is DUSt3R Dense 3D Reconstruction?
DUSt3R yubaka geometrike yuzuye ya 3D uhereye kumafoto asanzwe adakeneye imyanya ya kamera izwi cyangwa kalibrasi. Isenyuka umuyoboro gakondo wamafoto menshi yintambwe mumurongo umwe wimitsi usohora amanota ya 3D gusa.
Ni ubuhe butumwa bw'ingenzi DUSt3R idasaba nk'iyinjiza, bitandukanye n'imiterere ya kera-kuva-kugenda?
DUSt3R ikorana na kamera idahinduka hamwe na posisiyo itazwi; igereranya geometrie iturutse kumashusho mbisi.
Nibihe bisohoka hagati umuyoboro wa DUSt3R usubira kuri buri shusho?
DUSt3R ihanura ingingo yerekana, igenera buri pigiseli umurongo wa 3D wuzuye, hamwe namashusho yombi yubukwe murwego rusangiwe.
Mumashusho ya DUSt3R, ni ikihe kintu cyo guhuza ibice byombi byerekanwe?
Amashusho yombi yerekana amashusho asubizwa mumashusho yambere ya kamera ya kamera, bigatuma geometrie yabo igereranywa.
Nigute DUSt3R ibona kamera ya kamera na pigiseli ihuye?
Kuberako inzandiko zandikirwa mubikorwa bya 3D bisangiwe, imyanya hamwe nibisomwa bisomwa uhereye kumurongo aho gukemurwa mbere.
Nigute DUSt3R ikora amashusho arenze abiri yinjiza?
Kubireba byinshi, DUSt3R ikoresha ihuza ryisi yose ihuza ibishushanyo mbonera byombi muburyo bumwe.