DUst3R nnukwu 3D Nrụzigharị
DUSt3R na-ewughachi geometry 3D siri ike site na foto ndị nkịtị na-enweghị mkpa ọnọdụ igwefoto ama ama ma ọ bụ nhazi.
Nchịkọta
It collapses the traditional multi-step photogrammetry pipeline into a single neural network that just outputs 3D points.
Ime miri emi
Omuma nwughari 3D (ihe owuwu-site na ngagharị gbakwunyere stereo multi-view) bụ yinye na-emebi emebi: chọpụta njirimara, dakọtara ha, chepụta ọnọdụ igwefoto, triangulate, wee mejupụta. Ọkwa ọ bụla nwere ike ịda, ma ị na-achọkarị ọtụtụ onyonyo na-agbakọ ọnụ na ihe igwefoto ama ama. DUst3R (Wang et al., 2024) na-edozi nsogbu ahụ dum. Nyere naanị onyonyo abụọ, netwọkụ nke na-agbanwe agbanwe na-eweghachite ozugbo 'pointmap' maka onye ọ bụla - nhazi 3D pikselụ ọ bụla, egosipụtara n'otu etiti nhazi ahụ. Site na map ndị ahụ dabara adaba, ị nwere ike ịgụpụta omimi, ihe ngosi igwefoto, na egwuregwu fọrọ nke nta ka ọ bụrụ n'efu. Maka ihe karịrị onyonyo abụọ, DUSt3R na-arụ nhazi zuru ụwa ọnụ nke na-adụkọta maapụ ụzọ abụọ n'otu igwe ojii na-agbanwe agbanwe. Ọ na-arụ ọrụ ọbụlagodi na igwefoto enweghị akara yana nlele ole na ole nwere oghere n'ọtụtụ ebe.
Nghọta nka nka
Nsonaazụ bụ isi bụ maapụ: maapụ 2D-na-3D siri ike nke na-edobe pikselụ onyonyo ọ bụla na ebe 3D doro anya, yana onyonyo abụọ nke otu ụzọ tụgharịrị n'ime etiti nhazi igwefoto nke mbụ. N'ihi na nzikọrịta ozi pụtara n'ezoghị ọnụ na nhazi 3D na-ekekọrịta, nleba anya na ndakọrịta ga-abụ ihe agụpụta nke ala karịa ihe achọrọ. A Vision Transformer na cross-nlebara anya n'etiti abụọ image alaka na-ahapụ netwọk na-ejikọta ọnụ banyere ma echiche, ịmụta geometry kpọmkwem site na nnukwu datasets nke esere onyoonyo.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke DUST3R Dese 3D Nrụzigharị
DUSt3R kpalitere ahịrị ọrụ na-aga ngwa ngwa - MASt3R na-agbakwunye nha nha siri ike, yana nsonye na-aga n'ihu n'oge na ọtụtụ nlele nlele. Usoro a doro anya: geometry amụtara site na ngwụcha ruo na njedebe na-edochi ọkpọkọ ejiri aka arụrụ nke ọma. Na-atụ anya ka ụdị ihe atụ ndị a ga-eri nri ozugbo na SLAM, robotics, AR, na ọbụna mmalite Gaussian-splating, na-eme foto ekwentị nkịtị iji mepụta metric, 3D na-agbanwe agbanwe site na ihe fọrọ nke nta ka ọ bụrụ njide ọ bụla.
Mmejuputa n'ezie n'ụwa
Na-atụgharị foto ekwentị nkịtị ole na ole nke ime ụlọ ma ọ bụ ihe n'ime igwe ojii 3D nwere ike iji na-enweghị nyocha ọnọdụ igwefoto.
Na-eweghachite ọnọdụ igwefoto na omimi na bootstrap mgbada nwughari 3D ma ọ bụ ịgbasa Gaussian site na onyonyo na-enweghị atụ.
Na-ewughachi ihe nkiri sitere na ebe nchekwa ma ọ bụ foto ịntanetị ebe data nhazi igwefoto adịghị.
Na-enye atụmatụ geometry ọsọ ọsọ maka robotics na igodo AR site na nleba anya abụọ ma ọ bụ atọ.
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DUSt3R Dense 3D Reconstruction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Pipeline Magic3D ederede-gaa-3D
Ajụjụ a na-ajụkarị
What is DUSt3R Dense 3D Reconstruction?
DUSt3R na-ewughachi geometry 3D siri ike site na foto ndị nkịtị na-enweghị mkpa ọnọdụ igwefoto ama ama ma ọ bụ nhazi. Ọ na-akụda pipeline fotogrammetry ọdịnala ọdịnala n'ime otu netwọkụ akwara nke na-ewepụta isi ihe 3D.
Kedu isi ihe ozi DUst3R na-achọghị ka ntinye, n'adịghị ka nhazi-site-motion?
DUSt3R na-arụ ọrụ na igwefoto enweghị akara na ihe ngosi amaghi ama; ọ na-eme atụmatụ geometry ozugbo site na ihe onyonyo chara acha.
Kedu ihe nrụpụta etiti nke netwọk DUst3R na-eweghachite maka onyonyo ọ bụla?
DUST3R na-ebu amụma maka maapụ, na-ekenye pixel ọ bụla nhazi 3D siri ike, yana onyonyo abụọ nke otu ụzọ na etiti nhazi nkekọrịta.
N'ime ụzọ onyonyo DUSt3R, kedu etiti nhazi ka egosipụtara na maapụ abụọ ahụ?
A na-atụgharị maapụ ihe onyonyo abụọ a n'ime etiti nhazi igwefoto nke mbụ, nke na-eme ka geometry ha tụnyere ozugbo.
Kedu ka DUST3R si enweta ihe nrụnye igwefoto na pikselụ?
N'ihi na akwụkwọ ozi pụtara n'ezoghị ọnụ na nhazi 3D nkekọrịta, a na-agụpụta poses na egwuregwu site na maapụ karịa ka a na-ebu ụzọ dozie ya.
Kedu ka DUst3R si ejikwa ihe karịrị onyonyo ntinye abụọ?
Maka ọtụtụ nlele, DUSt3R na-agba ọsọ nhazi zuru ụwa ọnụ nke na-ejikọta maapụ ụzọ abụọ n'otu igwe ojii na-agbanwe agbanwe.