DUst3R Dinse 3D Sake Gina
DUST3R yana sake gina ginshiƙan 3D mai yawa daga ɗimbin hotuna na yau da kullun ba tare da buƙatar sanannun wuraren kamara ko daidaitawa ba.
Dubawa
It collapses the traditional multi-step photogrammetry pipeline into a single neural network that just outputs 3D points.
Zurfafa nutsewa
Sake ginawa na 3D na gargajiya (tsari-daga motsi da sitiriyo mai gani da yawa) sarka ce mai rauni: gano fasalulluka, daidaita su, ƙididdige wuraren kamara, mai triangular, sannan ƙara girma. Kowane mataki na iya gazawa, kuma yawanci kuna buƙatar hotuna masu cunkushe da yawa da sanannun abubuwan kamara. DUst3R (Wang et al., 2024) yana daidaita matsalar gaba ɗaya. Da aka ba da hotuna guda biyu kawai, cibiyar sadarwa ta tushen taswira kai tsaye tana mayar da 'taswirar ma'ana' ga kowannensu - haɗin gwiwar 3D mai girman kowane-pixel, dukansu an bayyana su cikin firam ɗin daidaitawa iri ɗaya. Daga waɗancan taswirorin madaidaitan za ku iya karanta zurfin zurfafa, hotunan kyamara, da matches kusan kyauta. Don fiye da hotuna biyu, DUST3R yana aiwatar da jeri na duniya wanda ke ɗinke duk taswirori iri-iri zuwa gajimare madaidaici ɗaya. Yana aiki ko da tare da kyamarori marasa daidaituwa da kaɗan, ra'ayoyi masu sarari.
Fahimtar Fasaha
Babban fitowar ita ce taswirar batu: taswirar taswirar 2D-zuwa-3D mai yawa wanda ke sanya kowane pixel na hoto a sarari na 3D, tare da duka hotunan biyu sun koma cikin firam ɗin daidaitawar kamara ta farko. Saboda wasiƙa ba ta da tushe a cikin haɗin kai na 3D, ƙididdigewa da daidaitawa sun zama abubuwan karantawa a ƙasa maimakon abubuwan da ake buƙata. Mai canza hangen nesa tare da mai da hankali tsakanin rassan hoto guda biyu yana ba da damar hanyar sadarwa tare da haɗin gwiwa game da ra'ayoyi biyu, koyan ilimin lissafi kai tsaye daga manyan bayanan da aka zayyana.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar DUst3R Dese 3D Sake Gina
DUSt3R ya haifar da layin aiki mai sauri - MASt3R yana ƙara madaidaicin madaidaicin madaidaici, kuma masu biyo baya suna turawa zuwa ga ainihin-lokaci da haɓakar kallo da yawa. Yanayin a bayyane yake: koyaswar lissafi na ƙarshe zuwa ƙarshe wanda ya maye gurbin bututun injinan hannu. Yi tsammanin waɗannan ƙirar taswira don ciyarwa kai tsaye zuwa cikin SLAM, robotics, AR, har ma da ƙaddamarwar Gaussian-splating, yin hotunan waya na yau da kullun don samar da ma'auni, daidaitaccen 3D daga kusan kowane kama.
Aiwatar da Gaskiyar Duniya
Juya ƴan hotunan wayar da ba a saba gani ba na ɗaki ko abu zuwa gajimare mai amfani na 3D ba tare da binciken wuraren kamara ba.
Maido da madaidaicin kamara da zurfin zuwa bootstrap na sake gina 3D na ƙasa ko Gaussian splatting daga tarkace, hotuna marasa ƙima.
Sake gina al'amuran daga ɗakunan ajiya ko hotunan intanit inda babu bayanan daidaita kyamara.
Samar da ƙididdige ƙididdiga masu sauri don robotics da kewayawa AR daga mahalli biyu ko uku kawai.
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DUSt3R Dense 3D Reconstruction quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Magic3D Rubutu-zuwa-3D Bututun
Tambayoyin da ake yawan yi
What is DUSt3R Dense 3D Reconstruction?
DUST3R yana sake gina ginshiƙan 3D mai yawa daga ɗimbin hotuna na yau da kullun ba tare da buƙatar sanannun wuraren kamara ko daidaitawa ba. Yana rushe bututun na'urar daukar hoto na gargajiya da yawa zuwa cibiyar sadarwa guda ɗaya wacce ke fitar da maki 3D kawai.
Wane maɓalli na bayanai ne DUst3R BAYA buƙata azaman shigarwa, sabanin tsari na al'ada-daga motsi?
DUst3R yana aiki tare da kyamarorin da ba a daidaita su ba da wuraren da ba a san su ba; yana ƙididdige lissafin lissafi kai tsaye daga ainihin hotuna.
Menene fitarwa na tsakiya wanda cibiyar sadarwar DUst3R ke komawa ga kowane hoto?
DUst3R yana annabta taswirar batu, yana ba kowane pixel madaidaicin daidaitawar 3D, tare da hotunan biyu a cikin firam ɗin daidaitawa.
A cikin nau'in hoto na DUST3R, wanne firam ɗin haɗin gwiwa aka bayyana duka taswirorin nuni a ciki?
Dukkan taswirorin hotuna biyu suna komawa cikin firam ɗin daidaitawar kamara ta farko, wanda ke sa lissafinsu ya yi daidai da kai tsaye.
Ta yaya DUST3R ke samun madaidaicin kyamara da matches pixel?
Saboda wasiƙa ba ta da tushe a cikin haɗin kai na 3D, ana karanta taswirori da matches daga taswirori maimakon a fara warware su.
Ta yaya DUst3R ke sarrafa hotuna fiye da shigarwa biyu?
Don ra'ayoyi da yawa, DUST3R yana gudanar da jeri na duniya wanda ke haɗa dukkan taswirori masu ma'ana guda biyu zuwa gajimare madaidaici ɗaya.