Incamake
DUSt3R yubaka geometrike yuzuye ya 3D uhereye kumafoto asanzwe adakeneye imyanya ya kamera izwi cyangwa kalibrasi. Isenyuka umuyoboro gakondo wamafoto menshi yintambwe mumurongo umwe wimitsi usohora amanota ya 3D gusa.
DUSt3R Ubwinshi bwa 3D Kwiyubaka ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekana amashusho yo gusesengura, ibikorwa, no guhanga.
Kwibira cyane
Iyubakwa rya 3D rya kera (imiterere-kuva-yimuka wongeyeho stereo-nyinshi-reba stereo) ni urunigi rworoshye: gutahura ibiranga, kubihuza, kugereranya kamera ya kamera, mpandeshatu, hanyuma ikuzura. Buri cyiciro kirashobora kunanirwa, kandi mubisanzwe ukeneye amashusho menshi arengana hamwe na kamera izwi. DUSt3R (Wang et al., 2024) yongeye gukemura ikibazo cyose. Uhaye amashusho abiri gusa, umuyoboro ushingiye kuri transformateur usubiza mu buryo butaziguye 'pointmap' kuri buri - umurongo wuzuye kuri pigiseli ya 3D ihuza, byombi bigaragazwa muburyo bumwe. Uhereye kuri ibyo bishushanyo mbonera ushobora gusoma byimbitse, kamera yerekana, hamwe na match hafi yubusa. Kumashusho arenze abiri, DUSt3R ikora ihuza ryisi yose idoda ibice byombi byerekanwe muburyo bumwe. Ikora ndetse na kamera zidakurikiranwa hamwe na bike cyane, bigaragara cyane.
Ubushishozi
Ibisohoka byibanze ni ingingo yerekana: ikarita ya 2D-kuri-3D ishushanya buri pigiseli yishusho ahantu hagaragara 3D, hamwe namashusho yombi yabantu basubijwe mumashusho ya kamera ya mbere. Kuberako inzandiko zandikirwa mubikorwa bya 3D bisangiwe, kugereranya no guhuza bihinduka ibisomwa byo hasi aho kuba ibisabwa. Iyerekwa rya Vision hamwe no guhuza ibitekerezo hagati yamashami abiri yishusho areka urusobekerane rwibitekerezo hamwe kubyerekeranye byombi, wiga geometrie biturutse kumibare minini yerekana amashusho.
Kumenya DUSt3R Ubwinshi bwa 3D Kwiyubaka
DUSt3R yubaka geometrike yuzuye ya 3D uhereye kumafoto asanzwe adakeneye imyanya ya kamera izwi cyangwa kalibrasi. Isenyuka umuyoboro gakondo wamafoto menshi yintambwe mumurongo umwe wimitsi usohora amanota ya 3D gusa. DUSt3R Ubwinshi bwa 3D Kwiyubaka ni ibya mudasobwa-iyerekwa ryakazi risobanura cyangwa ritanga itangazamakuru ryerekana amashusho yo gusesengura, ibikorwa, no guhanga. Kugirango wubake byimbitse, fata DUSt3R Dense 3D Kwiyubaka nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mubimenyerezo, amakipe akomeye akoresha DUSt3R Dense 3D Kwiyubaka kuringaniza neza hamwe nibikorwa bifatika nkubwiza bwamakuru, itandukaniro ryamatara, hamwe nibirango bihoraho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego. Mugihe kimwe, uburenganzira bwishusho no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego.
AI igaragara irashobora guhita igenzura, gutahura, no gushushanya imirimo murwego. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa-Isi
Guhindura amashusho make ya terefone yicyumba cyangwa ikintu mubicu bikoreshwa bya 3D point utabanje gusuzuma aho kamera ihagaze.
Kugarura kamera yifoto nuburebure kugirango bootstrap yamanutse hasi ya 3D yongeye kwiyubaka cyangwa Gaussian itandukana kuva amashusho make, adahujwe.
Kongera kubaka amashusho yo mububiko cyangwa amafoto ya enterineti aho amakuru ya kalibrasi ataboneka.
Gutanga igereranya ryihuse rya robotics hamwe na AR kugendagenda kubintu bibiri cyangwa bitatu gusa.
Uburyo bwo Gushyira mu bikorwa
DUSt3R Kwiyubaka 3D Kwiyubaka mubikorwa
Guhindura amashusho make ya terefone yicyumba cyangwa ikintu mubicu bikoreshwa bya 3D point utabanje gusuzuma aho kamera ihagaze.
Guhindura amafoto make ya terefone yicyumba cyangwa ikintu mukigicu cyakoreshwa cya 3D point utabanje gusuzuma imyanya ya kamera Amakipe akunze kubona ibisubizo byiza mugihe asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
DUSt3R Kwiyubaka 3D Kwiyubaka mubikorwa
Kugarura kamera yifoto nuburebure kugirango bootstrap yamanutse hasi ya 3D yongeye kwiyubaka cyangwa Gaussian itandukana kuva amashusho make, adahujwe.
Kugarura kamera yerekana nuburebure kugirango bootstrap yamanutse yubaka 3D cyangwa Gaussian itandukana gake, amashusho adahwitse Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
DUSt3R Kwiyubaka 3D Kwiyubaka mubikorwa
Kongera kubaka amashusho yo mububiko cyangwa amafoto ya enterineti aho amakuru ya kalibrasi ataboneka.
Kongera kubaka amashusho avuye mububiko cyangwa amafoto ya interineti aho amakuru ya kalibrasi ya kamera ataboneka Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
DUSt3R Kwiyubaka 3D Kwiyubaka mubikorwa
Gutanga igereranya ryihuse rya robotics hamwe na AR kugendagenda kubintu bibiri cyangwa bitatu gusa.
Gutanga igereranya ryihuse rya geometrike kuri robo na AR kugendana uhereye kubintu bibiri cyangwa bitatu gusa Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.