Zeru-1-kuri-3 Ibishya Reba Gutandukana
Zeru-1-kuri-3 ihindura ifoto imwe yikintu mumashusho yikintu kimwe kiboneka muburyo ubwo aribwo bwose, ukoresheje moderi yo gukwirakwiza iteganijwe kuzunguruka kamera ubajije.
Incamake
It matters because it lets you reconstruct 3D-consistent views without ever scanning the object from multiple sides.
Kwibira cyane
Zeru-1-kuri-3 (kuva muri Columbiya, 2023) neza-neza neza Diffusion kuburyo ishobora gukora zeru-shusho yerekana igitabo cyerekana synthesis uhereye kumashusho yinjiza. Urayigaburira ishusho imwe wongeyeho kamera igereranya ihinduka (kuzunguruka hamwe nubusobanuro buto), kandi icyitegererezo kibyara icyo kintu cyaba gisa nukubona ibintu bishya. Igitekerezo cyingenzi nuko moderi nini ya 2D ikwirakwizwa, yatojwe kumurongo munini wamashusho yurubuga, yakiriye byimazeyo geometrike na physique yibanze kuburyo ibintu bisa muri 3D. Mugutondekanya neza kuri dataset yubukorikori bwibintu byatanzwe kuva kumpande nyinshi zagenzuwe (ukoresheje Objaverse), icyitegererezo cyiga gushushanya ibyo priors kugenzura kamera neza. Ibitekerezo byatanzwe birashobora kugaburira hasi ya 3D kwiyubaka.
Ubushishozi
Imiterere yicyitegererezo kumashusho yinkomoko inzira ebyiri: gushyiramo CLIP ihujwe na kamera igereranya (azimuth, ubutumburuke, radiyo) kugirango bayobore ibitekerezo, mugihe ishusho mbisi iba umuyoboro uhujwe nurusaku rwihishwa kuburyo burambuye kandi indangamuntu irabikwa. Amahugurwa akoresha ishusho-pose-ishusho ya gatatu yatanzwe mubintu bya CAD, bityo umuyoboro wiga ikarita igenzurwa hagati yimiterere ihinduka hamwe na pigiseli ihinduka.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka Zeru-1-kuri-3 Ibishya Reba Gutandukana
Zeru-1-kuri-3 yabibye umurongo w'amashusho-kuri-3D. Abasimbuye nka Zero123-XL, SyncDreamer, na One-2-3-45 basunika kugana ibintu byinshi kandi byihuse, byizewe cyane bya 3D mesh bisohoka, mugihe kwishyira hamwe na Gaussian Splatting hamwe nuburyo bunini bwo kwiyubaka bigenda bigabanya igihe cyibisekuruza kuva muminota kugeza kumasegonda. Tegereza uburyo bukomeye bwo kureba neza, gukemura hejuru, hamwe nukuri-kwisi (ntabwo ari ibintu gusa).
Gushyira mu bikorwa Isi
Kubyara impinduka zifoto yibicuruzwa bimwe kugirango urutonde rwa e-ubucuruzi rushobora kwerekana ikintu kumpande zose
Bootstrapping mesh ya 3D mesh yikintu uhereye kumashusho imwe ya terefone isanzwe kugirango AR ibone
Gukora ibihangano byinshi bifatika byerekana imiterere cyangwa prop kumikino nabahanzi ba firime
Kugaburira ibitekerezo bishya byerekanwe muri NeRF cyangwa Gaussian Splatting kwiyubaka kugirango yuzuze geometrie itagaragara
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Zero-1-to-3 Novel View Diffusion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ibishya Reba Synthesis
Ibibazo bikunze kubazwa
What is Zero-1-to-3 Novel View Diffusion?
Zeru-1-kuri-3 ihindura ifoto imwe yikintu mumashusho yikintu kimwe kiboneka muburyo ubwo aribwo bwose, ukoresheje moderi yo gukwirakwiza iteganijwe kuzunguruka kamera ubajije. Nibyingenzi kuko igufasha kongera kureba 3D-ihamye itarinze gusikana ikintu uhereye kumpande nyinshi.
Ni ubuhe butumwa bwibanze Zero-1-kuri-3 ikeneye hiyongereyeho ishusho imwe kugirango itange icyerekezo gishya?
Zeru-1-kuri-3 iteganijwe ku ishusho imwe hiyongereyeho kamera ifitanye isano, uragaragaza rero kuzenguruka no guhindura ibisobanuro wifuza.
Zeru-1-kuri-3 yubatswe no guhuza neza ni ubuhe bwoko?
Ihuza neza moderi nini ya 2D ikwirakwizwa kuburyo ishobora gukoresha geometrike yibanze izo moderi zize ku buryo butaziguye ku mashusho y'urubuga.
Ni ukubera iki moderi ya 2D ikwirakwiza ishobora gukora zeru-shusho yerekana amashusho yose?
Amahugurwa manini ya 2D atanga ubumenyi butaziguye bwuburyo ibintu bigaragara muri 3D, ibyo gutunganya neza bigatuma bigenzurwa hakoreshejwe kamera.
Nihe dataset yibintu bya 3D yari ingenzi mumahugurwa Zero-1-kuri-3?
Yahuguwe kumashusho-pose-shusho inshuro eshatu zakozwe mubikusanyirizo binini bya 3D byakusanyirijwe hamwe nka Objaverse.
Nigute ishusho yinkomoko yibintu byiza yabitswe mugisekuru?
Ishusho mbisi ni umuyoboro uhujwe no gusakuza rwihishwa (hamwe na CLIP yashyizwemo na semantique) bityo indangamuntu nibisobanuro bitwara.