Amabwiriza ya AI

Zeru-1-kuri-3 Ibishya Reba Gutandukana

Zeru-1-kuri-3 ihindura ifoto imwe yikintu mumashusho yikintu kimwe kiboneka muburyo ubwo aribwo bwose, ukoresheje moderi yo gukwirakwiza iteganijwe kuzunguruka kamera ubajije.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka Zeru-1-kuri-3 Ibishya Reba Gutandukana
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

It matters because it lets you reconstruct 3D-consistent views without ever scanning the object from multiple sides.

Kwibira cyane

Zeru-1-kuri-3 (kuva muri Columbiya, 2023) neza-neza neza Diffusion kuburyo ishobora gukora zeru-shusho yerekana igitabo cyerekana synthesis uhereye kumashusho yinjiza. Urayigaburira ishusho imwe wongeyeho kamera igereranya ihinduka (kuzunguruka hamwe nubusobanuro buto), kandi icyitegererezo kibyara icyo kintu cyaba gisa nukubona ibintu bishya. Igitekerezo cyingenzi nuko moderi nini ya 2D ikwirakwizwa, yatojwe kumurongo munini wamashusho yurubuga, yakiriye byimazeyo geometrike na physique yibanze kuburyo ibintu bisa muri 3D. Mugutondekanya neza kuri dataset yubukorikori bwibintu byatanzwe kuva kumpande nyinshi zagenzuwe (ukoresheje Objaverse), icyitegererezo cyiga gushushanya ibyo priors kugenzura kamera neza. Ibitekerezo byatanzwe birashobora kugaburira hasi ya 3D kwiyubaka.

Gushyira mu bikorwa Isi

Kubyara impinduka zifoto yibicuruzwa bimwe kugirango urutonde rwa e-ubucuruzi rushobora kwerekana ikintu kumpande zose

Bootstrapping mesh ya 3D mesh yikintu uhereye kumashusho imwe ya terefone isanzwe kugirango AR ibone

Gukora ibihangano byinshi bifatika byerekana imiterere cyangwa prop kumikino nabahanzi ba firime

Kugaburira ibitekerezo bishya byerekanwe muri NeRF cyangwa Gaussian Splatting kwiyubaka kugirango yuzuze geometrie itagaragara

Kazoza ka Zeru-1-kuri-3 Ibishya Reba Gutandukana

Zeru-1-kuri-3 yabibye umurongo w'amashusho-kuri-3D. Abasimbuye nka Zero123-XL, SyncDreamer, na One-2-3-45 basunika kugana ibintu byinshi kandi byihuse, byizewe cyane bya 3D mesh bisohoka, mugihe kwishyira hamwe na Gaussian Splatting hamwe nuburyo bunini bwo kwiyubaka bigenda bigabanya igihe cyibisekuruza kuva muminota kugeza kumasegonda. Tegereza uburyo bukomeye bwo kureba neza, gukemura hejuru, hamwe nukuri-kwisi (ntabwo ari ibintu gusa).

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Umuvuduko n'igipimo. AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
  • Kubaka amahitamo. Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
  • Itsinda hamwe nakazi. Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Witondere

  • Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
  • Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
  • Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Intambwe ikurikira

  1. Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
  2. Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
  3. Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
  4. Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Zero-1-to-3 Novel View Diffusion quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Zero-1-to-3 Novel View Diffusion?

Zeru-1-kuri-3 ihindura ifoto imwe yikintu mumashusho yikintu kimwe kiboneka muburyo ubwo aribwo bwose, ukoresheje moderi yo gukwirakwiza iteganijwe kuzunguruka kamera ubajije. Nibyingenzi kuko igufasha kongera kureba 3D-ihamye itarinze gusikana ikintu uhereye kumpande nyinshi.

Ni ubuhe butumwa bwibanze Zero-1-kuri-3 ikeneye hiyongereyeho ishusho imwe kugirango itange icyerekezo gishya?

Zeru-1-kuri-3 iteganijwe ku ishusho imwe hiyongereyeho kamera ifitanye isano, uragaragaza rero kuzenguruka no guhindura ibisobanuro wifuza.

Zeru-1-kuri-3 yubatswe no guhuza neza ni ubuhe bwoko?

Ihuza neza moderi nini ya 2D ikwirakwizwa kuburyo ishobora gukoresha geometrike yibanze izo moderi zize ku buryo butaziguye ku mashusho y'urubuga.

Ni ukubera iki moderi ya 2D ikwirakwiza ishobora gukora zeru-shusho yerekana amashusho yose?

Amahugurwa manini ya 2D atanga ubumenyi butaziguye bwuburyo ibintu bigaragara muri 3D, ibyo gutunganya neza bigatuma bigenzurwa hakoreshejwe kamera.

Nihe dataset yibintu bya 3D yari ingenzi mumahugurwa Zero-1-kuri-3?

Yahuguwe kumashusho-pose-shusho inshuro eshatu zakozwe mubikusanyirizo binini bya 3D byakusanyirijwe hamwe nka Objaverse.

Nigute ishusho yinkomoko yibintu byiza yabitswe mugisekuru?

Ishusho mbisi ni umuyoboro uhujwe no gusakuza rwihishwa (hamwe na CLIP yashyizwemo na semantique) bityo indangamuntu nibisobanuro bitwara.