InoteveraGaidhi rinotevera
Vadivelu Comedy Novel View Synthesis
AI Yekutarisa
Gwara reVisual AI
Zero-1-to-3 Novel View Diffusion
Zero-1-kusvika-3 inoshandura pikicha imwe chete yechinhu kuita mifananidzo yechinhu chimwe chete chinoonekwa kubva kune chero kona nyowani, uchishandisa diffusion modhi yakamisikidzwa pakutenderera kwekamera yaunokumbira.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Pa peji ino2 min verenga
Pfupiso
It matters because it lets you reconstruct 3D-consistent views without ever scanning the object from multiple sides.
Kudzika Kwakadzika
Zero-1-kusvika-3 (kubva kuColumbia, 2023) yakanaka-tunes Yakagadzika Diffusion kuitira kuti iite zero-shot novel kuona synthesis kubva kune imwe yekuisa mufananidzo. Unoidyisa mufananidzo mumwe chete pamwe neshanduko yekamera (kutenderera uye shandurudzo diki), uye modhi inogadzira izvo chinhu chingataridzika kubva pamaonero matsva aya. Pfungwa yakakosha ndeyekuti hombe 2D yekuparadzira modhi, yakadzidziswa pahombe yewebhu mifananidzo yakaunganidzwa, yakanyatso tora geometric uye yemuviri pres pamusoro pekuti zvinhu zvinotaridzika sei mu3D. Nekugadzirisa zvakanaka padhata rekugadzira rezvinhu zvinopihwa kubva kune akawanda anodzorwa kamera angles (uchishandisa Objaverse), modhi inodzidza kumepu izvo zvinotangira pane yakajeka kamera kutonga. Maonero akagadzirwa anogona kuzodyisa kudzika kwe3D kuvakazve.
Kuitwa muNyika yeChokwadi
Kugadzira maonero anotendeuka echigadzirwa chimwe chete kuitira kuti e-commerce rondedzero iratidze chinhu kubva kumativi ese
Bootstrapping yakashongedzerwa 3D mesh yechinhu kubva kune imwe yakajairika foni snapshot yekutarisisa AR.
Kugadzira anowirirana akawanda-ekona referefeta art yemunhu kana prop yemutambo uye firimu concept artists
Kudyisa maonerwo akaitwa novel muNeRF kana Gaussian Splatting kuvakazve kuzadza isingaonekwi geometry.
Ramangwana reZero-1-ku-3 Novel View Diffusion
Zero-1-ku-3 yakadyara masaisai emufananidzo-ku-3D mapaipi. Vatsivi vakaita seZero123-XL, SyncDreamer, uye One-2-3-45 kusundidzira kwakanangana nekuona kwakawanda uye nekukurumidza, kwakavimbika 3D mesh kubuda, uku kubatanidzwa neGaussian Splatting uye mahombe ekuvaka patsva kuri kupera nguva yechizvarwa kubva pamaminetsi kuenda kumasekonzi. Tarisira kusimba kwemaonero, kugadzirisa kwepamusoro, uye nyika chaiyo (kwete kungogadzirwa-chinhu) kudzokororwa sezvo aya mamodheru anodzoreka-anodzoreka anokura kuita maturusi akajairwa ekugadzira zvirimo.
Kuzvishandisa
Nei zvichikosha
- Kumhanya uye chiyero. Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
- Vaka sarudzo. Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
- Team uye workflow. Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Chenjera
- Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
- Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
- Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Matanho anotevera
- Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
- Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
- Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
- Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Tsamba yemahara
Tora iyo yemazuva ese AI pfupiso
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Take the Zero-1-to-3 Novel View Diffusion quiz
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Mibvunzo inowanzo bvunzwa
What is Zero-1-to-3 Novel View Diffusion?
Zero-1-kusvika-3 inoshandura pikicha imwe chete yechinhu kuita mifananidzo yechinhu chimwe chete chinoonekwa kubva kune chero kona nyowani, uchishandisa diffusion modhi yakamisikidzwa pakutenderera kwekamera yaunokumbira. Izvo zvine basa nekuti zvinokutendera kuti uvakezve 3D-inopindirana maonero usingambotarise chinhu kubva kumativi akawanda.
Ndeipi yepakati pekuisa Zero-1-ku-3 inoda mukuwedzera kune imwechete mufananidzo kugadzira maonero matsva?
Zero-1-kusvika-3 inoiswa pamufananidzo mumwe chete pamwe neinomira kamera, saka unotsanangura kutenderera neshanduro kune yaunoda maonero.
Zero-1-ku-3 inovakwa nekunyatso-tuning rudzii rwemuenzaniso?
Iyo inokwenenzvera yakakura yakafanodzidziswa 2D diffusion modhi kuitira kuti ishandise iyo geometric pres iwo mamodheru akadzidzwa kubva pawebhu mifananidzo.
Sei iyo 2D yekuparadzira modhi ichigona kuita zero-shot novel kuona synthesis zvachose?
Kudzidziswa kwakakura kwe2D kunopa ruzivo rwakakwana rwekuti zvinhu zvinoonekwa sei mu 3D, iyo yakanaka-tuning inoita kuti idzoreke kuburikidza nekamera pose.
Ndeipi dhatasethi yezvinhu zve3D yaive pakati pekudzidzisa Zero-1-kusvika-3?
Yakadzidziswa pamufananidzo-pose-image triplets yakashandurwa kubva kune yakakura synthetic 3D chinhu muunganidzwa senge Objaverse.
Tsanangudzo yakanaka yemufananidzo inochengetedzwa sei muchizvarwa?
Mufananidzo wakasvibirira wakabatanidzwa kune ruzha rwakadzika (padivi peCLIP yekumisikidza ye semantics) saka chitupa uye ruzivo rwunopfuura.
Ramba uchidzidza
Mazano anoenderana
Mamwe madhairekitori akasarudzirwa nyaya iyi