Mgbasa nlele nke efu-1 ruo-3
Zero-1-to-3 na-atụgharị otu foto nke ihe ka ọ bụrụ onyonyo nke otu ihe ahụ a na-ahụ site na akụkụ ọhụrụ ọ bụla, na-eji ụdị mgbasa ozi etinyere na ntụgharị igwefoto ị rịọrọ.
Nchịkọta
It matters because it lets you reconstruct 3D-consistent views without ever scanning the object from multiple sides.
Ime miri emi
Zero-1-to-3 (nke sitere na Columbia, 2023) na-ada ụda Stable Diffusion nke ọma ka ọ nwee ike ịrụ nlegharị anya ọhụụ efu site na otu onyonyo ntinye. Ị na-enye ya otu foto gbakwunyere mgbanwe igwefoto ikwu (ntụgharị na obere ntụgharị), ihe nlereanya ahụ na-ewepụta ihe ihe ahụ ga-adị ka n'echiche ọhụrụ ahụ. Echiche bụ isi bụ na nnukwu ụdị mgbasa ozi 2D, zụrụ azụ na nnukwu mkpokọta onyonyo weebụ, etinyela uche n'ihe gbasara geometric na anụ ahụ n'ụzọ zuru ezu banyere otu ihe si dị na 3D. Site n'imezigharị nke ọma na ihe ndekọ ihe sịntetik nke ihe arụpụtara site n'ọtụtụ akụkụ igwefoto a na-achịkwa (na-eji Objaverse), ihe nlereanya ahụ na-amụta ịse eserese ndị bu ụzọ na njikwa igwefoto doro anya. Echiche ndị a na-emepụta nwere ike na-enye nri nwughari 3D ala.
Nghọta nka nka
Ọnọdụ ihe atụ dị na onyonyo isi mmalite ụzọ abụọ: ntinye CLIP na-ejikọta ya na igwefoto ikwu (azimuth, elu, radius) iji duzie nlebara anya n'ofe, ebe ihe onyonyo a na-edoghị anya bụ ọwa-gbakọnyere na latent mkpọtụ ka echekwara nkọwa zuru oke na njirimara. Ọzụzụ na-eji mbiet-pose-oyiyi triplet emepụtara site na ihe CAD, yabụ netwọk na-amụta maapụ a na-achịkwa n'etiti mgbanwe echiche na mgbanwe pikselụ na-esi na ya pụta.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke Mgbasa Nleba Ọhụụ Zero-1-to-3
Zero-1-na-3 wetara ebili mmiri nke paịpụ onyonyo gaa na-3D. Ndị na-aga nke ọma dị ka Zero123-XL, SyncDreamer, na One-2-3-45 na-aga n'ihu n'usoro nlele multi-view na ngwa ngwa, nke a pụrụ ịdabere na ya na mmepụta mesh 3D, ebe ijikọ na Gaussian Splating na nnukwu nwughari ụdị na-ebelata oge ọgbọ site na nkeji ruo sekọnd. Na-atụ anya nhụsianya siri ike, mkpebi dị elu na ụwa n'ezie (ọ bụghị naanị ihe sịntetik-ihe) n'ozuzu ka echiche ndị a na-achịkwa mgbasa ozi na-etolite n'ime ngwaọrụ ọkọlọtọ maka ịmepụta ọdịnaya.
Mmejuputa n'ezie n'ụwa
Ịmepụta echiche ntụgharị nke otu foto ngwaahịa ka ndepụta e-azụmahịa nwere ike igosi ihe ahụ n'akụkụ niile
Na-ebulite ntupu 3D ederede nke ihe site na otu foto ekwentị nkịtị maka nlebanya AR
Ịmepụta nka nrụtụ aka ọtụtụ akụkụ na-agbanwe agbanwe nke agwa ma ọ bụ nkwado maka egwuregwu na ndị na-ese ihe nkiri
Na-enye echiche ọhụrụ emepụtara n'ime NeRF ma ọ bụ Gaussian Splatting nwughari iji mejupụta geometry a na-adịghị ahụ anya.
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Zero-1-to-3 Novel View Diffusion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Synthesis Nlele Ọhụrụ
Ajụjụ a na-ajụkarị
What is Zero-1-to-3 Novel View Diffusion?
Zero-1-to-3 na-atụgharị otu foto nke ihe ka ọ bụrụ onyonyo nke otu ihe ahụ a na-ahụ site na akụkụ ọhụrụ ọ bụla, na-eji ụdị mgbasa ozi etinyere na ntụgharị igwefoto ị rịọrọ. Ọ dị mkpa n'ihi na ọ na-ahapụ gị ka ị rụgharịa nlele 3D na-agbanwe agbanwe na-enweghị nyocha ihe ahụ site n'ọtụtụ akụkụ.
Kedu ihe bụ isi ntinye Zero-1-na-3 chọrọ na mgbakwunye na otu onyonyo iji mepụta ọhụụ ọhụrụ?
Zero-1-to-3 ka edobere n'otu onyonyo gbakwunyere nrụnye igwefoto ikwu, yabụ ị kọwaa ntụgharị na ntụgharị asụsụ n'echiche achọrọ.
A na-ewu Zero-1-na-3 site na nhazi nke ọma nke ụdị ụdị?
Ọ na-edobe nnukwu ụdị mgbasa ozi 2D a zụrụ azụ ka ọ nwee ike irigbu ihe geometric tupu ụdị ndị ahụ amụtara n'ezoghị ọnụ na onyonyo weebụ.
Kedu ihe kpatara ụdị mgbasa ozi 2D ga-eji rụpụta nleba anya ọhụụ efu ma ọlị?
Ọzụzụ 2D buru ibu na-enye ihe ọmụma zuru oke banyere otu ihe si apụta na 3D, nke ngbanwe nke ọma na-eme ka a na-achịkwa ya site na ndorondoro igwefoto.
Kedu ihe ndekọ nke ihe 3D bụ isi n'ịzụ Zero-1-na-3?
A zụrụ ya n'ihe onyonyo-oyi atọ egosipụtara site na nnukwu mkpokọta ihe 3D sịntetịt dị ka Objaverse.
Kedu ka esi echekwa nkọwa zuru oke nke ihe oyiyi isi mmalite n'ọgbọ?
Onyonyo a na-adịghị ahụ anya bụ ọwa-kọbatara na latent mkpọtụ (n'akụkụ CLIP agbakwunyere maka semantics) yabụ njirimara na nkọwa zuru oke na-aga.