I-Zero-1-to-3 Novel View Diffusion
Uziro-1-kuya-3 uphendula isithombe esisodwa sento sibe izithombe zaleyo nto efanayo ebonwa kunoma iyiphi i-engeli entsha, kusetshenziswa imodeli yokusabalalisa efakwe esimweni sokuzungezisa kwekhamera oyicelayo.
Uhlolojikelele
It matters because it lets you reconstruct 3D-consistent views without ever scanning the object from multiple sides.
I-Deep Dive
I-Zero-1-to-3 (kusuka e-Columbia, 2023) iculela kahle i-Stable Diffusion ukuze ikwazi ukwenza ukuhlanganiswa kokubuka kwenoveli okungasho lutho ngesithombe esifakiwe esisodwa. Uyiphakela isithombe esisodwa kanye nokuguqulwa kwekhamera ehlobene (ukuzungezisa nokuhumusha okuncane), futhi imodeli ikhiqiza ukuthi into izobukeka kanjani kulowo mbono omusha. Umbono obalulekile ukuthi amamodeli amakhulu okusatshalaliswa kwe-2D, aqeqeshwe emaqoqweni amakhulu ezithombe zewebhu, athathe ngokungaguquki okubalulekile kwejometri kanye nokomzimba mayelana nendlela izinto ezibukeka ngayo ku-3D. Ngokulungisa kahle kudathasethi yezinto zokwenziwa ezinikezwe ngama-engeli amaningi ekhamera alawulwayo (kusetshenziswa i-Objaverse), imodeli ifunda ukwenza imephu lezo zangaphambili ekulawuleni ikhamera ingcaca. Ukubuka okukhiqizwayo kungabese kuphakela ukwakhiwa kabusha kwe-3D ezansi komfula.
I-Technical Insight
Izimo zemodeli kusithombe somthombo ngezindlela ezimbili: ukushumeka kwe-CLIP kuhlanganiswe nokuma kwekhamera okuhlobene (i-azimuth, ukuphakama, irediyasi) ukuze kuqondiswe ukunakwa okuphambene, kuyilapho isithombe esiluhlaza sixhunywe kusiteshi esicashile esinomsindo ukuze kugcinwe imininingwane emihle kanye nobunikazi. Ukuqeqeshwa kusebenzisa ama-triplets esithombe-isithombe-isithombe esinikezwe kusukela kuzinto ze-CAD, ngakho-ke inethiwekhi ifunda imephu elawulekayo phakathi kokushintsha kokubuka kanye noshintsho lwephikseli oluwumphumela.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lokuhlukaniswa kweNoveli ka-Zero-1-to-3
I-Zero-1-to-3 ithole igagasi lamapayipi wesithombe kuya ku-3D. Abalandelayo abanjengo-Zero123-XL, i-SyncDreamer, kanye ne-One-2-3-45 basunduzela ekuhambisaneni kokubukwa okuningi kanye nokuphuma ngokushesha, okuthembeke kakhulu kwe-3D mesh, kuyilapho ukuhlanganiswa ne-Gaussian Splatting kanye namamodeli amakhulu okwakha kabusha kuncipha isikhathi sokukhiqiza kusuka kumaminithi kuya kumasekhondi. Lindela ukufana kokubuka okuqinile, ukulungiswa okuphezulu, kanye nomhlaba wangempela (hhayi nje into yokwenziwa) njengoba lawa mamodeli okusakaza alawulekayo okubuka evuthwa abe amathuluzi ajwayelekile okudala okuqukethwe.
Ukuqaliswa Komhlaba Wangempela
Ikhiqiza ukubukwa okuphendukayo kwesithombe somkhiqizo owodwa ukuze ukufakwa kuhlu kwe-e-commerce kubonise into kusuka kuzo zonke izinhlangothi
I-Bootstrapping ye-3D mesh eyenziwe ngomumo yento kusuka kusifinyezo esisodwa socingo esingajwayelekile sokuhlola kuqala kwe-AR
Ukudala ubuciko obuyisethenjwa obunama-engeli amaningi obufanayo bomlingisi noma i-prop yabaculi bomqondo wegeyimu nefilimu
Ukondla ukubukwa kwenoveli ehlanganisiwe ku-NeRF noma ukwakhiwa kabusha kwe-Gaussian Splatting ukugcwalisa ijometri engabonakali
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Zero-1-to-3 Novel View Diffusion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-Novel View Synthesis
Imibuzo evame ukubuzwa
What is Zero-1-to-3 Novel View Diffusion?
Uziro-1-kuya-3 uphendula isithombe esisodwa sento sibe izithombe zaleyo nto efanayo ebonwa kunoma iyiphi i-engeli entsha, kusetshenziswa imodeli yokusabalalisa efakwe esimweni sokuzungezisa kwekhamera oyicelayo. Kubalulekile ngoba ikuvumela ukuthi wakhe kabusha ukubuka okungaguquguquki kwe-3D ngaphandle kokuskena into ezinhlangothini eziningi.
Iyini i-core input ethi Zero-1-to-3 edingekayo ngaphezu kwesithombe esisodwa ukuze ukhiqize ukubuka okusha?
I-Zero-1-to-3 ifakwe esimweni sesithombe esisodwa kanye nokuma kwekhamera okuhlobene, ngakho ucacisa ukuzungezisa nokuhumusha kumbono owufunayo.
I-Zero-1-to-3 yakhiwe ngokulungiswa kahle yiluphi uhlobo lwemodeli?
Ishuna kahle imodeli enkulu yokusabalalisa ye-2D eqeqeshwe kusengaphambili ukuze isebenzise okubalulekile kwejometri lawo mamodeli afundwe ngokusobala ezithombeni zewebhu.
Kungani imodeli yokusabalalisa ye-2D ingenza i-zero-shot yokubuka inoveli nhlobo?
Ukuqeqeshwa kwe-2D kwezinga elikhulu kunikeza ulwazi olungaguquki lokuthi izinto zivela kanjani ku-3D, lokho ukulungisa kahle kwenza kulawuleke ngokuma kwekhamera.
Iyiphi idathasethi yezinto ze-3D eyayimaphakathi ekuqeqesheni i-Zero-1-to-3?
Iqeqeshwe kuma-triplets esithombe-isithombe-isithombe esinikezwe kusukela kumaqoqo ezinto zokwenziwa ze-3D ezifana ne-Objaverse.
Igcinwa kanjani imininingwane emihle yomthombo wesithombe esizukulwaneni?
Isithombe esingahluziwe sihlanganiswe nesiteshi kokufihlekile okunomsindo (kanye nokushumeka kwe-CLIP ye-semantics) ukuze ubunikazi nemininingwane kuqhubeke.