Yaduwar Kallon Novel Zero-1-zuwa-3
Sifili-1-zuwa-3 yana juya hoto ɗaya na abu zuwa hotuna na wannan abu ɗaya da ake gani daga kowane sabon kusurwa, ta amfani da ƙirar yaduwa da aka sanya akan jujjuyar kyamarar da kuke nema.
Dubawa
It matters because it lets you reconstruct 3D-consistent views without ever scanning the object from multiple sides.
Zurfafa nutsewa
Sifili-1-zuwa-3 (daga Columbia, 2023) ingantaccen-tunes Stable Diffusion don haka zai iya aiwatar da haɗin ra'ayi na sifili-shot daga hoton shigarwa ɗaya. Kuna ciyar da shi hoto guda ɗaya tare da canjin kyamarar dangi (juyawa da ƙaramin fassarar), kuma ƙirar tana haifar da yadda abin zai yi kama da sabon ra'ayi. Babban ra'ayin shi ne cewa manyan nau'ikan watsawa na 2D, waɗanda aka horar da su akan ɗimbin hotunan gidan yanar gizo, sun mamaye fa'idodin lissafi da zahiri game da yadda abubuwa suke kama da 3D. Ta hanyar daidaitawa akan saitin bayanai na abubuwan da aka yi daga kusurwoyin kyamara da yawa (ta amfani da Objaverse), ƙirar tana koyon taswirar waɗanda suka rigaya zuwa ga sarrafa kyamarar bayyane. Ra'ayoyin da aka ƙirƙira na iya ciyar da sake gina 3D na ƙasa.
Fahimtar Fasaha
Sharuɗɗan ƙirar akan hoton tushen hanyoyi biyu: an haɗa haɗin CLIP tare da tsayawar kyamarar dangi (azimuth, ɗagawa, radius) don jan hankalin giciye, yayin da ɗanyen hoton yana tashe-tallafi zuwa latent mai hayaniya don haka ana adana cikakkun bayanai da ainihi. Horon yana amfani da hotuna uku-uku da aka yi daga abubuwan CAD, don haka hanyar sadarwar ta koyi yadda za a iya sarrafa taswira tsakanin canjin ra'ayi da sakamakon canjin pixel.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar Zero-1-zuwa-3 Novel View Diffusion
Sifili-1-zuwa-3 ya shuka guguwar bututun hoto-zuwa-3D. Masu nasara kamar Zero123-XL, SyncDreamer, da One-2-3-45 suna turawa zuwa daidaiton ra'ayi da yawa da sauri, mafi aminci na 3D mesh fitarwa, yayin da haɗin gwiwa tare da Gaussian Splatting da manyan sake ginawa na sake ginawa yana raguwa lokacin tsarawa daga mintuna zuwa sakan. Yi tsammanin daidaiton ra'ayi mai ƙarfi, ƙuduri mafi girma, da kuma ainihin duniya (ba kawai abu na roba ba) gabaɗaya yayin da waɗannan nau'ikan yaɗuwar ra'ayi ke girma zuwa daidaitattun kayan aikin don ƙirƙirar abun ciki.
Aiwatar da Gaskiyar Duniya
Ƙirƙirar ra'ayoyi masu juyawa na hoto ɗaya na samfur don haka lissafin kasuwancin e-commerce zai iya nuna abu daga kowane bangare
Haɓaka ragamar 3D da aka zayyana na abu daga hoton wayar yau da kullun don samfotin AR
Ƙirƙirar madaidaicin zane-zane mai nunin ɗabi'a na ɗabi'a ko talla don wasan kwaikwayo da masu fasahar fina-finai
Ciyar da haɗe-haɗen ra'ayoyin labari zuwa cikin NeRF ko Gaussian Splatting sake ginawa don cike juzu'in ganuwa.
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Zero-1-to-3 Novel View Diffusion quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Littafin Kallon Novel Synthesis
Tambayoyin da ake yawan yi
What is Zero-1-to-3 Novel View Diffusion?
Sifili-1-zuwa-3 yana juya hoto ɗaya na abu zuwa hotuna na wannan abu ɗaya da ake gani daga kowane sabon kusurwa, ta amfani da ƙirar yaduwa da aka sanya akan jujjuyar kyamarar da kuke nema. Yana da mahimmanci saboda yana ba ku damar sake gina ra'ayoyi-daidaitacce na 3D ba tare da taɓa bincika abu daga bangarori da yawa ba.
Menene ainihin shigar da Zero-1-zuwa-3 ke buƙata ban da hoto ɗaya don samar da sabon ra'ayi?
Zero-1-zuwa-3 yana da sharadi akan hoto guda tare da tsayawar kyamarar dangi, don haka za ku ƙididdige jujjuyawar da fassarar zuwa ra'ayi da ake so.
An gina sifili-1-zuwa-3 ta hanyar daidaitawa wane irin samfuri?
Yana da kyau-sauƙaƙa babban samfurin watsa shirye-shiryen 2D wanda aka riga aka horar don haka zai iya yin amfani da jumlolin da ke gaban waɗannan samfuran da aka koya a fakaice daga hotunan yanar gizo.
Me yasa samfurin watsawa na 2D zai iya yin haɗin ra'ayi na sabon labari kwata-kwata?
Babban horo na 2D yana ba da cikakkiyar masaniya game da yadda abubuwa ke bayyana a cikin 3D, wanda ingantaccen daidaitawa ke sa ana iya sarrafawa ta hanyar tsayawar kyamara.
Wane saitin bayanai na abubuwan 3D ya kasance tsakiyar horar da Zero-1-zuwa-3?
An horar da shi akan hoto-pose-hoto uku da aka yi daga manyan tarin abubuwa na 3D na roba kamar Objaverse.
Ta yaya aka adana kyawawan dalla-dallan hoton tushen a cikin tsarar?
Danyen hoton tashoshi ne-mai haɗawa zuwa latent mai hayaniya (tare da haɗakar da CLIP don ilimin tauhidi) don haka ainihi da cikakkun bayanai ke gudana.