Ƙimar Zurfin Yaɗa Marigold
Marigold yana sake fasalin samfurin watsa shirye-shiryen da aka riga aka horar (Stable Diffusion) don tsinkayar taswirorin zurfin zurfi sosai.
Dubawa
It shows you can turn a generator's rich visual knowledge into a precise perception tool with surprisingly little training data.
Zurfafa nutsewa
Marigold (ETH Zurich, CVPR 2024 Mafi kyawun Bayanin Takarda Mai Girma) yana sake fasalin ƙididdigewa mai zurfi azaman matsalar tsara yanayin yanayi. Maimakon horar da hanyar sadarwa mai zurfi daga karce, yana da kyau-saukar da Stable Diffusion don 'ƙirƙira' zurfin taswira mai sharadi akan hoton shigarwa. Hankali shine cewa samfurin da aka horar don haɗa hotunan hoto ya riga ya koyi ilimin lissafi, haske, da tsari mai zurfi a cikin sararin samaniyar sa, daidai abubuwan da ke da amfani ga zurfin. Abin sha'awa, Marigold ya kasance mai kyau-saukar akan saitin bayanan roba kawai (kamar Hypersim da Virtual KITTI) amma duk da haka ya cika da kyau ga ainihin hotuna sifili. Yana haifar da zurfin dangi mai banƙyama tare da kyawawan cikakkun bayanai na musamman, kodayake ƙin yarda ya sa ya yi hankali fiye da samfuran ciyarwa kamar DepthAnything.
Fahimtar Fasaha
Marigold yana aiki a cikin ɓoyewar sarari na Stable Diffusion. Duka hoton da taswirar zurfin suna VAE iri ɗaya ne; U-Net ɗin yana da kyau-saukarwa don ƙirƙira zurfin latent sharadi akan latent hoto mai tsabta. Bisa ga ƙididdigewa yana gudanar da daidaitaccen madaidaicin madaidaicin madauki, sannan yana yanke latent mai zurfi. Saboda samfuransa, ana iya haɗa gudummuwa da yawa don kwanciyar hankali, ƙididdige ciniki don daidaito. Daga baya 'LCM' da nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan iri) da masu siye da siye da siye da siye da siye da siye da siye da girkin girkin girkin girki da aka girka sun yanke matakan matakai da yawa zuwa fasfo guda.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar Ƙimar Zurfin Yaduwa ta Marigold
Girke-girke na Marigold, ingantaccen-daidaita yaduwa na gaba don tsinkaya mai yawa, yana gabaɗaya sama da zurfi zuwa yanayin al'ada, bazuwar hoto, da ƙimar kayan abu. Bambance-bambancen samfuri masu sauri da daidaito suna rufe tazarar gudu tare da hanyoyin ciyarwa na gaba, suna sa fahimtar tushen yadawa a cikin kayan aikin mu'amala. Yi tsammanin yanayi mai faɗi inda ƙashin baya ɗaya da aka riga aka horar da shi ya dace da yawancin lissafin lissafi da ayyuka na fahimta, yana rage buƙatar takamaiman ƙayyadaddun bayanai masu lakabin ɗawainiya.
Aiwatar da Gaskiyar Duniya
Ciro zurfin-tsara mai kyau daga gine-gine da hotunan samfur don haskakawa da izgili na 3D.
Samar da taswirorin zurfin daki-daki da aka yi amfani da su azaman sanyaya don sarrafa hoto da tsarar bidiyo.
Taimakawa fim ɗin da ƙungiyoyin VFX a cikin matte da aikin parallax inda daidaitattun abubuwan ke da mahimmanci.
Yin hidima azaman tushen bincike yana nuna yadda ake daidaita abubuwan ƙirƙira kafin ayyukan tsinkaya masu yawa.
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Marigold Diffusion Depth Estimation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Ƙimar Zurfin Juna
Tambayoyin da ake yawan yi
What is Marigold Diffusion Depth Estimation?
Marigold yana sake fasalin samfurin watsa shirye-shiryen da aka riga aka horar (Stable Diffusion) don tsinkayar taswirorin zurfin zurfi sosai. Yana nuna za ku iya juyar da wadataccen ilimin gani na janareta zuwa ainihin kayan aiki na fahimta tare da ƙarancin bayanan horo.
Wane samfurin da aka riga aka horar da Marigold ya gina akai?
Marigold yayi kyau-sautun da Stable Diffusion samfurin ɓoyayyiyar ɓarna don samar da taswira mai zurfi.
Ta yaya Marigold ke tsara aikin kimanta zurfin?
Yana ɗaukar zurfin a matsayin wani abu da za'a samar da shi akan hoton shigarwar, yana sake amfani da injunan watsawa.
Menene abin mamaki game da bayanan horo na Marigold?
An daidaita Marigold akan bayanan roba kamar Hypersim da Virtual KITTI amma yana ba da cikakken hoto zuwa ainihin hotuna.
Me yasa Marigold yawanci ya yi hankali fiye da ƙirar zurfafan ciyarwa?
Samfuran watsawa suna nuna rashin jin daɗi kan matakai da yawa, suna yin tunani a hankali fiye da wucewar gaba ɗaya.
A wanne sarari Marigold ke aiwatar da tsarin watsawa?
Dukansu hoto da zurfin an ɓoye su cikin sararin ɓoye na VAE inda U-Net ke ƙi.