Ntụle omimi nke Marigold Diffusion
Marigold na-atụgharịrị ụdị mgbasa ozi-ihe onyonyo a zụrụ azụ (Stable Diffusion) iji buo maapụ omimi zuru oke.
Nchịkọta
It shows you can turn a generator's rich visual knowledge into a precise perception tool with surprisingly little training data.
Ime miri emi
Marigold (ETH Zurich, CVPR 2024 Kachasị Mma Akwụkwọ Ọsọpụrụ aha) na-emezi atụmatụ omimi dị ka nsogbu ọgbọ nke ọnọdụ. Kama ịzụ netwọk dị omimi site na ọkọ, ọ na-ada ụda Stable Diffusion ka ọ 'mepụta' maapụ omimi nke dabara na onyonyo ntinye. Nghọta a bụ na ihe nlereanya a zụrụ azụ iji megharịa onyonyo foto adịlarị amụtala geometry, ọkụ, na usoro n'ime oghere ya, kpọmkwem ihe mbụ bara uru maka omimi. N'ụzọ dị ịrịba ama, Marigold na-ege ntị nke ọma na naanị datasets sịntetik (dị ka Hypersim na Virtual KITTI) ma na-agbakọta nke ọma na foto efu efu. Ọ na-emepụta ịdị omimi nke affine na-enweghị atụ na nkọwa zuru oke nke ukwuu, ọ bụ ezie na nkwuputa okwu ahụ na-eme ka ọ dị nwayọ karịa ụdị ndị na-ebugharị nri dị ka DepthAnything.
Nghọta nka nka
Marigold na-arụ ọrụ na oghere nzuzo Stable Diffusion. A na-etinye ma oyiyi ahụ na maapụ omimi site na otu VAE; U-Net dị mma ka emebere ya ka ọ ghara imebi ihe omimi nke etinyere na latent onyonyo dị ọcha. N'ịtụle ya, ọ na-agba ọsọ akara akaghị aka, wee depụta akara nzuzo nke omimi. N'ihi na ọ tụrụ atụ, enwere ike ịchịkọta ọtụtụ ọsọ maka nkwụsi ike, ịgbakọ azụmaahịa maka izi ezi. Ka emechara 'LCM' na ụdị mgbagha otu nzọụkwụ wepụrụ ọtụtụ usoro mgbada ruo otu ngafe.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke nleba anya omimi nke Marigold
Ntụziaka Marigold, nhazigharị nke ọma maka amụma dị oke egwu, na-agbasawanye karịa omimi ruo n'elu nkịtị, mwepu onyonyo dị n'ime, yana nleba anya ihe onwunwe. Ụdịdị ụdịdị dị iche iche na-agbanwe ngwa ngwa na nke na-agbanwe agbanwe na-emechi oghere ọsọ site na netwọk ndị na-ebuga nri, na-eme ka nghọta dabere na mgbasawanye na ngwaọrụ mmekọrịta. Na-atụ anya ka a na-emewanyewanye ebe otu ọkpụkpụ azụ azụ azụ azụ na-adaba na ọtụtụ geometry na ọrụ nghọta, na-ebelata mkpa maka nnukwu ọrụ-kpọmkwem datasets.
Mmejuputa n'ezie n'ụwa
Na-ewepụta omimi dị mma site na foto ụkpụrụ ụlọ na ngwaahịa maka nlegharị anya na ịkwa emo 3D.
Ịmepụta maapụ omimi zuru oke ejiri dị ka ihe ndozi maka onyonyo na ọgbọ vidiyo nwere ike ịchịkwa.
Ihe nkiri na-enyere aka na ndị otu VFX na matte na parallax na-arụ ọrụ ebe njedebe dị oke mkpa.
Na-eje ozi dị ka ntọala nyocha na-egosi otu esi eme mgbanwe maka nrụpụta tupu arụ ọrụ ibu amụma.
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Marigold Diffusion Depth Estimation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ntụle omimi nke monocular
Ajụjụ a na-ajụkarị
What is Marigold Diffusion Depth Estimation?
Marigold na-atụgharịrị ụdị mgbasa ozi-ihe onyonyo a zụrụ azụ (Stable Diffusion) iji buo maapụ omimi zuru oke. Ọ na-egosi na ị nwere ike ịtụgharị ihe ọmụma nhụsianya bara ụba nke generator ka ọ bụrụ ngwaọrụ nghọta nke nwere obere data ọzụzụ dị ịtụnanya.
Kedu ihe nlereanya a zụrụ azụ nke Marigold na-ewu na ya?
Marigold dị mma na-akụ ụdị mgbasa ozi Stable Diffusion ka ọ mepụta maapụ omimi.
Kedu ka Marigold si ahazi ọrụ nleba anya omimi?
Ọ na-ewere omimi dị ka ihe a ga-eme 'mepụtara' n'ọnọdụ dị n'onyinyo ntinye, na-eji igwe mgbasa ozi.
Kedu ihe dị ịtụnanya gbasara data ọzụzụ Marigold?
A na-enyocha Marigold nke ọma na data sịntetik dị ka Hypersim na Virtual KITTI mana na-akọwapụta foto efu n'ezie.
Kedu ihe kpatara Marigold ji eji nwayọ karịa ụdị omimi nke na-aga n'ihu?
Ụdị mgbasa ozi na-ekwupụta n'elu ọtụtụ nzọụkwụ, na-eme ka ntuba dị nwayọọ karịa otu ngafe na-aga n'ihu.
Kedu oghere Marigold na-arụ usoro mgbasa ya?
A na-etinye ma onyonyo na omimi n'ime oghere VAE latent ebe U-Net na-ekwupụta.