Xayma xóotaayu tasaaroo Marigold
Marigold dafay jëfandikoowaat xeetu diffusion buñ tàggat bu njëkk (Diffusion Stable) ngir mëna wax luy waaja am ci kàrtu xóotaayu xóotaayu.
Résumé
It shows you can turn a generator's rich visual knowledge into a precise perception tool with surprisingly little training data.
Plongeur bu xóot
Marigold (ETH Zurich, CVPR 2024 Këyit bi gëna baax ci njukkal) dafay soppi xayma xóotaayu ni jafe-jafe defar bu lalu ci sart. Du tàggat ab reso bu xóot ci noonu, dafay defar Diffusion bu dëgër ngir 'defar' ab kàrtu xóotaayu conditionné ci ab nataal buñ dugal. Li ñuy gis mooy model biñ tàggat ngir defar nataali fotorealistik jàngoon na geometrie seen, leeraay, ak structure bu xóot ci espace bu nëbbu bi, gëna gën priors yi am njariñ ci xóotaayu. Lu yéeme mooy, Marigold dañu ko defar bu baax ci ay done yuñ defaree ay done (lu melni Hypersim ak Virtual KITTI) waaye mingi yamale bu baax ci nataal yu dëggu yi. Dafay defar xóotaayu affine-invariant ak ay detay yu rafet lool, waaye denoising biy baamtu daf koy gëna yeex yeneen xeetu feed-forward yu melni DepthAnything.
Gis-gis xarala
Marigold mingi liggéey ci barab bu nëbbu bu diffusion stabil. Nataal bi ak kàrtu xóotaayu ñoom ñaar benn VAE moo leen kode; U-Net bi dañu ko defar bu baax ngir dindi bruit bu xóot bu nëbbu bi lalu ci nataal bu nëbbu bu sell bi. Ci inference dafay def bouclage denoising iteratif buñ miin, ba noppi dekode xóotaayu latente bi. Ndax dafay misaal, mën nañu boole ay daw yu bari ngir dakkal, jënd ak jaay xayma ngir gëna jub. Ginaaw loolu 'LCM' ak benn-jéego distiye versions dagg fukki-fukki jéego wàcci benn pass.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Xayma xóotaayu tasaaroo Marigold ëlëg
Reset bu Marigold, defar diffusion bi njëkk ngir wax luy waaja am, dafay yamale lu ëpp xóotaayu surface normal yi, decomposition nataal bi ci biir, ak xayma macceer bi. Xeetu distiye yu gëna gaaw ak anam yu méngoo dañuy tëj bërëb bi ci gaawaay bi ak reso feed-forward yi, tax gis-gis bu lalu ci diffusion mën na nekk ci jumtukaayi weccoo xalaat. Xaarandil tendaas bu gëna yaatu fu benn yaxu ndigg buñ tàggat bu njëkk mën ànd ak liggéey yu bari ci geometrie ak gis-gis, wàññi soxla liggéey yu bari yuñ etikete.
Doxal ci àdduna dëgg
Di génne xóotaayu pepp yu sew ci nataali architecture ak produit ngir leeralaat ak maquette 3D.
Defar kàrtu xóotaayu detaay yu bari yuñ jëfandikoo ngir defar nataal ak wideo yuñ mëna saytu.
Jàppale ekipu filmu ak VFX ci liggéeyu matt ak parallax fu njubte gi am solo.
Dina nekk royuwaayu gëstu buy wane ni ñuy méngale ay prior generatif ak ay liggéey yu dëgër yuy wax luy am.
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Marigold Diffusion Depth Estimation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Xayma xóotaayu monokulaar
Laaj yi ñuy faral di laaj
What is Marigold Diffusion Depth Estimation?
Marigold dafay jëfandikoowaat xeetu diffusion buñ tàggat bu njëkk (Diffusion Stable) ngir mëna wax luy waaja am ci kàrtu xóotaayu xóotaayu. Dafay wane ni mën nga soppi xam-xam bu bari bi generator bi am ci wàllu gis-gis, mu nekk jumtukaayu gis-gis bu leer, te amul benn done bu yéeme ci tàggat.
Ban xeetu tàggat la Marigold tabax ci?
Marigold dafay gëna suqali xeetu diffusion bu nëbbu bi ngir defar kàrtu xóotaayu diffusion.
Naka la Marigold di def ngir xayma xóotaayu liggéey bi?
Dafay jàppee xóotaayu mbir ni luñu wara 'genere' ci nataalu dugal bi, jëfandikoowaat masinu diffusion.
Lan moo yéeme ci done yu Marigold ci tàggat yaram?
Marigold deñ kaa defar bu baax ci ay done yuñ defaree ay done yu melni Hypersim ak Virtual KITTI waaye dafay yamale nataal yu amul dara ci nataal yu dëggu yi.
Lan moo waral Marigold di gëna néew doole ci xeetu xóotaayu feed-forward yi?
Modèle diffusion yi denoise ci jéego yu bari, tax inference bi gëna yeex benn passe ci kanam.
Ci ban barab la Marigold di defee liggéeyam ci diffusion?
Nataal bi ak xóotaayu ñoom ñaar ñu ngi kode ci barab bu nëbbu bu VAE bi U-Net di denoise.