Ikigereranyo cyimbitse ya Marigold
Marigold yongeye kwerekana ishusho-yisekuru yerekana ikwirakwizwa (Stable Diffusion) kugirango ihanure amakarita yimbitse.
Incamake
It shows you can turn a generator's rich visual knowledge into a precise perception tool with surprisingly little training data.
Kwibira cyane
Marigold (ETH Zurich, CVPR 2024 Impapuro nziza Icyubahiro Cyiza) yongeye kugereranya uburebure bwimbitse nkikibazo cyibisekuruza. Aho guhugura umuyoboro wimbitse kuva kera, uhuza neza Diffusion Stable kugirango 'ubyare' ikarita yimbitse iteganijwe kumashusho yinjira. Ubushishozi nuko icyitegererezo cyatojwe gushushanya amashusho yifotozi yamaze kwiga geometrie, kumurika, nuburyo bwimbitse mumwanya wacyo wihishe, neza na priors ifite akamaro kubwimbitse. Igitangaje, Marigold yatunganijwe neza kuri dataseti gusa (nka Hypersim na Virtual KITTI) nyamara yerekana neza kumafoto nyayo zeru. Itanga affine-invariant igereranije ubujyakuzimu hamwe nibisobanuro byiza bidasanzwe, nubwo itera itera itinda cyane kuruta kugaburira imbere-moderi nka Byimbitse.
Ubushishozi
Marigold ikorera mumwanya wihishe wa Stable Diffusion. Byombi ishusho hamwe nikarita yimbitse byashyizweho na VAE imwe; U-Net yatunganijwe neza kugirango yerekane ubujyakuzimu bwihishwa buteganijwe ku ishusho isukuye neza. Mugusuzuma ikora ibisanzwe itera itera, hanyuma ikuramo ubujyakuzimu bwihishe. Kuberako ibyitegererezo, kwiruka byinshi birashobora guhurizwa hamwe kugirango bihamye, gucuruza kubara kubwukuri. Nyuma 'LCM' hamwe nintambwe imwe yatandukanijwe verisiyo igabanya intambwe nyinshi kumurongo kugeza kumurongo umwe.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Ejo hazaza ha Marigold Diffusion Ikigereranyo Cyimbitse
Ikirangantego cya Marigold, kuringaniza neza ikwirakwizwa ryibanze ryo guhanura kwinshi, ni rusange muri rusange birenze ubujyakuzimu kugeza ku buso busanzwe, ishusho yimbere, no kugereranya ibintu. Impinduka zihuse kandi zihoraho-moderi zifunga kuziba icyuho cyihuta hamwe nimiyoboro igaburira imbere, bigatuma imyumvire ishingiye ku gukwirakwiza iboneka mubikoresho byifashishwa. Tegereza inzira yagutse aho umuntu yabanje kubyara umugongo wahujwe na geometrie myinshi hamwe nimirimo yo kwiyumvisha, bikagabanya gukenera imirimo minini yihariye yerekana imibare.
Gushyira mu bikorwa Isi
Gukuramo ubujyakuzimu bwiza uhereye kumafoto yububiko hamwe nibicuruzwa byo kumurika no gushinyagura 3D.
Gukora amakarita arambuye yerekana ikarita ikoreshwa nkibisabwa kugirango igenzurwe kandi ikore amashusho.
Gufasha firime hamwe na VFX mumatsinda ya matte na parallax ikora aho impande zisobanutse neza.
Gukora nkibyingenzi byubushakashatsi byerekana uburyo bwo guhuza ibikorwa byabyara imirimo myinshi yo guhanura.
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Marigold Diffusion Depth Estimation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Ikigereranyo cyimbitse ya Monocular
Ibibazo bikunze kubazwa
What is Marigold Diffusion Depth Estimation?
Marigold yongeye kwerekana ishusho-yisekuru yerekana ikwirakwizwa (Stable Diffusion) kugirango ihanure amakarita yimbitse. Irerekana ko ushobora guhindura ubumenyi bukungahaye bwa generator mubikoresho byukuri byo gutahura hamwe nibitangaje bito byamahugurwa.
Ni ubuhe buryo bwateganijwe Marigold yubakiyeho?
Marigold neza-itondekanya Stable Diffusion yihishe ikwirakwizwa kugirango ikore amakarita yimbitse.
Nigute Marigold akora umurimo wo kugereranya ubujyakuzimu?
Ifata ubujyakuzimu nkikintu cyo 'kubyara' giteganijwe ku ishusho yinjiza, ikongera gukoresha imashini ikwirakwizwa.
Niki cyatangaje amakuru yamahugurwa ya Marigold?
Marigold yakurikiranwe neza kumakuru yubukorikori nka Hypersim na Virtual KITTI ariko ashyira zero-amafoto kumafoto nyayo.
Ni ukubera iki Marigold itinda cyane kuruta kugaburira-ubujyakuzimu bwimbitse?
Moderi ya Diffusion yerekana intambwe nyinshi, bigatuma umwanzuro utinda kurenza inzira imwe yimbere.
Ni uwuhe mwanya Marigold akora inzira yo gukwirakwiza?
Ishusho nuburebure byombi byashyizwe mumwanya wihishe VAE aho U-Net yerekana.