Amabwiriza ya AI

Magic3D Umwandiko-Kuri-3D Umuyoboro

Magic3D nigisubizo cya NVIDIA ibyiciro bibiri kuri DreamFusion, bitanga ibisubizo bihanitse, birambuye 3D yibirimo byihuse.

2 min somaIbiherutse kuvugururwa

Incamake

It made SDS-based text-to-3D practical enough to hint at real creative workflows.

Kwibira cyane

Magic3D, ukomoka muri NVIDIA mu 2022, yibasiye ingingo ebyiri zibabaje za DreamFusion: gutinda kandi birambuye. Igabanya ibisekuru mubyiciro bito kandi byiza. Icyiciro kigufi gikoresha ikigereranyo gito cyo gukwirakwiza mbere hamwe na hash-grid yihuta ya neural field (Instant-NGP style) kugirango ihoshe geometrie. Umurima uhita uhindurwamo meshi ya mpandeshatu. Icyiciro cyiza gitezimbere iyi mesh muburyo butaziguye hamwe na verisiyo ihanitse yo gukwirakwiza (Stable Diffusion mumwanya wihishe), ukoresheje rasterisation itandukanye kugirango ityaze ubuso burambuye hamwe nimiterere. NVIDIA yatangaje ko yihuta ya 2x hejuru ya DreamFusion mugihe itanga ibisubizo bihanitse cyane-ibisubizo, kandi mesh isohoka irashobora guhindurwa muburyo bwibikoresho bisanzwe.

Ubushishozi

Icyiciro cyiza nicyo gifungura ubuziranenge. Mu kohereza umurima mubi kuri meshi itomoye no kuyihindura hamwe na rasterisation itandukanye, Magic3D ikoresha gradients ya SDS kumurongo mwinshi neza, ikintu kidashoboka hamwe na NeRF yuzuye. Gukoresha ikwirakwizwa rya kabiri mbere yumwanya wihishe ureke igenzure 512x512-ibyiciro-bihendutse bihendutse. Ikiganza-cyiza-cyiza bivuze ko buri cyiciro gikoresha icyerekezo gikwiranye nakazi kacyo: umurima utaziguye wa geometrie yihuse, mesh yo gutunganya neza.

Ingaruka z'Ingamba

Umuvuduko n'igipimo

AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.

Build choices

Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.

Itsinda hamwe nakazi

Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.

Kazoza ka Magic3D Umwandiko-kuri-3D Umuyoboro

Magic3D yashyizeho icyitegererezo cyiza-cyiza, mesh-itunganya inyandikorugero ubu isanzwe mubyanditswe-kuri-3D. Sisitemu nshya itera imbere cyane byihuse kugaburira-ibisekuruza byihuse, kureba-ibintu byinshi bihoraho kugirango bikosore ibihangano bya Janus, hamwe na Gaussian Splatting. Tegereza imiyoboro isohora umusaruro-witeguye, UV-mape, umutungo wa animasiyo mumasegonda kugeza kumunota, bigenda byinjizwa muburyo bwa moteri yimikino nibikoresho bya 3D kubashushanya.

Gushyira mu bikorwa Isi

Kubyara inshusho ihindagurika y '' igikeri cyubururu-dart igikeri kumazi ya lili 'uhereye mukanya

Gukora ibyemezo-bihanitse bya 3D byimikino kumikino byihuse kuruta DreamFusion

Guhindura byihuse gushingira aho guhindura inyandiko isubiramo moderi ya 3D iriho

Kohereza meshes muri Blender cyangwa moteri yimikino yo gusukura abahanzi na animasiyo

Ingaruka & Kurinda

Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.

Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.

Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.

Igishushanyo mbonera

1

Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.

2

Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.

3

Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.

4

Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Magic3D Text-to-3D Pipeline quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Igisekuru-Kuri-3D Igisekuru

Ibibazo bikunze kubazwa

What is Magic3D Text-to-3D Pipeline?

Magic3D nigisubizo cya NVIDIA ibyiciro bibiri kuri DreamFusion, bitanga ibisubizo bihanitse, birambuye 3D yibirimo byihuse. Cyakoze SDS ishingiye kumyandiko-kuri-3D ifatika bihagije kugirango yerekane ibikorwa byukuri byo guhanga.

Ni ubuhe buryo rusange busobanura umuyoboro wa Magic3D?

Magic3D ikoresha urwego ruto kuri geometrie yihuta kandi nicyiciro cyiza kubisobanuro birambuye.

Ni ubuhe buryo bwo kwerekana ibyiciro byiza bihindura ibisobanuro birambuye?

Umurima mubi uhindurwamo mesh, hanyuma ugatunganywa hamwe na rasterisation itandukanye kurwego rwo hejuru.

Niki cyihutisha igereranya rya geometrie igereranya?

Umuvuduko wihuse hash-grid ureka Magic3D ikabura geometrie byihuse kumurongo muke.

Nangahe byihuse NVIDIA yatangaje Magic3D kugirango ihure na DreamFusion?

Magic3D yatangaje hafi 2x yihuta mugihe nayo itanga ibisubizo bihanitse cyane.

Ni ukubera iki icyiciro cyiza gikwirakwiza mbere yacyo ahantu hihishe?

Umwanya-wo gukwirakwiza (Stable Diffusion style) ureka Magic3D ikayobora 512-ibyiciro birambuye nta kiguzi cya pigiseli-yuzuye yerekana.