Ntuziaka Visual AI

Pipeline Magic3D ederede-gaa-3D

Magic3D bụ azịza nke abụọ NVIDIA na DreamFusion, na-arụpụta mkpebi dị elu, ọdịnaya 3D zuru ezu karịa ngwa ngwa.

2 nkeji na-agụEmelitere ikpeazụ

Nchịkọta

It made SDS-based text-to-3D practical enough to hint at real creative workflows.

Ime miri emi

Magic3D, sitere na NVIDIA na 2022, wakporo DreamFusion isi ihe mgbu abụọ kachasị: nwayọ na nkọwa dị ala. Ọ na-ekewa ọgbọ ka ọ bụrụ ọkwa na-enweghị isi na ọkwa mara mma. Ogbo ahụ na-adịghị ahụkebe na-eji mgbasa ozi dị obere tupu ya enwee oghere akwara hash-grid ngwa ngwa (ụdị ngwa ngwa-NGP) iji wepụta geometry ngwa ngwa. A na-atụgharị mpaghara ahụ ka ọ bụrụ ntupu triangle emepụtara. Ọkpụkpọ ahụ mara mma na-ebuli ntupu a ozugbo site na iji ụdị mgbasa ozi dị elu dị elu (Stable Diffusion in latent space), na-eji rasterization dị iche iche na-amụba nkọwa elu na udidi. NVIDIA kọrọ ihe dị ka ọsọ ọsọ 2x n'elu DreamFusion ka ọ na-ebuga nsonaazụ dị elu nke ukwuu, na ntupu a na-edezi ozugbo na ngwaọrụ eserese ọkọlọtọ.

Nghọta nka nka

Ogbo mara mma bụ ihe na-emeghe mma. Site na mbupụ ubi ahụ na-adịghị ahụkebe na ntupu doro anya ma na-enye ya na rasterization dị iche iche, Magic3D na-etinye gradients SDS na mkpebi dị elu nke ọma, ihe na-adịghị mma na ntụgharị NeRF volumetric. Ịrụ mgbasa ozi nke abụọ tupu na oghere oghere na-ahapụ ya ka ọ na-elekọta nkọwa klaasị 512x512 ọnụ ala. Ntugharị aka na-adịchaghị mma pụtara na ọkwa ọ bụla na-eji ihe nnọchi anya kacha dabara adaba maka ọrụ ya: ubi doro anya maka geometry ngwa ngwa, ntupu maka nchacha nke ọma.

Mmetụta atụmatụ

Ọsọ na ọnụ ọgụgụ

Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.

Mee nhọrọ

Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.

Team na usoro ọrụ

Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.

Ọdịnihu nke Pipeline Magic3D Text-to-3D

Magic3D guzobere ndebiri nchacha nke ọma, nchacha nchacha ugbu a na ederede-gaa-3D. Usoro ọhụrụ na-aga n'ihu n'ọgbọ na-aga n'ihu ngwa ngwa, ọtụtụ nlele na-agbanwe agbanwe tupu edozi Janus artifacts, na ihe nnọchianya Gaussian Splatting. Na-atụ anya pipeline nke na-emepụta mmepụta-njikere, nke UV-mapped, akụ a na-ahụ anya n'ime sekọnd ruo nkeji, na-agbakwunyewanye ngwa ngwa n'ime igwe egwuregwu yana ngwa ọdịnaya 3D maka ndị na-emepụta ihe.

Mmejuputa n'ezie n'ụwa

Na-emepụta ntupu ederede nke 'acha anụnụ anụnụ nsi-dart frog na lily mmiri' site na ngwa ngwa.

Na-emepụta ihe nkwado 3D dị elu maka egwuregwu ọsọ ọsọ karịa DreamFusion

Ndozi dabere ozugbo ebe ịgbanwe ederede na-emezigharị ụdị 3D dị adị

Na-ebupụ meshes n'ime Blender ma ọ bụ igwe egwuregwu maka nchacha na ihe nkiri

Ihe ize ndụ & okporo ụzọ nche

Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.

Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.

Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.

Map mmejuputa

1

Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.

2

Nwalee na data dabara na ọnọdụ mmepụta n'ezie.

3

Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.

4

Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.

Nọgide na-eme nchọpụta

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Magic3D Text-to-3D Pipeline quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Malite ajụjụ

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ntuziaka na-esote

Ederede-ruo-3D Ọgbọ

Ajụjụ a na-ajụkarị

What is Magic3D Text-to-3D Pipeline?

Magic3D bụ azịza nke abụọ NVIDIA na DreamFusion, na-arụpụta mkpebi dị elu, ọdịnaya 3D zuru ezu karịa ngwa ngwa. O mere ka ederede dabere na SDS-gaa-3D bara uru nke ọma iji gosi na usoro ọrụ okike n'ezie.

Kedu usoro n'ozuzu ya na-akọwa pipeline Magic3D?

Magic3D na-eji ogbo siri ike maka geometry siri ike yana ọkwa mara mma maka nkọwa zuru oke.

Kedu ihe nnochite anya nke ọma na-ebuli maka nkọwa zuru oke?

A na-atụgharị ogige ahụ siri ike ka ọ bụrụ ntupu, wee nụchaa ya na rasterization dị iche iche na mkpebi dị elu.

Kedu ihe na-eme ka nleba anya geometry dị oke njọ?

Oghere akwara hash-grid ngwa ngwa na-ahapụ Magic3D imepụta geometry ngwa ngwa na mkpebi dị ala.

Kedu ka ngwa ngwa NVIDIA si kọọ Magic3D ka ọ bụrụ DreamFusion?

Magic3D kọrọ ihe dị ka ọsọ ọsọ 2x ebe ọ na-arụpụtakwa nsonaazụ kacha elu.

Kedu ihe kpatara ọnọdụ dị mma ji agbasa mgbasa ya tupu oghere zoro ezo?

Mgbasa oghere oghere (ụdị Stable Diffusion) na-ahapụ Magic3D ntuziaka nkọwa klaasị 512 na-enweghị ọnụ nke nsụgharị oghere pixel zuru oke.