Tuyob bind-ci-3D Magic3D
Magic3D mooy tontub NVIDIA ci DreamFusion ci ñaari pacc, di defar ëmbiit 3D bu gëna gaaw te gëna leer.
Résumé
It made SDS-based text-to-3D practical enough to hint at real creative workflows.
Plongeur bu xóot
Magic3D, bu bawoo ci NVIDIA ci 2022, dafa song ñaari poñ yi gëna metti ci DreamFusion: yeexal ak detay yu néew. Dafay xaaj generation ci ñaari etape yu dëgër ak etape yu rafet. Etape bu dëgër bi dafay jëfandikoo ab diffusion bu am resolusioŋ bu woyof balaa ak ab champ neuronal bu gaaw bu am griy hash (stil Instant-NGP) ngir gaaw ci geometrie bu dëgër. Suko defee ñu soppi barab boobu mu nekk mbaal bu am textu triangle. Etape bu baax bi dafay gëna baaxal mbaal mi ci saasi ak xeetu diffusion bu nëbbu bu am dayo bu kawe (Diffusion bu dëgër ci espace bu nëbbu), di jëfandikoo rasterization buñ mëna wuutale ngir gëna ñaw surface bi ak texture bi. NVIDIA xamlena lu tollu ci 2x gaawaay ci kaw DreamFusion ci di joxe ay resultaa yu gëna rëy, te génnug mesh bi mën nañu ko soppi ci jumtukaayi grafik yiñ miin.
Gis-gis xarala
etape bu baax bi mooy ubbi kalite bi. Su Magic3D génnee barab bu dëgër bi ci benn lëndëm bu leer, ba noppi joxe ko ak rasterization buñ mëna wuutale, Magic3D dafay jëfandikoo gradient SDS ci dayo bu kawe, muy lu mënatul am ci joxe NeRF volumetric bu dëgër. Doxal ñaareelu diffusion bi njëkk ci espace latente daf koy may mu saytu 512x512-klaas detay ci njëg yu yomb. Handoff bu dëgër ba bu woyof dafay tekki ni etap bu nekk dafay jëfandikoo représentation bi gëna baax ci liggéeyam: champ implicite ngir geometrie bu gaaw, mesh ngir setal bu fëgër.
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu Magic3D Bind-ci-3D Pipeline
Magic3D moo taxawal gaaraas bu dëgër-ba-fiin, mesh-refinement bi ñuy gëna xam leegi ci bind-ba-3D. Sistem yu bees yi dañuy puus ngir feed-forward bu gëna gaaw, gis-gis yu bari yuy méngoo balaa ñuy defar mbiri Janus, ak fësal Gaussian Splatting. Xaarandi pipeline yuy génne produit-ready, UV-mapped, asset animable ci ay segond wala ay simili, di gëna dugg ci motëri jeu yi ak jumtukaayi ëmbiit 3D ngir jëfandikukat yi.
Doxal ci àdduna dëgg
Defar ab mbaal buñu mëna soppali bu 'mbott bu baxa bu am dangar ci kaw benn lily ndox' ci benn laaj
Defar ay rekwisiit 3D yu gëna kawe ngir jeu yi gëna gaaw DreamFusion
Soppite bu sukkandiko ci gaaw, di soppi mbind mi di soppi stil model 3D bu fi nekk
Yobbu ay mbaal ci biir Blender wala motëri jeu ngir setal artist bi ak animaasioŋ
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Magic3D Text-to-3D Pipeline quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Bind-ci-3D
Laaj yi ñuy faral di laaj
What is Magic3D Text-to-3D Pipeline?
Magic3D mooy tontub NVIDIA ci DreamFusion ci ñaari pacc, di defar ëmbiit 3D bu gëna gaaw te gëna leer. Defar na text-to-3D bu sukkandiko ci SDS muy lu mëna jëfandikoo ngir wane ni ñuy liggéeyee ci sos lu bees.
Lan mooy màndargaal pipeline Magic3D?
Magic3D dafay jëfandikoo etape bu dëgër ngir geometrie bu gaaw bu dëgër ak etape bu rafet ngir detay yu am dayo bu kawe.
Ban représentation la etape bu baax bi gëna baax ngir am detay yu fëgër?
Dañuy soppi barab bu dëgër bi def ko mbaal, ginaaw ga ñu setal ko ak rasterization buñ mëna wuutale ci dayo bu kawe.
Lan mooy gaawlu xayma geometrie bu etape bu dëgër bi?
Benn champ neuronal bu gaaw bu am griy hash dafay may Magic3D mu gaaw ci defar geometrie ci dayo bu woyof.
Lu tollu ci ban gaawaay la NVIDIA wax ni Magic3D moo gëna gaaw ci DreamFusion?
Magic3D xamlena lu tollu ci 2x speedup ci noonu muy defar ay resultaa yu gëna rëy.
Lan moo waral etape bu baax bi di njëkka tasaaroo ci espace latente bi?
Diffusion espace latente (stilu diffusion stabil) dafay tax Magic3D mëna teg ay detay ci 512 classe te doo fay rendu espace pixel bu mat.