Zvinyorwa-ku-3D Generation
Mavara-ku-3D chizvarwa chinoshandura yakanyorwa senge 'yevintage leather armchair' kuita yakazara 3D modhi yaunogona kutenderedza, kupenya, uye kudonha mumutambo kana chiitiko.
Pfupiso
It promises to do for 3D assets what image generators did for pictures.
Kudzika Kwakadzika
Zvinyorwa-ku-3D masisitimu anoburitsa 3D inomiririra (mesh, point Cloud, kana radiance field) kubva mumutsara. Mabhindauko ekutanga senge Google's DreamFusion (2022) akashandisa Score Distillation Sampling: pane kudzidziswa pane 3D data, vakakwenenzvera NeRF kuitira kuti yega yega inopihwa 2D maonero aite seanobatika kune yakaomeswa nechando 2D diffusion modhi. Iyi bootstrapped 3D maumbirwo kubva ku2D pres asi yainonoka, ichitora maawa pachinhu chimwe uye kazhinji ichigadzira 'Janus dambudziko' apo chisikwa chinokura zviso zvakawanda. Mamodheru matsva-emberi (OpenAI's Point-E uye Shap-E, pamwe neGaussian-splatting uye mahombe ekuvaka patsva) anogadzira zvinhu mumasekonzi kusvika kumaminitsi. Hunhu, kuwanda-maonero kuenderana, yakachena topology, uye anoshandisika manyorerwo anoramba achishanda matambudziko.
Technical Insight
DreamFusion's core trick, Score Distillation Sampling (SDS), haidi 3D kudzidziswa data. Inopa maonero asina kujairika eNeRF, anowedzera ruzha, uye anobvunza pretrained 2D diffusion modhi maitiro ekuita denoise kune iyo chinyorwa chekukurumidza. Iyo denoising siginecha inova gradient inobata iyo NeRF maparamendi kuitira kuti maonero ese anoenderana nekukasira. Iyo 2D modhi inoita semutsoropodzi achinyudza ruzivo rwemufananidzo muchinhu chinowirirana che3D.
Strategic Impact
Kumhanya uye chiyero
Visual AI inogona kuita otomatiki yekuongorora, yekuona, uye yekumaka mabasa pachiyero.
Vaka sarudzo
Zvikwata zvekugadzira zvinogona prototype pfungwa nekukurumidza nekudzokororwa kwemaoko mashoma.
Team uye workflow
Mashandisirwo anogona kushandisa masaini emifananidzo nemavhidhiyo ayo aimbove akaoma kugadzirisa.
Ramangwana reChinyorwa-ku-3D Chizvarwa
Tarisira kushanduka kubva kunonokerwa pachinhu chimwe-nechimwe-chinomhanyisa kuenda kumberi-mberi majenareta anoburitsa kugadzirwa-akagadzirira meshes akachena topology, zvinhu zvakapatsanurwa, uye UV mepu mumasekonzi. 3D Gaussian splatting uye mahombe ekuvaka patsva ari kukurumidza izvi. Kubatanidzwa muinjini dzemitambo, CAD, uye mapaipi eAR, pamwe nemavara-ku-4D (ane mifananidzo, zvinhu zvinofamba), kuchaita yekukurukurirana kwekugadzira midziyo, kunyangwe kucheneswa kwevanhu kwekubira uye kutevedzera-kwemutambo kuchaenderera.
Real-World Implementation
Yemutambo situdiyo prototypes yekumashure props (makrete, marambi, mashizha) kubva kune zvinyorwa zvinokurudzira kuti zvizadze mazinga vasati maartist akwenenzvera zvinhu zvegamba.
Iyo e-commerce saiti auto-inogadzira inotenderera 3D chigadzirwa preview kubva kukhathalogi tsananguro yeAR 'kuona mukamuri mako' maficha.
Mugadziri wezvivakwa anokurumidza kuzadza nzira yekufambisa nefenicha nekunyora 'mid-century sofa' pachinzvimbo chekutarisa mumaraibhurari emidziyo.
Firimu pre-viz timu inovharira mapfekero echiitiko kubva pane tsananguro yescript kuyedza angles kamera isati yavaka mamodheru ekupedzisira.
Njodzi & Guardrails
Kodzero dzemifananidzo uye kubvumirwa kunogona kuve njodzi dzepamutemo kana provenance isina kujeka.
Kuita kwemuenzaniso kunogona kusiyanisa kupenya, huwandu hwevanhu, uye nharaunda.
Manyepo enhema anogona kusacherechedzwa kunze kwekunge zvikumbaridzo zvekuvimba zvikatariswa.
Implementation Roadmap
Tsanangura maitiro ekugamuchirwa echokwadi, kurangarira, uye mutengo wekukanganisa.
Edzai nedata rinoenderana nemamiriro chaiwo ekugadzira.
Wedzera ongororo yemunhu kune yakaderera-kusavimbika kana yakakwirira-inokanganisa kufanotaura.
Tevera modhi kudonha uye simbisa mushure mekuchinja kwekamera kana dataset.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Text-to-3D Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
Magic3D Chinyorwa-ku-3D Pipeline
Mibvunzo inowanzo bvunzwa
What is Text-to-3D Generation?
Mavara-ku-3D chizvarwa chinoshandura yakanyorwa senge 'yevintage leather armchair' kuita yakazara 3D modhi yaunogona kutenderedza, kupenya, uye kudonha mumutambo kana chiitiko. Inovimbisa kuitira 3D assets izvo majenareta emifananidzo akaitira mapikicha.
Chii chaive chakakosha innovation yeDreamFusion (2022)?
DreamFusion yakagadziridza NeRF kuitira kuti maonero ega ega e2D agutse modhi yakaomeswa ye2D yekuparadzira mufananidzo, uchishandisa SDS uye isingade 3D data yekudzidziswa.
Chii chinonzi 'Janus dambudziko' mune zvinyorwa-ku-3D?
Yakatumidzwa zita ramwari wevaRoma vane zviso zviviri, dambudziko raJanus nderokuti chinhu chinokura zviso zvakawedzerwa nekuti maonero ega ega e2D anogadziridzwa zvakazvimiririra.
Ndeapi maviri aive OpenAI's ekutanga mavara-ku-3D ekufambisa-mberi mhando?
OpenAI yakaburitswa Point-E (point cloud) neShap-E, iyo inogadzira 3D assets nekukurumidza kupfuura optimization-based nzira.
Nei nzira dzekutanga dzekugadzirisa-dzakavakirwa senge DreamFusion dzainonoka?
Chinhu chega chega chaida kukwidziridza NeRF kune dzakawanda dzine ruzha, kazhinji kutora maawa pachinhu chimwe.
Ndeipi fomati yekubuda HAIYO yakajairika 3D inomiririra inogadzirwa neaya masisitimu?
Zvinyorwa-ku-3D masisitimu anoburitsa meshes, anonongedza makore, kana minda yekupenya; MP3 imhando yekuteerera, kwete 3D inomiririra.