I-Text-to-3D Generation
Isizukulwane sombhalo uye ku-3D siphendula umyalo obhaliwe njengokuthi 'isihlalo sesikhumba sesikhathi esidlule' sibe yimodeli ye-3D egcwele ongayiphendukisa, ukhanyise, futhi uyekele emdlalweni noma isigcawu.
Uhlolojikelele
It promises to do for 3D assets what image generators did for pictures.
I-Deep Dive
Amasistimu ombhalo ukuya ku-3D akhiqiza ukumelwa kwe-3D (i-mesh, ifu lephoyinti, noma inkambu yokukhanya) emshweni. Ukuphumelela kwangaphambi kwesikhathi njenge-DreamFusion (2022) ka-Google kusetshenziswe i-Score Distillation Sampling: esikhundleni sokuqeqeshwa ngedatha ye-3D, bathuthukise i-NeRF ukuze konke ukubuka kwe-2D kubukeke kuvumelana nemodeli yokusabalalisa isithombe se-2D efriziwe. Lokhu kumumo we-3D okuqale kwaxhunywa kusuka kokuphambili kwe-2D kodwa bekuhamba kancane, kuthatha amahora ngento ngayinye futhi kuvame ukukhiqiza 'inkinga ka-Janus' lapho isidalwa sikhula ubuso obuningi. Amamodeli amasha okuphakela phambili (OpenAI's Point-E kanye ne-Shap-E, kanye namamodeli e-Gaussian-splattting kanye namamodeli amakhulu okwakha kabusha) akhiqiza amafa ngemizuzwana ukuya kumaminithi. Ikhwalithi, ukungaguquguquki kokubuka okuningi, i-topology ehlanzekile, nokuthungwa okusebenzisekayo kuhlala kuyinselele esebenzayo.
I-Technical Insight
Iqhinga eliyinhloko le-DreamFusion, i-Score Distillation Sampling (SDS), ayidingi idatha yokuqeqeshwa kwe-3D. Inikeza ukubukwa okungahleliwe kwe-NeRF, yengeza umsindo, futhi ibuza imodeli yokusabalalisa ye-2D eqeqeshwe kusengaphambili ukuthi iphikiswa kanjani ukuya ekwazisweni kombhalo. Leyo siginali ekhipha umsindo iba i-gradient egudluza amapharamitha e-NeRF ukuze yonke imibono ifane nokwaziswa. Imodeli ye-2D isebenza njengomgxeki ehlakaza ulwazi lwayo lwesithombe lube yinto engaguquki ye-3D.
I-Strategic Impact
Isivinini nesikali
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
Yakha ukukhetha
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Ithimba kanye nokusebenza komsebenzi
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Ikusasa Lesizukulwane Esisuka ku-3D
Lindela uguquko ukusuka ekuthuthukisweni okunensayo kwento ngayinye ukuya kumajeneretha adlulisela phambili okuphakelayo akhipha amameshi alungele ukukhiqiza ane-topology ehlanzekile, izinto ezihlukene, namamephu e-UV ngemizuzwana. I-3D Gaussian splatt namamodeli amakhulu okwakha kabusha ayasheshisa lokhu. Ukuhlanganiswa ezinjinini zegeyimu, i-CAD, namapayipi e-AR, kanye nombhalo-to-4D (izinto ezigqwayizayo, ezihambayo), kuzokwenza isimiso sokudala impahla yengxoxo, nakuba ukuhlanzwa komuntu ukuze kuqiniswe nokuhambisana negeyimu ethile kuzophikelela.
Ukuqaliswa Komhlaba Wangempela
Isitudiyo segeyimu senza ama-prototypes angemuva (amakhreyithi, amalambu, amahlamvu) asuka emyalweni wombhalo ukuze agcwalise amaleveli ngaphambi kokuba amaciko acwenge amafa eqhawe.
Isayithi le-e-commerce likhiqiza ngokuzenzakalelayo ukuhlola kuqala komkhiqizo we-3D ophendukayo osuka ezincazelweni zekhathalogi yezici ze-AR 'zokubuka egumbini lakho'.
Umakhi ugcwalisa ngokushesha i-walkthrough enikezela ngefenisha ngokuthayipha 'usofa wamaphakathi nekhulunyaka' esikhundleni sokuphequlula amalabhulali wempahla.
Ithimba langaphambi kwefilimu livimba isethi yokugqoka yesigcawu encazelweni yombhalo ukuze lihlole ama-engeli ekhamera ngaphambi kokwakha amamodeli okugcina.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Text-to-3D Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-Magic3D Text-to-3D Pipeline
Imibuzo evame ukubuzwa
What is Text-to-3D Generation?
Isizukulwane sombhalo uye ku-3D siphendula umyalo obhaliwe njengokuthi 'isihlalo sesikhumba sesikhathi esidlule' sibe yimodeli ye-3D egcwele ongayiphendukisa, ukhanyise, futhi uyekele emdlalweni noma isigcawu. Ithembisa ukwenza kumafa we-3D lokho abakhiqizi bezithombe abakwenzile ezithombeni.
Kwakuyini ukuqanjwa okubalulekile kwe-DreamFusion (2022)?
I-DreamFusion ithuthukise i-NeRF ukuze konke ukubuka kwe-2D kwanelise imodeli efriziwe ye-2D yokusabalalisa isithombe, kusetshenziswa i-SDS futhi ayidingi idatha yokuqeqeshwa kwe-3D.
Ithini 'inkinga kaJanus' kumbhalo-kuya-3D?
Iqanjwe ngegama likankulunkulu wamaRoma onobuso obubili, inkinga kaJanus yilapho into ikhula ubuso obengeziwe ngoba ukubuka ngakunye kwe-2D kuthuthukiswa ngokuzimele.
Yimaphi amamodeli OpenAI amamodeli okuqala okuthumela umbhalo ku-3D okuphakelayo?
OpenAI ikhishwe i-Point-E (point clouds) ne-Shap-E, ekhiqiza amafa e-3D ngokushesha kakhulu kunezindlela ezisekelwe ekuthuthukiseni.
Kungani izindlela ezisekelwe ekusebenzeni kangcono njenge-DreamFusion zazihamba kancane?
Into ngayinye idinga ukuthuthukiswa ngokuphindaphindiwe kwe-NeRF kuzo zonke izinguqulo eziningi ezinomsindo, ngokuvamile kuthatha amahora ngempahla ngayinye.
Iyiphi ifomethi yokukhipha AKUSIYO ukumelwa okujwayelekile kwe-3D okukhiqizwa yilezi zinhlelo?
Amasistimu wombhalo kuya ku-3D okukhipha amameshi, amafu okukhomba, noma izinkambu zokukhanya; I-MP3 iyifomethi yomsindo, hhayi ukumelwa kwe-3D.