Uhlolojikelele
I-Magic3D iyimpendulo yezigaba ezimbili ye-NVIDIA ku-DreamFusion, ekhiqiza ukucaca okuphezulu, okuqukethwe kwe-3D okunemininingwane eminingi ngokushesha. Yenze i-SDS-based text-to-3D yasebenziseka ngokwanele ukuze ibonise ukugeleza komsebenzi wokudala kwangempela.
I-Magic3D Text-to-3D Pipeline ingeyokugeleza kokusebenza kombono wekhompuyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, nokudala.
I-Deep Dive
I-Magic3D, evela ku-NVIDIA ngo-2022, yahlasela izindawo ezimbili ezinkulu zezinhlungu ze-DreamFusion: ukunensa nemininingwane ephansi. Ihlukanisa isizukulwane sibe yisiteji esimahhadlahhadla kanye nesiteji esihle. Isiteji esimahhadla sisebenzisa ukusabalalisa okunokulungiswa okuphansi ngaphambili ngenkundla ye-neural ye-hash-grid esheshayo (isitayela se-Instant-NGP) ukuze kuhlakazeke ngokushesha ijometri. Leyo nkambu ibe isiguqulelwa kunxantathu enezikhala ezithungwe. Isiteji esihle silungiselela le meshi ngokuqondile ngemodeli yokusabalalisa efihlekile yokulungiswa okuphezulu (I-Stable Diffusion esikhaleni esicashile), kusetshenziswa i-rasterization ehlukanisayo ukulola imininingwane yendawo kanye nokuthungwa. I-NVIDIA ibike cishe ukusheshisa okungu-2x phezu kwe-DreamFusion ngenkathi iletha imiphumela yokucaca okuphezulu ngokuphawulekayo, futhi okukhiphayo kwe-mesh kuhleleka ngokuqondile kumathuluzi ezithombe ezijwayelekile.
I-Technical Insight
Isiteji esihle yisona esivula ikhwalithi. Ngokuthekelisa inkambu emagebhugebhu enezikhala esobala futhi iwunikeze nge-rasterization ehlukanisayo, i-Magic3D isebenzisa amagrediyenti e-SDS ekulungisweni okuphezulu ngendlela efanele, into engenakwenzeka ngokuhunyushwa kwe-NeRF yevolumu eminyene. Ukusebenzisa ukusabalalisa kwesibili ngaphambi kwesikhala esicashile kuyivumela ukuthi igade imininingwane yekilasi elingu-512x512 ngokushibhile. Isandla esimahhadla-kuya-cone sisho ukuthi isigaba ngasinye sisebenzisa isethulo esiwufanele kangcono umsebenzi waso: inkambu engacacile yejiyomethri esheshayo, i-mesh ukuze ithuthukiswe kahle.
I-Mastering Magic3D Text-to-3D Pipeline
I-Magic3D iyimpendulo yezigaba ezimbili ye-NVIDIA ku-DreamFusion, ekhiqiza ukucaca okuphezulu, okuqukethwe kwe-3D okunemininingwane eminingi ngokushesha. Yenze i-SDS-based text-to-3D yasebenziseka ngokwanele ukuze ibonise ukugeleza komsebenzi wokudala kwangempela. I-Magic3D Text-to-3D Pipeline ingeyokugeleza kokusebenza kombono wekhompuyutha okuhumusha noma okukhiqiza imidiya ebonakalayo ukuze ihlaziywe, isebenze, nokudala. Ukuze wakhe ukuqonda okujulile, phatha i-Magic3D Text-to-3D Pipeline njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, cacisa ukucabanga, futhi uhlukanise lokho uhlelo olungakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa ukunemba kwebhalansi ye-Magic3D Text-to-3D Pipeline namaqiniso okusebenza njengekhwalithi yedatha, ukuhluka kokukhanya, nokuvumelana kwamalebula. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ngesikhathi esifanayo, amalungelo ezithombe kanye nemvume kungaba ubungozi bomthetho uma ukutholakala kungacacile. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini.
I-Visual AI ingakwazi ukuhlola, ukutholwa, nokumaka imisebenzi esikalini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha.
Amathimba aqanjiwe angakwazi ukulinganisa imiqondo ngokushesha ngezibuyekezo ezimbalwa ezenziwa mathupha. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini.
Imisebenzi ingasebenzisa amasiginali wesithombe nawevidiyo obekunzima ukuwenza ngaphambilini. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ikhiqiza i-mesh ehlelekayo eyenziwe 'yexoxo eliluhlaza okwesibhakabhaka elinobuthi obuluhlaza emnduze wamanzi' kusukela ekwazisweni
Ikhiqiza izisetshenziswa ze-3D ezinokulungiswa okuphezulu kwemidlalo ngokushesha kune-DreamFusion
Ukuhlela okusekelwe ekwazisweni lapho ukushintsha umbhalo kulungisa kabusha imodeli ekhona ye-3D
Ithekelisa amameshi ku-Blender noma izinjini zegeyimu zokuhlanza amaciko nokugqwayiza
Amaphethini Okusebenzisa
I-Magic3D Text-to-3D Pipeline iyasebenza
Ikhiqiza i-mesh ehlelekayo eyenziwe 'yexoxo eliluhlaza okwesibhakabhaka elinobuthi obuluhlaza emnduze wamanzi' kusukela ekwazisweni.
Ukukhiqiza i-mesh ehlelekayo enobuthi 'yexoxo eliluhlaza okwesibhakabhaka elinobuthi emnduzeni wamanzi' kusukela ngokushesha Amaqembu ngokuvamile athola imiphumela engcono uma echaza imingcele yekhwalithi ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Magic3D Text-to-3D Pipeline iyasebenza
Ikhiqiza izisetshenziswa ze-3D ezinokulungiswa okuphezulu kwemidlalo ngokushesha kune-DreamFusion.
Ukukhiqiza izinto ezisezingeni eliphezulu ze-3D zamageyimu ngokushesha kune-DreamFusion Teams ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Magic3D Text-to-3D Pipeline iyasebenza
Ukuhlela okusekelwe ekwazisweni lapho ukushintsha umbhalo kulungisa kabusha imodeli ekhona ye-3D.
Ukuhlela okusekelwe ngokushesha lapho ukuguqula umbhalo kulungisa kabusha imodeli ye-3D Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-Magic3D Text-to-3D Pipeline iyasebenza
Ithekelisa amameshi ku-Blender noma izinjini zegeyimu zokuhlanza amaciko nokugqwayiza.
Ukuthekelisa amameshi ku-Blender noma izinjini zegeyimu zokuhlanza amaciko nokugqwayiza Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Amalungelo ezithombe kanye nemvume kungaba ubungozi bezomthetho uma ukuvela kungacacile.
Ukusebenza kwemodeli kungahluka kukho konke ukukhanya, izibalo zabantu, kanye nezindawo.
Okuhle okungelona iqiniso kungase kungabonakali ngaphandle uma izinga lokuzethemba liqashelwa.
Ukuqalisa Umhlahlandlela
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha.
Chaza indlela yokwamukela yokunemba, ukukhumbula, nezindleko zamaphutha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Hlola ngedatha efana nezimo zangempela zokukhiqiza.
Hlola ngedatha efana nezimo zangempela zokukhiqiza. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu.
Engeza isibuyekezo somuntu ukuze uthole ukuzethemba okuphansi noma izibikezelo zomthelela omkhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha.
Landelela ukukhukhuleka kwemodeli bese uqinisekisa kabusha ngemva kwezinguquko zekhamera noma zesethi yedatha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.