Visual AI Itọsọna

Ọrọ-si-3D Iran

Ọrọ-si-3D iran yi itọsẹ kikọ bi 'aga-apa alawọ ojoun' sinu awoṣe 3D ni kikun ti o le yi, tan ina, ati ju silẹ sinu ere tabi iṣẹlẹ kan.

2 min kakẹhin imudojuiwọn

Akopọ

It promises to do for 3D assets what image generators did for pictures.

Jin Dive

Awọn ọna ṣiṣe ọrọ-si-3D ṣe agbejade aṣoju 3D kan (mesh, awọsanma ojuami, tabi aaye didan) lati gbolohun ọrọ kan. Awọn aṣeyọri ni kutukutu bi Google's DreamFusion (2022) lo Iṣayẹwo Distillation Score: dipo ikẹkọ lori data 3D, wọn ṣe iṣapeye NeRF kan ki gbogbo wiwo 2D ti a ṣe rii daju si awoṣe itanka aworan 2D tio tutunini. Eleyi bootstrapped 3D ni nitobi lati 2D saju sugbon je o lọra, mu wakati fun ohun kan ati ki o nigbagbogbo producing awọn 'Janus isoro' ibi ti a ẹda dagba ọpọ oju. Awọn awoṣe siwaju kikọ sii tuntun (OpenAI's Point-E ati Shap-E, pẹlu Gaussian-splating ati awọn awoṣe atunkọ nla) ṣe ina awọn ohun-ini ni iṣẹju-aaya si iṣẹju. Didara, aitasera wiwo-pupọ, topology mimọ, ati awọn awoara nkan elo jẹ awọn italaya lọwọ.

Imọ-imọ-ẹrọ

Ẹtan mojuto DreamFusion, Iṣayẹwo Distillation Score (SDS), ko nilo data ikẹkọ 3D. O ṣe awọn iwo laileto ti NeRF kan, n ṣafikun ariwo, o si beere awoṣe itọka 2D ti a ti kọ tẹlẹ bi o ṣe le tako si itọ ọrọ naa. Ifihan agbara ikọsilẹ yẹn di gradient ti o ṣe itọsi awọn aye-aye NeRF nitorinaa gbogbo oju-iwoye baamu itọsi naa. Awọn 2D awoṣe ìgbésẹ bi a radara distilling awọn oniwe-aworan imo sinu kan dédé 3D ohun.

Ipa Ilana

Iyara ati iwọn

Visual AI le ṣe adaṣe adaṣe, wiwa, ati awọn iṣẹ ṣiṣe taagi ni iwọn.

Kọ awọn yiyan

Awọn ẹgbẹ ẹda le ṣe apẹrẹ awọn imọran yiyara pẹlu awọn atunyẹwo afọwọṣe diẹ.

Ẹgbẹ ati ṣiṣan iṣẹ

Awọn iṣẹ ṣiṣe le lo aworan ati awọn ifihan agbara fidio ti o nira tẹlẹ lati ṣiṣẹ.

Ojo iwaju ti Ọrọ-si-3D Iran

Reti iṣipopada lati iṣapeye ohun-ọlọra fun awọn olupilẹṣẹ ifunni siwaju ti o njade awọn meshes ti o ṣetan iṣelọpọ pẹlu topology mimọ, awọn ohun elo ti o yapa, ati awọn maapu UV ni iṣẹju-aaya. 3D Gaussian splatting ati awọn awoṣe atunkọ nla n mu eyi pọ si. Ijọpọ sinu awọn ẹrọ ere, CAD, ati awọn opo gigun ti AR, pẹlu ọrọ-si-4D (awọn ohun idanilaraya, awọn nkan gbigbe), yoo ṣe ilana ṣiṣe ṣiṣẹda dukia ibaraẹnisọrọ, botilẹjẹpe afọmọ eniyan fun rigging ati ibamu-ere-spec yoo tẹsiwaju.

Real-World imuse

Ile-iṣere ere kan ṣe apẹẹrẹ awọn atilẹyin lẹhin (awọn apoti, awọn atupa, foliage) lati awọn itọ ọrọ lati kun awọn ipele ṣaaju ki awọn oṣere ṣe atunṣe awọn ohun-ini akọni.

Oju opo wẹẹbu e-commerce kan ṣe ipilẹṣẹ awọn awotẹlẹ ọja 3D iyipo lati awọn apejuwe katalogi fun awọn ẹya AR 'iwo inu yara rẹ'.

Oniyaworan yara yara gbejade iṣẹ ṣiṣe pẹlu aga nipa titẹ 'sofa aarin-ọdun' dipo lilọ kiri lori awọn ile-ikawe dukia.

Ẹgbẹ fiimu kan ti o ṣaju-viz ṣe idiwọ imura ṣeto ti ipele kan lati apejuwe iwe afọwọkọ lati ṣe idanwo awọn igun kamẹra ṣaaju ṣiṣe awọn awoṣe ikẹhin.

Awọn ewu & Awọn ọna iṣọ

Awọn ẹtọ aworan ati igbanilaaye le di awọn eewu labẹ ofin ti o ba jẹ afihan.

Iṣe awoṣe le yatọ kọja ina, awọn ẹda eniyan, ati awọn agbegbe.

Awọn idaniloju eke le ma ṣe akiyesi ayafi ti a ba ṣe abojuto awọn ala igbẹkẹle.

Ilana Ilana imuse

1

Ṣetumo awọn ibeere gbigba fun pipe, iranti, ati awọn idiyele aṣiṣe.

2

Ṣe idanwo pẹlu data ti o baamu awọn ipo iṣelọpọ gidi.

3

Ṣafikun atunyẹwo eniyan fun igbẹkẹle kekere tabi awọn asọtẹlẹ ipa-giga.

4

Tọpinpin awoṣe ki o ṣe tunṣe lẹhin kamẹra tabi awọn ayipada datasetto.

Tesiwaju Ṣiṣawari

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Text-to-3D Generation quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Bẹrẹ adanwo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Itọsọna atẹle

Magic3D Ọrọ-to-3D Pipeline

Awọn ibeere ti a beere nigbagbogbo

What is Text-to-3D Generation?

Ọrọ-si-3D iran yi itọsẹ kikọ bi 'aga-apa alawọ ojoun' sinu awoṣe 3D ni kikun ti o le yi, tan ina, ati ju silẹ sinu ere tabi iṣẹlẹ kan. O ṣe ileri lati ṣe fun awọn ohun-ini 3D kini awọn olupilẹṣẹ aworan ṣe fun awọn aworan.

Kini isọdọtun bọtini ti DreamFusion (2022)?

DreamFusion ṣe iṣapeye NeRF kan nitorinaa gbogbo wiwo 2D ti a ṣe ni itẹlọrun awoṣe itanka aworan 2D tio tutunini, ni lilo SDS ati pe ko nilo data ikẹkọ 3D.

Kini 'iṣoro Janus' ni ọrọ-si-3D?

Ti a npè ni lẹhin ọlọrun Romu ti o ni oju meji, iṣoro Janus ni nigbati ohun kan ba dagba awọn oju afikun nitori wiwo 2D kọọkan jẹ iṣapeye ni itumo ominira.

Tọkọtaya wo ni OpenAI's ni kutukutu ọrọ-si-3D awọn awoṣe siwaju kikọ?

OpenAI tu Point-E (awọsanma ojuami) ati Shap-E, eyiti o ṣe agbejade awọn ohun-ini 3D ni iyara pupọ ju awọn ọna orisun iṣapeju lọ.

Kini idi ti awọn ọna ti o da lori iṣapeye tete bii DreamFusion lọra?

Ohun kọọkan nilo ni ilodisi iṣapeye NeRF kan kọja ọpọlọpọ awọn idawọle ti ariwo, nigbagbogbo n gba awọn wakati fun dukia.

Eyi ti o wu kika jẹ KO kan aṣoju 3D oniduro yi ni awọn ọna šiše?

Awọn ọna ṣiṣe ọrọ-si-3D ṣe agbejade awọn meshes, awọn awọsanma aaye, tabi awọn aaye didan; MP3 jẹ ọna kika ohun, kii ṣe aṣoju 3D.