DreamFusion ati Iṣapẹẹrẹ Distillation Dimegilio
DreamFusion ṣe ipilẹṣẹ awọn nkan 3D lati ọrọ nipa lilo awoṣe itanka aworan 2D bi alariwisi, ko ṣe ikẹkọ lori eyikeyi data 3D.
Akopọ
Ipilẹṣẹ ipilẹ rẹ, Iṣayẹwo Distillation Score, di ohunelo ipilẹ fun gbogbo aaye ọrọ-si-3D.
Jin Dive
DreamFusion, lati Google ni ọdun 2022, beere: Njẹ awoṣe ọrọ-si-aworan 2D kan le kọ oju iṣẹlẹ 3D kan lati wo ọtun lati gbogbo igun? O ṣe iṣapeye NeRF kan (Aaye Radiance Neural) ki awọn igbejade lati awọn oju-ọna kamẹra laileto, nigba ariwo ati ti o han si awoṣe itankale tutunini (Imagen), Dimegilio bi awọn aworan ti o ṣeeṣe fun tọ ọrọ naa. Ni pataki ko lo data ikẹkọ 3D. Aṣeyọri naa jẹ Iṣayẹwo Distillation Score (SDS): dipo isọdọtun nipasẹ awoṣe itọka U-Net gbowolori, SDS nlo ariwo asọtẹlẹ awoṣe bi ifihan agbara gradient taara lori awọn piksẹli ti a ṣe. Yiyi pada kọja awọn ẹgbẹẹgbẹrun awọn oju iwo ṣe ere dukia 3D isokan, ni pipe pẹlu jiometirika ati irisi ti o gbẹkẹle wiwo, lati gbolohun kan.
Imọ-imọ-ẹrọ
SDS ṣe itọju awoṣe itankale bi iṣẹ igbelewọn tio tutunini. O funni ni NeRF, n ṣafikun ariwo, beere U-Net kaakiri lati ṣe asọtẹlẹ ariwo naa, ati ṣe iṣiro iwọn didun bi (ariwo asọtẹlẹ iyokuro ariwo ti a ṣafikun) titari pada si aworan ti a ṣe ati nitorinaa awọn iwuwo NeRF. Foju U-Net Jacobian jẹ ki o ṣee ṣe. Itọnisọna ti ko ni kilasika giga (ni ayika 100) ni a nilo fun awọn abajade didasilẹ, eyiti o fa ihuwasi ti o kun pupọ, nigbakan blurry 'wo DreamFusion'.
Ipa Ilana
Iyara ati iwọn
Visual AI le ṣe adaṣe adaṣe, wiwa, ati awọn iṣẹ ṣiṣe taagi ni iwọn.
Kọ awọn yiyan
Awọn ẹgbẹ ẹda le ṣe apẹrẹ awọn imọran yiyara pẹlu awọn atunyẹwo afọwọṣe diẹ.
Ẹgbẹ ati ṣiṣan iṣẹ
Awọn iṣẹ ṣiṣe le lo aworan ati awọn ifihan agbara fidio ti o nira tẹlẹ lati ṣiṣẹ.
Ọjọ iwaju ti DreamFusion ati Iṣapẹẹrẹ Distillation Dimegilio
SDS ṣe agbejade laini iṣẹ lọpọlọpọ ti n ṣatunṣe awọn ailagbara rẹ: Magic3D fun ipinnu ati iyara, ProlificDreamer's Variational Score Distillation fun didasilẹ, awọn abajade oniruuru diẹ sii, ati awọn ọna ikọlu ‘Janus’ artifact olona-oju. Aaye naa n pọ si SDS pọ si pẹlu awọn iṣaju itankale wiwo pupọ ati awọn aṣoju 3D yara bi Gaussian Splatting. Reti ọrọ-si-3D lati dagba ni iyara ati olotitọ jiometirika diẹ sii, dín aafo naa pẹlu awọn ohun-ini ti a ṣe awoṣe.
Real-World imuse
Ṣiṣẹda awoṣe 3D ti 'Fọto DSLR kan ti okere ti o wọ fila kekere kan' lati ọrọ nikan
Ṣiṣẹda ere ere ati awọn ohun-ini AR laisi fifin 3D afọwọṣe
Ṣiṣejade awọn meshes okeere ti awọn oṣere n ṣatunṣe dipo ti kọ lati ibere
Awọn ipilẹ iwadi fun iṣiro awọn ọna tuntun-si-3D lodi si SDS
Awọn ewu & Awọn ọna iṣọ
Awọn ẹtọ aworan ati igbanilaaye le di awọn eewu labẹ ofin ti o ba jẹ afihan.
Iṣe awoṣe le yatọ kọja ina, awọn ẹda eniyan, ati awọn agbegbe.
Awọn idaniloju eke le ma ṣe akiyesi ayafi ti a ba ṣe abojuto awọn ala igbẹkẹle.
Ilana Ilana imuse
Ṣetumo awọn ibeere gbigba fun pipe, iranti, ati awọn idiyele aṣiṣe.
Ṣe idanwo pẹlu data ti o baamu awọn ipo iṣelọpọ gidi.
Ṣafikun atunyẹwo eniyan fun igbẹkẹle kekere tabi awọn asọtẹlẹ ipa-giga.
Tọpinpin awoṣe ki o ṣe tunṣe lẹhin kamẹra tabi awọn ayipada datasetto.
Tesiwaju Ṣiṣawari
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DreamFusion and Score Distillation Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Itọsọna atẹle
Awọn awoṣe Generative ti o da lori Dimegilio
Awọn ibeere ti a beere nigbagbogbo
Kini DreamFusion ati Iṣapẹẹrẹ Distillation Score?
DreamFusion ṣe ipilẹṣẹ awọn nkan 3D lati ọrọ nipa lilo awoṣe itanka aworan 2D bi alariwisi, ko ṣe ikẹkọ lori eyikeyi data 3D. Ipilẹṣẹ ipilẹ rẹ, Iṣayẹwo Distillation Score, di ohunelo ipilẹ fun gbogbo aaye ọrọ-si-3D.
Aṣoju 3D wo ni DreamFusion ṣe iṣapeye?
DreamFusion ṣe iṣapeye NeRF kan nitorinaa awọn iwo ti o ṣe ni itẹlọrun ni itẹlọrun idajọ awoṣe itankale 2D ti tọ ọrọ naa.
Elo ni data ikẹkọ 3D DreamFusion nilo?
DreamFusion nlo awoṣe itankale ọrọ-si-aworan 2D tio tutunini bi abojuto rẹ nikan, ko nilo data ikẹkọ 3D.
Kini ọna abuja iṣiro bọtini ni Iṣapẹẹrẹ Distillation Score?
SDS nlo ariwo ti a ti sọtẹlẹ-iyokuro-fikun bi itọsẹ taara lori awọn piksẹli ti a ṣe, yago fun U-Net Jacobian ti o niyelori.
Kini idi ti DreamFusion nlo itọnisọna ọfẹ-ọfẹ classifier pupọ (~ 100)?
SDS gradient jẹ alariwo ati alailagbara, nitorinaa itọsọna ti o ga julọ ni a nilo fun agaran, jiometirita-kia, botilẹjẹpe o fa itẹlọrun pupọ.
Awoṣe 2D wo ni DreamFusion atilẹba lo bi tio tutunini ṣaaju?
DreamFusion ti wa ni itumọ ti lori Google's Imagen awoṣe itankale ọrọ-si-aworan bi iṣẹ igbelewọn tio tutunini.