DreamFusion iyo Saamaynta Distillation Dhibcaha
DreamFusion waxay ka soo saartaa walxaha 3D qoraalka iyadoo la adeegsanayo qaabka faafinta sawirka 2D dhaleeceyn ahaan, waligiisna uma tababarin xogta 3D kasta.
Dulmar
Its core invention, Score Distillation Sampling, became the foundational recipe for the entire text-to-3D field.
quusid qoto dheer
DreamFusion, laga bilaabo Google sanadka 2022, ayaa la waydiiyay: 2D qaab qoraal-u-sawir ma bari karaa muuqaalka 3D inuu u ekaado midig xagal kasta? Waxay wanaajisaa NeRF (Neural Radiance Field) si soo-bandhigidda kaamirooyinka random-ka ah, marka la buuqo oo la tuso qaabka fidinta la qaboojiyey (Imagen), waxay u dhigantaa sawirro macquul ah isla markiiba qoraalka. Muhiimad ahaan ma isticmaasho xogta tababarka 3D. Horumarku waa Dhibcaha Distillation Sampling (SDS): Halkii dib loogu faafin lahaa moodeelka faafinta qaaliga ah ee U-Net, SDS waxay isticmaashaa dhawaaqa la saadaaliyay ee moodeelka si toos ah pixels-yada la sameeyay. Ku celcelinta tan kumanaan aragtiyo ayaa sawiraysa hanti 3D ah oo isku xidhan, oo dhammaystiran oo leh joomatari iyo muuqaalka ku-tiirsanaanta, laga bilaabo hal jumlad.
Aragtida Farsamada
SDS waxay ula dhaqantaa qaabka faafinta sidii shaqo dhibco la qaboojiyey. Waxay soo saartaa NeRF, waxay kordhisaa buuqa, waxay waydiisaa U-Net faafinta si ay u saadaaliso buuqaas, waxayna u xisaabisaa jaantuska sida (sanqadha la saadaaliyay ee laga jaray buuqa lagu daray) dib loogu riixay sawirka la sameeyay oo sidaas darteed miisaanka NeRF. Ka boodista U-Net Jacobian waxay ka dhigtaa mid la heli karo. Hagitaan-free-classifier sare (qiyaastii 100) ayaa loo baahan yahay si loo helo natiijooyin fiiqan, taas oo sababta sifada aad u buuxsantay, mararka qaarkoodna wareersan 'DreamFusion look'.
Saamaynta Istiraatijiyadeed
Xawaaraha iyo miisaanka
Visual AI wuxuu si otomaatig ah u samayn karaa baadhista, ogaanshaha, iyo sumadaynta hawlaha miisaanka.
Xulashada dhismayaasha
Kooxaha hal-abuurka leh waxay hindise karaan fikradaha si dhakhso leh iyagoo leh dib-u-eegis buugeed yar.
Kooxda iyo socodka shaqada
Hawlgalladu waxay isticmaali karaan calaamadaha muuqaalka iyo muuqaalka kuwaas oo markii hore adkeyd in la farsameeyo.
Mustaqbalka DreamFusion iyo Saamaynta Distillation Dhibcaha
SDS waxa ay dhalisey khad qani ah oo shaqo ah oo hagaajinaysa daciifnimadeeda: Magic3D ee xallinta iyo xawaaraha, Dhibcaha Kala Duwan ee ProlificDreamer ee fiiqan, wax soo saar badan oo kala duwan, iyo habab lagu weerarayo farshaxanada wejiyada badan ee 'Janus'. Goobtu waxay si isa soo taraysa u lamaanaynaysaa SDS oo leh aragtiyo kala duwan oo hore iyo muuqaalo 3D degdeg ah sida Gaussian Splatting. Filo qoraalka-to-3D inuu u koraan si dhakhso leh oo joomatari ahaan aamin ah, adoo ku soo koobaya farqiga hantida gacanta lagu qaabeeyey.
Dhaqangelinta Adduunka-dhabta ah
Soo saarista nooc 3D ah 'sawirka DSLR ee Dabagaale xidhan koofiyad yar' qoraalka oo keliya
Abuuritaanka ciyaarta qabyada ah iyo hantida AR iyadoon gacanta lagu sawirin 3D
Soo saarista meshes dhoofin kara oo fannaaniintu sifeeyaan halkii ay ka dhisi lahaayeen meel eber ah
Saldhigyada cilmi-baarista ee qiimaynta hababka cusub ee qoraalka-3D ee ka dhanka ah SDS
Khatarta & Dariiqyada Ilaalada
Xuquuqda sawirka iyo ogolaanshaha waxay noqon kartaa khataro sharci ah haddii caddayntu aanay caddayn.
Waxqabadka moodeelku wuu ku kala duwanaan karaa iftiinka, tirakoobka, iyo deegaanka.
Wanaagga beenta ah waxa laga yaabaa inaan la dareemin ilaa xadka kalsoonida aan la kormeerin.
Qorshe Hawleedka Dhaqangelinta
Qeex shuruudaha aqbalida ee saxnaanta, dib u celinta, iyo kharashyada khaladka.
Ku tijaabi xogta ku habboon xaaladaha wax soo saarka dhabta ah.
Ku dar dib u eegis bini'aadamka si aad u hesho kalsoonida hoose ama saameeynta sare.
Lasoco moodeel dhaqaaqa oo dib u cusboonaysii kamarada ama xogta kaydinta ka dib.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DreamFusion and Score Distillation Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Qaababka Dhalmada ku Salaysan Dhibcaha
Su'aalaha soo noqnoqda
What is DreamFusion and Score Distillation Sampling?
DreamFusion waxay ka soo saartaa walxaha 3D qoraalka iyadoo la adeegsanayo qaabka faafinta sawirka 2D dhaleeceyn ahaan, waligiisna uma tababarin xogta 3D kasta. Hal-abuurkeeda udub-dhexaadka ah, Dhibcaha Distillation Sampling, ayaa noqday habka aasaasiga ah ee qoraalka-u-3D oo dhan.
Waa maxay matalaadda 3D ee DreamFusion ay hagaajiso?
DreamFusion waxay wanaajisaa NeRF si aragtideeda la soo bandhigay ay qanciso qaabka faafinta 2D ee xukunka isla qoraalka.
Intee in le'eg ayay xogta tababarka 3D DreamFusion u baahan tahay?
DreamFusion waxay isticmaashaa qaab baahinta qoraal-u-sawir 2D la qaboojiyey oo ah kormeerkeeda kaliya, oo aan u baahnayn xogta tababarka 3D.
Waa maxay furaha gaaban ee xisaabinta ee Dhibcaha Distillation Sampling?
SDS waxay isticmaashaa sawaxanka la saadaaliyay-laga jaray ee lagu daray sida jaangooyooyin toos ah ee pixels-ka la sameeyay, iyada oo ka fogaanaysa U-Net Jacobian-ka qaaliga ah.
Maxay DreamFusion u isticmaashaa hagitaan bilaash ah oo aad u sarreeya (~ 100)?
Jimicsiga SDS waa buuq badan yahay waana daciif, sidaa darteed hagitaan aan caadi ahayn oo sare ayaa loo baahan yahay si loo helo joomatari degdeg ah oo qallafsan, inkasta oo ay keento dhereg badan.
Qaabkee 2D u adeegsaday DreamFusion asalka ah sidii uu barafoobay ka hor?
DreamFusion waxaa lagu dhisay Google's Imagen text-to-saw model baahinta sida shaqada dhibcaha la qaboojiyay.