DreamFusion ak jël misaalu distilaasioŋ
DreamFusion dafay defar ay mbir 3D ci mbind, ci jëfandikoo xeetu diffusion nataal 2D buy ŋàññi, musul tàggat ci benn done 3D.
Résumé
Its core invention, Score Distillation Sampling, became the foundational recipe for the entire text-to-3D field.
Plongeur bu xóot
DreamFusion, ci Google ci 2022, laaj na: ndax xeetu bind-ci-nataal 2D mën na jàngal ab seen 3D xool bu baax ci bepp wàll? Dafay gëna xéewale NeRF (Neural Radiance Field) suko defee ñu mëna gis ci kamera yu bari, suñu ko defee bruit ba noppi ñu wane ko ci modelu diffusion bu liw (Imagen), ñu am poñ ci nataal yu wóor ngir bind bi. Li gëna am solo mooy jëfandikoowul ay done tàggat yaram 3D. Li gëna doywaat mooy Sampling Distillation Score (SDS): ludul tasaare ci U-Net bu seer bi ci modelu diffusion bi, SDS dafay jëfandikoo bruit bi ñu séentu ci model bi ni siñaal gradient ci kaw pixel yiñ joxe. Baamtu lii ci ay junni-junni gis-gis dafay jël benn mbiri 3D bu lëkkaloo, matt ak geometri ak melokaan bu aju ci gis-gis, ci benn frase.
Gis-gis xarala
SDS dafay jàppee xeetu diffusion bi ni fonction poñ buñ tëye. Dafay joxe NeRF, yokk bruit, laaj diffusion U-Net ngir wax luy waaja am, ba noppi xayma gradient bi (bruit bi ñu wax luy génne bruit biñ yokk) ñu puus ko ci nataal biñ joxe, moo tax NeRF di poids. Soo sànni U-Net Jacobian daf koy gëna yombal. Njàngale mu kawe te amul benn classifier (ci diggu 100) lañu soxla ngir am resultaa yu ñaw, te loolu moo waral màndarga yu bari yi, yenn saa muy fësul 'DreamFusion look.'
njeextalu pexe
Gaawaay ak yaatuwaay
Visual IA mën na otomatise saytu, gis ak etiketu liggéey ci eskaal.
Tabax tànneef
Ekipu kreatif yi mën nañu defar konsept yu gëna gaaw te duñu def lu bari ci loxo.
Ekip ak def liggéey
Liggéeyukaay yi mën nañu jëfandikoo siñaal nataal wala wideo yu jafewoon lool ci liggéey.
Ëlëgu DreamFusion ak jël misaalu distilaasioŋ poñ
SDS jural na liggéey bu bari ngir saafara ay ñakk kattan: Magic3D ngir dayo ak gaawaay, Distillation Score Variational bu ProlificDreamer ngir gëna ñaw, génne yu bari te wuute, ak pexe yuy song 'Janus' artfact bu bari kanam. Doxalin bi dafay gëna boole SDS ak diffusion yu bari yu ñuy gis ak 3D yu gaaw yu melni Gaussian Splatting. Xaarandil ni text-to-3D di gëna gaaw màgg, gëna dëggu ci wàllu geometrie, di wàññi bërëb bi ak ay jumtukaay yuñ defaree loxo.
Doxal ci àdduna dëgg
Defar ab xeetu 3D bu 'nataalu DSLR bu benn xojog bu sol mbaxna bu ndaw' ci bind kese
Defar jeu draft ak ay mbiri AR te du am yatteef 3D ak loxo
Defar ay mbaal yuñ mëna yóbbu ci bitim réew, artist yi di leen raxas ludul tabax ci noonu rek
Liggéeyu gëstu ngir jàngat pexe bind-ci-3D yu bees yi ci SDS
Risk yi ak balustrade yi
Yelleefi nataal ak nangu mën na nekk risku yoon sudee fi ñu bawoo leerul.
Performance model bi mën na wuute ci leeraay bi, demographie bi ak environmaa bi.
Njuumteg positive yi mën nañu dem te kenn duko seetlu fileek xool wuñu buntu wóolu sa bopp.
Roadmap ngir samp gi
Mandargal kritërium nangug njub, woowaat ak njëgu njuumte.
Saytu ak done yu méngoo ak anam yi ñuy liggéeyee dëgg.
Yokk jàngat nit ngir xam fu wóorul dara wala am njeexital yu rëy.
Toppal model drift bi nga baaxal ko ginaaw bi kamera bi wala done yi soppeekoo.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DreamFusion and Score Distillation Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Modèle Generatif yu sukkandiko ci poñ
Laaj yi ñuy faral di laaj
What is DreamFusion and Score Distillation Sampling?
DreamFusion dafay defar ay mbir 3D ci mbind, ci jëfandikoo xeetu diffusion nataal 2D buy ŋàññi, musul tàggat ci benn done 3D. Li gëna am solo ci sos bi mooy, Score Distillation Sampling, moo nekkoon rëset bi gëna am solo ci wàllu bind-ci-3D.
Ban misaalu 3D la DreamFusion gëna mëna jëfandikoo?
DreamFusion dafay gëna baaxal NeRF suko defee gis-gis yi mu joxe méngoo ak àtteb modelu diffusion 2D ci laajtu bind bi.
Ñaata done tàggat yaram 3D la DreamFusion soxla?
DreamFusion dafay jëfandikoo xeetu diffusion 2D bu bind-ci-nataal muy benn surveillance, te soxlawul benn done tàggat 3D.
Lan mooy gaawaayu ordinatër bi gëna am solo ci jël misaalu distilaasioŋ?
SDS dafay jëfandikoo bruit biñ séentu-dindi-ñu yokk ko ni gradient bu jub ci pixel yiñ joxe, moytu U-Net Jacobian bu seer bi.
Lan moo tax DreamFusion di jëfandikoo tegtal bu kawe te amul benn xaaj (~100)?
SDS gradient bi dafa bari bruit te néew doole, kon dañu soxla njiit lu yéeg lool ngir geometrie bu fëgër, ci saasi, doonte dafay waral saturation bu ëpp.
Ban xeetu 2D la DreamFusion bi njëkka jëfandikoo ngir gëna ko gelé?
DreamFusion dañu ko tabax ci kaw xeetu tasaare bind-ci-nataal bu Imagen, muy fonction poñ buñ jël.