DreamFusion na Nlele Distillation Score
DreamFusion na-ewepụta ihe 3D site na ederede site na iji ụdị mgbasa ozi onyonyo 2D dị ka onye nkatọ, ọ nweghị ọzụzụ na data 3D ọ bụla.
Nchịkọta
Its core invention, Score Distillation Sampling, became the foundational recipe for the entire text-to-3D field.
Ime miri emi
DreamFusion, sitere na Google na 2022, jụrụ: ọ nwere ike na ụdị ederede gaa na onyonyo 2D kụziere ihe nkiri 3D ka ọ dị mma site n'akụkụ ọ bụla? Ọ na-ebuli NeRF (Neural Radiance Field) ka ntụgharị sitere na nlele igwefoto enweghị usoro, mgbe a na-eme mkpọtụ ma gosi ya na ụdị mgbasa ozi oyi kpọnwụrụ (Imagen), akara dị ka onyonyo nwere ezi uche maka ngwa ngwa ederede. N'ụzọ dị mkpa ọ naghị eji data ọzụzụ 3D. Ọganihu a bụ Score Distillation Sampling (SDS): kama ịgbasa site na U-Net dị oke ọnụ nke ụdị mgbasa ozi, SDS na-eji mkpọtụ amụma amụma dị ka mgbama gradient ozugbo na pikselụ egosipụtara. Ikwugharị nke a n'ofe puku kwuru puku echiche na-akpụpụta akụ 3D na-arụkọ ọrụ ọnụ, juputara na geometry na ọdịdị dabere na nlele, site na otu ahịrịokwu.
Nghọta nka nka
SDS na-ewere ụdị mgbasa ozi dị ka ọrụ akara oyi kpọnwụrụ akpọnwụ. Ọ na-atụgharị NeRF, na-agbakwụnye mkpọtụ, na-arịọ U-Net mgbasa ozi ka ọ buru amụma mkpọtụ ahụ, ma na-agbakọ gradient dị ka (mkpọtụ amụma na-ebelata mkpọtụ agbakwunyere) na-atụgharị azụ na onyinyo ahụ egosipụtara ma si otú a na-atụle NeRF. Ịwụfe U-Net Jacobian na-eme ka ọ dị mfe traktị. Ntuzi aka na-enweghị nkewa dị elu (ihe dị ka 100) ka achọrọ maka nsonaazụ dị nkọ, nke na-ebute njirimara ahụ jujuru oke, mgbe ụfọdụ na-adịghị ahụkebe 'DreamFusion anya.'
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Visual AI nwere ike megharịa nyocha, nchọpụta na mkpado ọrụ n'ọtụtụ.
Mee nhọrọ
Otu ndị na-emepụta ihe nwere ike imepụta echiche ngwa ngwa site na ngbanwe akwụkwọ ntuziaka ole na ole.
Team na usoro ọrụ
Ọrụ nwere ike iji onyonyo na akara vidiyo siri ike ịhazi.
Ọdịnihu nke DreamFusion na nlele Distillation Score
SDS weputara ahịrị ọrụ bara ụba na-edozi adịghị ike ya: Magic3D maka mkpebi na ọsọ ọsọ, ProlificDreamer's Variational Score Distillation for sharper, different results, na ụzọ na-awakpo 'Janus' multi-face artifact. Ogige ahụ na-ejikọta SDS na ụzọ mgbasa ozi multi-view na ihe nnọchianya 3D ngwa ngwa dị ka Gaussian Splatting. Na-atụ anya ka ederede-gaa na-3D ga-eto ngwa ngwa yana kwesị ntụkwasị obi geometric karịa, na-eji akụ ejiri aka mee ka ọdịiche ahụ dị warara.
Mmejuputa n'ezie n'ụwa
Ịmepụta ụdị 3D nke 'foto DSLR nke squirrel yi obere okpu' site na ederede naanị
Ịmepụta ihe egwuregwu na akụrụngwa AR na-enweghị ihe osise 3D ntuziaka
Na-emepụta meshes enwere ike ịpụpụ nke ndị na-ese ihe na-emecha kama ịrụpụta site na ọkọ
Usoro nyocha maka nyocha ụzọ ederede-gaa-3D ọhụrụ megide SDS
Ihe ize ndụ & okporo ụzọ nche
Ikike onyonyo na nkwenye nwere ike bụrụ ihe egwu dị n'iwu ma ọ bụrụ na edoghị anya.
Ọrụ nlereanya nwere ike ịdịgasị iche n'ofe ọkụ, igwe mmadụ, na gburugburu.
Enwere ike ghara ịhụ ihe dị mma ma ọ bụrụ na enyochaghị oke ntụkwasị obi.
Map mmejuputa
Kọwaa ụkpụrụ nnabata maka nkenke, icheta, na ụgwọ njehie.
Nwalee na data dabara na ọnọdụ mmepụta n'ezie.
Tinye nyocha mmadụ maka obere obi ike ma ọ bụ amụma mmetụta dị elu.
Sochie ihe nlere anya wee megharịa ka emechara mgbanwe igwefoto ma ọ bụ dataset.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DreamFusion and Score Distillation Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ụdị Ọdịbendị dabere na akara
Ajụjụ a na-ajụkarị
What is DreamFusion and Score Distillation Sampling?
DreamFusion na-ewepụta ihe 3D site na ederede site na iji ụdị mgbasa ozi onyonyo 2D dị ka onye nkatọ, ọ nweghị ọzụzụ na data 3D ọ bụla. Isi ihe mepụtara, Score Distillation Sampling, ghọrọ nhazi ntọala maka mpaghara ederede-gaa-3D dum.
Kedu ihe nnọchi anya 3D DreamFusion na-ebuli?
DreamFusion na-ebuli NeRF ka echiche ya egosipụtara mejuo mkpebi nke ụdị mgbasa ozi 2D nke ngwa ngwa ederede.
Kedu data ọzụzụ 3D DreamFusion chọrọ?
DreamFusion na-eji ụdị mgbasa ozi ederede gaa na onyonyo 2D oyi kpọnwụrụ dị ka naanị nlekọta ya, na-achọghị data ọzụzụ 3D.
Gịnị bụ igodo mkpirisi mkpirisi dị na Score Distillation Sampling?
SDS na-eji mkpọtụ agbakwunyere-mwepu amụma dị ka gradient ozugbo na pikselụ arụpụtara, na-ezere U-Net Jacobian dị ọnụ ahịa.
Kedu ihe kpatara DreamFusion ji eji ntụzịaka na-enweghị ọkwa ọkwa dị elu (~ 100)?
SDS gradient na-eme mkpọtụ ma na-esighi ike, yabụ ntuziaka dị elu na-adịghị ahụkebe chọrọ maka geometry dị ngwa ngwa, n'agbanyeghị na ọ na-ebute oke saturation.
Kedu ụdị 2D ka DreamFusion mbụ jiri dị ka oyi kpọnwụrụ tupu ya?
Ewubere DreamFusion na Google's Imagen ụdị mgbasa ozi ederede gaa na onyonyo dị ka ọrụ akara oyi kpọnwụrụ.