DreamFusion da Samfurin Distillation Score
DreamFusion yana haifar da abubuwa na 3D daga rubutu ta amfani da samfurin watsa hoto na 2D azaman mai suka, ba tare da yin horo akan kowane bayanan 3D ba.
Dubawa
Its core invention, Score Distillation Sampling, became the foundational recipe for the entire text-to-3D field.
Zurfafa nutsewa
DreamFusion, daga Google a cikin 2022, an yi tambaya: shin samfurin rubutu-zuwa hoto na 2D zai iya koyar da yanayin 3D don yin kama da kowane kusurwa? Yana inganta NeRF (Filin Radiance Neural) ta yadda za a yi daga ra'ayoyin kamara bazuwar, lokacin da aka yi hayaniya da nunawa ga samfurin watsawa daskararre (Imagen), maki azaman hotuna masu dacewa don saurin rubutu. Mahimmanci ba ya amfani da bayanan horo na 3D. Ci gaban shine Samfurin Distillation Sampling (SDS): maimakon yada baya ta hanyar U-Net mai tsadar ƙirar ƙirar, SDS yana amfani da hayaniyar annabta samfurin azaman siginar gradient kai tsaye akan pixels da aka yi. Ƙaddamar da wannan a cikin dubban ra'ayoyi yana zana kadara ta 3D mai daidaituwa, cikakke tare da nau'in lissafi da kamanni mai dogaro, daga jumla ɗaya.
Fahimtar Fasaha
SDS yana ɗaukar samfurin watsawa azaman aikin zura kwallaye daskararre. Yana sanya NeRF, yana ƙara amo, yana tambayar U-Net ɗin watsawa don tsinkayar wannan amo, kuma yana ƙididdige ƙarar kamar yadda (hawan da aka annabta ya rage ƙarar ƙara) da aka tura baya kan hoton da aka yi don haka ma'aunin NeRF. Tsallake U-Net Jacobian yana sa ya zama mai iya gani. Ana buƙatar babban jagora mara rarrabuwa (kimanin 100) don sakamako mai kaifi, wanda ke haifar da sifa mai cike da cikakkiya, wani lokacin kuma 'kallon DreamFusion' mara kyau.
Dabarun Tasiri
Gudu da sikelin
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Gina zaɓuɓɓuka
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiya da aikin aiki
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Makomar DreamFusion da Samfurin Distillation Score
SDS ya haifar da wadataccen layin aiki na gyara rauninsa: Magic3D don ƙuduri da sauri, ProlificDreamer's Variational Score Distillation don ƙwanƙwasa, ƙarin fitowar daban-daban, da hanyoyin kai hari ga kayan tarihi masu yawa na 'Janus'. Filin yana ƙara haɗawa da SDS tare da manyan abubuwan watsawa da yawa da kuma saurin wakilcin 3D kamar Gaussian Splatting. Yi tsammanin rubutu-zuwa-3D ya yi girma da sauri da aminci na geometric, yana rage tazarar da kadarorin da aka kera ta hannu.
Aiwatar da Gaskiyar Duniya
Samar da samfurin 3D na 'hoton DSLR na squirrel sanye da karamar hula' daga rubutu kadai
Ƙirƙirar daftarin wasan da kadarorin AR ba tare da sassaƙa 3D na hannu ba
Samar da ragamar fitarwa wanda masu fasaha ke tacewa maimakon yin gini daga karce
Tushen bincike don kimanta sabbin hanyoyin rubutu-zuwa-3D akan SDS
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DreamFusion and Score Distillation Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Samfuran Ƙarfafa Maki
Tambayoyin da ake yawan yi
What is DreamFusion and Score Distillation Sampling?
DreamFusion yana haifar da abubuwa na 3D daga rubutu ta amfani da samfurin watsa hoto na 2D azaman mai suka, ba tare da yin horo akan kowane bayanan 3D ba. Babban ƙirƙirar sa, Score Distillation Sampling, ya zama tushen girke-girke na gabaɗayan filin rubutu-zuwa-3D.
Menene wakilcin 3D DreamFusion ya inganta?
DreamFusion yana haɓaka NeRF don haka ra'ayoyin sa sun gamsar da samfurin watsawa na 2D game da saurin rubutu.
Nawa ne bayanan horo na 3D DreamFusion ke buƙata?
DreamFusion yana amfani da daskararre 2D samfurin watsa rubutu-zuwa hoto azaman kulawar sa kawai, baya buƙatar bayanan horo na 3D.
Menene gajeriyar hanyar lissafin maɓalli a cikin Samfurin Distillation Score?
SDS yana amfani da hayaniyar da aka annabta-rasa azaman ƙarar kai tsaye akan pixels da aka yi, da guje wa U-Net Jacobian mai tsada.
Me yasa DreamFusion ke amfani da jagorar kyauta mafi girma (~ 100)?
SDS gradient yana da surutu kuma yana da rauni, don haka ana buƙatar babban jagora na musamman don kintsattse, jigo mai kai tsaye, kodayake yana haifar da cikas.
Wane samfurin 2D ne ainihin DreamFusion yayi amfani dashi azaman daskarewa a baya?
DreamFusion an gina shi akan Google's Imagen samfurin yaduwa rubutu-zuwa-hoto a matsayin aikin daskararre.