Inzozi zo Guhuza hamwe no Gutanga amanota
DreamFusion itanga ibintu bya 3D bivuye mumyandiko ukoresheje 2D ishusho yo gukwirakwiza amashusho nkunegura, ntukigere uhugura kumibare iyo ari yo yose ya 3D.
Incamake
Its core invention, Score Distillation Sampling, became the foundational recipe for the entire text-to-3D field.
Kwibira cyane
DreamFusion, kuva Google muri 2022, yabajije: moderi ya 2D inyandiko-y-ishusho ishobora kwigisha amashusho ya 3D kureba neza muburyo bwose? Ihindura NeRF (Neural Radiance Field) kugirango ihindurwe riva kuri kamera itabishaka, iyo isakaye kandi ikerekanwa kuri moderi ikwirakwizwa (Imagen), amanota nkibishusho byemewe kubisobanuro byihuse. Byibanze ntabwo ikoresha amakuru yamahugurwa ya 3D. Icyagezweho ni Score Distillation Sampling (SDS): aho gusubira inyuma binyuze muri moderi ya diffuzion ya U-Net ihenze, SDS ikoresha urusaku rwahanuwe nkikimenyetso cyerekana buhoro buhoro kuri pigiseli yatanzwe. Guhindura ibi mubihumbi n'ibihumbi byerekana ibintu byerekana umutungo wa 3D, wuzuye hamwe na geometrike hamwe nuburyo bugaragara, uhereye kumurongo umwe.
Ubushishozi
SDS ifata moderi yo gukwirakwiza nkigikorwa cyo gutanga amanota yahagaritswe. Ihindura NeRF, ikongeramo urusaku, isaba ikwirakwizwa U-Net guhanura urwo rusaku, ikanagereranya icyiciro nkuko (urusaku rwahanuwe ukuyemo urusaku rwongeweho urusaku) rusubiza inyuma ku ishusho yatanzwe bityo uburemere bwa NeRF. Gusimbuka U-Net Jacobian bituma bikurikirana. Ubuyobozi bwo hejuru butarangwamo ubuyobozi (hafi 100) burakenewe kubisubizo bikarishye, bitera ibiranga kurenza urugero, rimwe na rimwe bitagaragara neza 'DreamFusion reba.'
Ingaruka z'Ingamba
Umuvuduko n'igipimo
AI igaragara irashobora gukora igenzura, gutahura, no gutondekanya imirimo kurwego.
Build choices
Amakipe arema arashobora prototype ibitekerezo byihuse hamwe nintoki nkeya.
Itsinda hamwe nakazi
Ibikorwa birashobora gukoresha amashusho nibimenyetso bya videwo byari bigoye gutunganya.
Kazoza ka DreamFusion hamwe no Gutanga amanota
SDS yabyaye umurongo utubutse wimirimo ikosora intege nke zayo: Magic3D yo gukemura no kwihuta, ProlificDreamer Variational Score Distillation kubisubizo bikaze, byinshi bitandukanye, hamwe nuburyo bwibasiye ibihangano bya 'Janus'. Umwanya uragenda uhuza SDS hamwe nuburyo bwinshi bwo gukwirakwiza ibiyobora hamwe na 3D yihuta nka Gaussian Splatting. Tegereza inyandiko-kuri-3D gukura byihuse kandi byizerwa bya geometrike, bigabanya icyuho numutungo wagereranijwe n'intoki.
Gushyira mu bikorwa Isi
Gukora moderi ya 3D ya 'DSLR ifoto yigituba yambaye ingofero nto' uhereye kumyandiko yonyine
Gukora umushinga wimikino numutungo wa AR udafite intoki za 3D
Gukora meshes zoherezwa hanze abahanzi batunganya aho kubaka guhera
Ibyingenzi byubushakashatsi bwo gusuzuma uburyo bushya bwanditse-kuri 3D burwanya SDS
Ingaruka & Kurinda
Uburenganzira bwishusho hamwe no kwemererwa birashobora guhinduka ibyago byemewe n'amategeko niba ibimenyetso bidasobanutse.
Imikorere yicyitegererezo irashobora gutandukana kumurika, demografiya, nibidukikije.
Ibyiza byibinyoma birashobora kutamenyekana keretse niba ibyiringiro byateganijwe bikurikiranwa.
Igishushanyo mbonera
Sobanura ibipimo byo kwemererwa kugiciro, kwibutsa, nibiciro byamakosa.
Gerageza hamwe namakuru ajyanye nuburyo nyabwo bwo gukora.
Ongeraho isubiramo ryabantu kubwizere buke cyangwa guhanura cyane.
Kurikirana icyitegererezo cya drift hanyuma uhindurwe nyuma ya kamera cyangwa dataset ihinduka.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the DreamFusion and Score Distillation Sampling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Amanota-ashingiye kubikorwa rusange
Ibibazo bikunze kubazwa
What is DreamFusion and Score Distillation Sampling?
DreamFusion itanga ibintu bya 3D bivuye mumyandiko ukoresheje 2D ishusho yo gukwirakwiza amashusho nkunegura, ntukigere uhugura kumibare iyo ari yo yose ya 3D. Ivumburwa ryibanze ryayo, Score Distillation Sampling, ryabaye igisubizo cyibanze kumyandiko yose kugeza kuri 3D.
Ni ubuhe buryo bwa 3D bwerekana DreamFusion itezimbere?
DreamFusion itezimbere NeRF kuburyo ibitekerezo byayo bihaza 2D ikwirakwizwa ryikigereranyo cyimyandikire.
Ni bangahe amakuru yamahugurwa ya 3D akeneye DreamFusion?
DreamFusion ikoresha icyerekezo cya 2D cyakonjeshejwe-cyerekana-ishusho yo gukwirakwiza nk'ubugenzuzi bwonyine, bisaba ko nta makuru y'amahugurwa ya 3D.
Ni ubuhe buryo bw'ingenzi bwo kubara muri Score Distillation Sampling?
SDS ikoresha urusaku rwahanuwe-gukuramo urusaku nka gradient itaziguye kuri pigiseli yatanzwe, irinda U-Net Jacobian ihenze.
Kuki DreamFusion ikoresha ubuyobozi bwo hejuru cyane-butayobora (~ 100)?
Ikigereranyo cya SDS ni urusaku n'intege nke, kubwibyo bidasanzwe ubuyobozi bukenewe burakenewe kuri crisp, kuri geometrie yihuse, nubwo itera kwiyuzuza birenze.
Ni ubuhe bwoko bwa 2D bwa mbere DreamFusion yakoresheje nkubukonje bwayo mbere?
DreamFusion yubatswe kuri __AIU_PROTECTED_11 __ 'Imagen inyandiko-yerekana ishusho yo gukwirakwiza nkumurimo wo gutanga amanota.