Dubawa
DreamFusion yana haifar da abubuwa na 3D daga rubutu ta amfani da samfurin watsa hoto na 2D azaman mai suka, ba tare da yin horo akan kowane bayanan 3D ba. Babban ƙirƙirar sa, Score Distillation Sampling, ya zama tushen girke-girke na gabaɗayan filin rubutu-zuwa-3D.
DreamFusion da Score Distillation Sampling na cikin ayyukan aikin hangen nesa na kwamfuta wanda ke fassara ko samar da kafofin watsa labarai na gani don bincike, ayyuka, da kerawa.
Zurfafa nutsewa
DreamFusion, daga Google a cikin 2022, an yi tambaya: shin samfurin rubutu-zuwa hoto na 2D zai iya koyar da yanayin 3D don yin kama da kowane kusurwa? Yana inganta NeRF (Filin Radiance Neural) ta yadda za a yi daga ra'ayoyin kamara bazuwar, lokacin da aka yi hayaniya da nunawa ga samfurin watsawa daskararre (Imagen), maki azaman hotuna masu dacewa don saurin rubutu. Mahimmanci ba ya amfani da bayanan horo na 3D. Ci gaban shine Samfurin Distillation Sampling (SDS): maimakon yada baya ta hanyar U-Net mai tsadar ƙirar ƙirar, SDS yana amfani da hayaniyar annabta samfurin azaman siginar gradient kai tsaye akan pixels da aka yi. Ƙaddamar da wannan a cikin dubban ra'ayoyi yana zana kadara ta 3D mai daidaituwa, cikakke tare da nau'in lissafi da kamanni mai dogaro, daga jumla ɗaya.
Fahimtar Fasaha
SDS yana ɗaukar samfurin watsawa azaman aikin zura kwallaye daskararre. Yana sanya NeRF, yana ƙara amo, yana tambayar U-Net ɗin watsawa don tsinkayar wannan amo, kuma yana ƙididdige ƙarar kamar yadda (hawan da aka annabta ya rage ƙarar ƙara) da aka tura baya kan hoton da aka yi don haka ma'aunin NeRF. Tsallake U-Net Jacobian yana sa ya zama mai iya gani. Ana buƙatar babban jagora mara rarrabuwa (kimanin 100) don sakamako mai kaifi, wanda ke haifar da sifa mai cike da cikakkiya, wani lokacin kuma 'kallon DreamFusion' mara kyau.
Jagorar DreamFusion da Samfurin Distillation Maki
DreamFusion yana haifar da abubuwa na 3D daga rubutu ta amfani da samfurin watsa hoto na 2D azaman mai suka, ba tare da yin horo akan kowane bayanan 3D ba. Babban ƙirƙirar sa, Score Distillation Sampling, ya zama tushen girke-girke na gabaɗayan filin rubutu-zuwa-3D. DreamFusion da Score Distillation Sampling na cikin ayyukan aikin hangen nesa na kwamfuta wanda ke fassara ko samar da kafofin watsa labarai na gani don bincike, ayyuka, da kerawa. Don gina zurfin fahimta, bi DreamFusion da Score Distillation Sampling azaman samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya dogara da abin da har yanzu ke buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi suna amfani da DreamFusion da Score Distillation Samfuran daidaiton daidaito tare da haƙiƙanin aiki kamar ingancin bayanai, bambancin haske, da daidaita alamar alama. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin. A lokaci guda, Haƙƙin Hoto da yarda na iya zama haɗari na shari'a idan ba a fayyace ba. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin.
Kayayyakin AI na iya sarrafa aiki da bincike, ganowa, da ayyuka masu alama a sikelin. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu.
Ƙungiyoyin ƙirƙira za su iya samar da ra'ayoyi cikin sauri tare da ƙarancin bita da hannu. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa.
Ayyuka na iya amfani da siginar hoto da bidiyo waɗanda a baya suke da wahalar aiwatarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Samar da samfurin 3D na 'hoton DSLR na squirrel sanye da karamar hula' daga rubutu kadai
Ƙirƙirar daftarin wasan da kadarorin AR ba tare da sassaƙa 3D na hannu ba
Samar da ragamar fitarwa wanda masu fasaha ke tacewa maimakon yin gini daga karce
Tushen bincike don kimanta sabbin hanyoyin rubutu-zuwa-3D akan SDS
Hanyoyin Aiwatarwa
DreamFusion da Score Distillation Sampling a aikace
Samar da samfurin 3D na 'hoton DSLR na squirrel sanye da karamar hula' daga rubutu kadai.
Ƙirƙirar samfurin 3D na 'hoton DSLR na squirrel sanye da ƙaramin hula' daga rubutu kaɗai Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin diddigin nasarorin samarwa da ƙimar kuskure a kan lokaci.
DreamFusion da Score Distillation Sampling a aikace
Ƙirƙirar daftarin wasan da kadarorin AR ba tare da sassaƙa 3D na hannu ba.
Ƙirƙirar daftarin wasan da kadarorin AR ba tare da ƙwaƙƙwaran ƙwaƙƙwaran 3D na hannu yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
DreamFusion da Score Distillation Sampling a aikace
Samar da ragamar fitarwa wanda masu fasaha ke tacewa maimakon yin gini daga karce.
Samar da ragamar fitarwa wanda masu fasaha ke tsaftacewa maimakon ginawa daga karce Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin duk nasarorin samarwa da farashi na kuskure akan lokaci.
DreamFusion da Score Distillation Sampling a aikace
Tushen bincike don kimanta sabbin hanyoyin rubutu-zuwa-3D akan SDS.
Tushen bincike don kimanta sabbin hanyoyin rubutu-zuwa-3D akan Ƙungiyoyin SDS yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Haƙƙoƙin hoto da yarda na iya zama haxarin doka idan ba a fayyace ba.
Ayyukan samfuri na iya bambanta a ko'ina cikin haske, ƙididdiga, da mahalli.
Ƙarya tabbataccen ƙila ba za a iya lura da shi ba sai dai idan an kula da ƙofofin amincewa.
Taswirar Hanya
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure.
Ƙayyade ma'auni na karɓa don daidaito, tunowa, da farashi na kuskure. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa.
Gwada tare da bayanan da suka dace da ainihin yanayin samarwa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri.
Ƙara bita na ɗan adam don ƙarancin amincewa ko tsinkaya mai tasiri. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai.
Bi diddigin ƙirar ƙira kuma sake ingantawa bayan canje-canjen kamara ko saitin bayanai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.