Dubawa
MusicLM shine Google's samfurin rubutu-zuwa-kaɗe-kaɗe wanda ke samar da madaidaitan sauti na mintuna da yawa daga kwatance kamar 'waƙar violin mai kwantar da hankali wanda ke da goyan bayan gurguwar gitar riff.' Yana da mahimmanci saboda ya warware tsarin kida na dogon zango ta hanyar tara ƙira a cikin matsayi, yana kula da tsarar kiɗa kamar ƙirar harshe akan alamun sauti.
Tsarin Kiɗa na MusicLM yana zaune a cikin ayyukan audio-AI waɗanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai.
Zurfafa nutsewa
An sanar da shi ta Google Bincike a farkon 2023, MusicLM yana tsara tsararrun kiɗan azaman tsinkaya jeri na alamun sauti mai ma'ana, kamar samfurin harshe yana tsinkayar kalmomi. Yana amfani da matsayi na wakilci: alamomin ma'ana (daga samfurin da ake kira w2v-BERT) yana ɗaukar tsari mai girma kamar waƙa da kari akan dogon lokaci, yayin da alamun sauti (daga SoundStream neural codec) suna ɗaukar cikakkun bayanai kamar timbre da rubutu. Mataki na farko yana haifar da alamomin ma'ana daga saƙon rubutu, sa'an nan kuma matakai na gaba suna cika cikakkun bayanan sauti da aka tsara akan waɗannan tarukan. Tsarin rubutu ya fito daga MuLM/MuLan, haɗin gwiwar rubutun kiɗa-rubutu waɗanda aka horar da su don haka kwatanci da ƙasa mai jiwuwa a sarari ɗaya. Wannan tsarin da aka tsara yana ba wa MusicLM damar kasancewa daidai da kida na mintina kaɗan maimakon yawo bayan ƴan daƙiƙa.
Fahimtar Fasaha
Makullin ra'ayi shine ɓata tsari daga rubutu a cikin tsarin alama. Alamun ma'anar ma'anar ƙaƙƙarfan ƙaƙƙarfan alamomi ba su da yawa kuma suna canzawa sannu-sannu, don haka Transformer zai iya yin ƙira na dogon lokaci ba tare da babban tsayin jeri ba. Alamu na Acoustic suna da yawa kuma suna da girma, amma kawai suna buƙatar yin annabta sharadi akan ƙayyadaddun ƙayyadaddun ƙayyadaddun ma'anar, yin kowane mataki ana iya gani. Ƙididdigar saura vector na SoundStream yana samar da lambobi masu ƙira waɗanda na'urar yankewa ta ƙarshe ta juya baya zuwa 24 kHz waveforms.
Jagorar Kiɗa LM Tsararriyar Kiɗa
MusicLM shine Google's samfurin rubutu-zuwa-kaɗe-kaɗe wanda ke samar da madaidaitan sauti na mintuna da yawa daga kwatance kamar 'waƙar violin mai kwantar da hankali wanda ke da goyan bayan gurguwar gitar riff.' Yana da mahimmanci saboda ya warware tsarin kida na dogon zango ta hanyar tara ƙira a cikin matsayi, yana kula da tsarar kiɗa kamar ƙirar harshe akan alamun sauti. Tsarin Kiɗa na MusicLM yana zaune a cikin ayyukan audio-AI waɗanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai. Don gina zurfin fahimta, bi da MusicLM Hierarchical Generation a matsayin samfurin aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu ke buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da Ƙarfafan Kiɗa na MusicLM suna ɗaukar inganci, jinkiri, da yarda a matsayin daidaitattun sassa na dabarun turawa. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A lokaci guda, rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Juyar da rubutaccen bayanin fage zuwa fim ko makin tirela, misali. 'Epic Orchestral gini tare da mawaƙa'
Ƙirƙirar kiɗan baya da aka sharadi akan taken hoto ko ma bayanin zanen kayan aikin fasaha
Ƙaddamar da ɗan gajeren waƙa ko busa waƙa zuwa cikakken tsari na kayan aiki
Samar da nau'ikan waƙoƙi-kiɗa daban-daban a lokaci daban-daban da yanayi don talla da masu ƙirƙirar abun ciki
Hanyoyin Aiwatarwa
Ƙarfin Kiɗa na MusicLM a aikace
Juyar da rubutaccen bayanin fage zuwa fim ko makin tirela, misali. 'epic orchestral build with choir'.
Juyar da rubutaccen bayanin fage zuwa fim ko makin tirela, misali. Ƙungiyoyin 'epic orchestral build with choir' yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da tsadar kurakurai a kan lokaci.
Ƙarfin Kiɗa na MusicLM a aikace
Ƙirƙirar kiɗan baya da aka sharadi akan taken hoto ko ma bayanin zanen kayan aikin fasaha.
Ƙirƙirar kiɗan baya da aka sanya akan hoton hoto ko ma zanen kwatancen don shigarwar fasaha Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure a kan lokaci.
Ƙarfin Kiɗa na MusicLM a aikace
Ƙaddamar da ɗan gajeren waƙa ko busa waƙa zuwa cikakken tsari na kayan aiki.
Ƙaddamar da ɗan gajeren waƙa ko busa waƙa cikin cikakken tsari na kayan aiki Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da kuma bibiyar nasarorin samarwa da tsadar kurakurai a kan lokaci.
Ƙarfin Kiɗa na MusicLM a aikace
Samar da nau'ikan waƙoƙi-kiɗa daban-daban a lokaci daban-daban da yanayi don talla da masu ƙirƙirar abun ciki.
Samar da nau'ikan waƙoƙi-kiɗa daban-daban a lokaci daban-daban da yanayi don talla da masu ƙirƙirar abun ciki Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in ƙira, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.
Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.
Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.
Taswirar Hanya
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Gwajin ingantattun masu magana daban-daban da yanayin baya.
Gwajin ingantattun masu magana daban-daban da yanayin baya. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.