Uhlolojikelele
I-MusicLM iyimodeli ye-Google yokuguqula umbhalo ube umculo eyenza imizuzu embalwa yomsindo ohambisanayo encazelweni efana 'nomculo wevayolini opholile osekelwa ukukhala kwesigingci esihlanekezelwe.' Ibalulekile ngoba ixazulule ukwakheka komculo webanga elide ngokubeka amamodeli esigabeni, iphathe isizukulwane somculo njengokumodela kolimi phezu kwamathokheni omsindo.
I-MusicLM Hierarchical Music Generation ihlala ku-audio-AI workflows eguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya.
I-Deep Dive
Imenyezelwe yi-Google Ucwaningo ngasekuqaleni kuka-2023, i-MusicLM imisa isizukulwane somculo njengokubikezela ukulandelana kwamathokheni omsindo ahlukahlukene, njengoba nje imodeli yolimi ibikezela amagama. Isebenzisa ukulandelana kwezethulo: amathokheni e-semantic (asuka kumodeli ebizwa ngokuthi i-w2v-BERT) athwebula ukwakheka kwezinga eliphezulu njengomculo nesigqi ngokudlula isikhathi eside, kuyilapho amathokheni e-acoustic (kusuka ku-SoundStream neural codec) athwebula imininingwane emihle njenge-timbre nokuthungwa. Isigaba sokuqala sikhiqiza amathokheni e-semantic kusuka ekwazisweni kombhalo, bese izigaba zakamuva zigcwalisa imininingwane ye-acoustic ebekwe kuleyo semantiki. Ukulungiswa kombhalo kuvela ku-MuLM/MuLan, ukushumeka kombhalo womculo okuhlanganyelwe okuqeqeshelwe izincazelo nomhlaba womsindo endaweni efanayo. Le ndlela yokwenziwa kwesiteji ivumela i-MusicLM ukuthi ihlale ingashintshile emculweni emaminithini ambalwa kunokuba inyakaze ngemva kwemizuzwana embalwa.
I-Technical Insight
Umbono oyinhloko ukuhlukanisa ukwakheka kusuka ekuthunjweni kuyo yonke i-hierarchy yamathokheni. Amathokheni ama-coarse semantic awancane futhi ashintsha kancane, ngakho-ke i-Transformer ingamodela ifomu lesikhathi eside ngaphandle kobude obukhulu bokulandelana. Amathokheni e-Acoustic aminyene futhi anezinga eliphezulu, kodwa adinga kuphela ukubikezelwa ukuthi abekwe esimweni se-semantics esesivele imisiwe, okwenza isigaba ngasinye sinyakazeke. Ukwandiswa kwevektha eyinsalela ye-SoundStream kukhiqiza amakhodi anezingqimba e-acoustic idikhoda yokugcina ewabuyisela emuva abe amaza angama-24 kHz.
I-Mastering MusicLM Isizukulwane Somculo Esisezingeni eliphezulu
I-MusicLM iyimodeli ye-Google yokuguqula umbhalo ube umculo eyenza imizuzu embalwa yomsindo ohambisanayo encazelweni efana 'nomculo wevayolini opholile osekelwa ukukhala kwesigingci esihlanekezelwe.' Ibalulekile ngoba ixazulule ukwakheka komculo webanga elide ngokubeka amamodeli esigabeni, iphathe isizukulwane somculo njengokumodela kolimi phezu kwamathokheni omsindo. I-MusicLM Hierarchical Music Generation ihlala ku-audio-AI workflows eguqula inkulumo, umculo, nomsindo wokuxhumana, ukufinyeleleka, nokukhiqizwa kwemidiya. Ukuze wakhe ukuqonda okujulile, phatha i-MusicLM Hierarchical Music Generation njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela oyifunayo, ucacise ukucabanga, futhi uhlukanise lokho uhlelo olungakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.
Empeleni, amaqembu aqinile asebenzisa i-MusicLM Hierarchical Music Generation aphatha ikhwalithi, ukubambezeleka, kanye nemvume njengezingxenye ezibalulekile ngokulinganayo zesu lokuthunyelwa. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ngesikhathi esifanayo, ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyakhuphuka uma imvume ingekho. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.
I-Strategic Impact
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.
Ukuqaliswa Komhlaba Wangempela
Ukuguqula incazelo yesigcawu esibhaliwe ibe ifilimu noma i-trailer score, isb. 'i-epic orchestral build with choir'
Ikhiqiza umculo wangemuva ofakwe kumagama-ncazo wesithombe noma izincazelo zokudweba zokufakwa kobuciko
Ukunweba ingoma emfushane ehumed noma enekhwelo ibe uhlelo olugcwele izinsimbi
Ukukhiqiza amathrekhi omculo wesitoko ahlukahlukene ngezikhathi ezihlukene nezimo zokukhangisa nabadali bokuqukethwe
Amaphethini Okusebenzisa
I-MusicLM Hierarchical Music Generation in practice
Ukuguqula incazelo yesigcawu esibhaliwe ibe ifilimu noma i-trailer score, isb. 'i-epic orchestral build with choir'.
Ukuguqula incazelo yesigcawu esibhaliwe ibe ifilimu noma i-trailer score, isb. 'i-epic orchestral build with choir' Amaqembu ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi aphambili, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-MusicLM Hierarchical Music Generation in practice
Ikhiqiza umculo wangemuva ofakwe kumagama-ncazo wesithombe noma izincazelo zokudweba zokufakwa kobuciko.
Ukukhiqiza umculo ongemuva ofakwe kumagama-ncazo wesithombe noma izincazelo zokudweba zokufakwa kobuciko Amaqembu ngokuvamile athola imiphumela engcono uma echaza izilinganiso zekhwalithi ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-MusicLM Hierarchical Music Generation in practice
Ukunweba ingoma emfushane ehumed noma enekhwelo ibe uhlelo olugcwele izinsimbi.
Ukunweba iculo elihumed noma elinekhwelo libe uhlelo olusebenza ngokugcwele Amaqembu ngokuvamile athola imiphumela engcono lapho echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
I-MusicLM Hierarchical Music Generation in practice
Ukukhiqiza amathrekhi omculo wesitoko ahlukahlukene ngezikhathi ezihlukene kanye nemizwa yokukhangisa nabadali bokuqukethwe.
Ukukhiqiza amathrekhi omculo wesitoko ahlukahlukene ngezikhathi ezihlukene nezimo zokukhangisa nabadali bokuqukethwe Amathimba ngokuvamile athola imiphumela engcono uma echaza izinga eliphezulu ngaphambili, egcina indlela yokukhuphuka kwabantu yamakesi aphambili, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.