MusicLM: Ihe nrịbama nke Semantic na Acoustic
MusicLM bụ ihe atụ ederede gaa na egwu Google nke na-ewepụta ọdịyo ogologo oge site n'usoro akara semantic maka nhazi egwu yana akara ụda maka nkọwa ụda.
Ime miri emi
Nchoputa nke Google kwuputara na mbido 2023, MusicLM weputara ọgbọ egwu dika ibu amụma usoro nke token ọdịyo dị iche, dịka ụdị asụsụ na-ebu amụma okwu. Ọ na-eji usoro ihe nnọchi anya: akara semantic (site na ihe nlereanya a na-akpọ w2v-BERT) weghara usoro dị elu dị ka abụ abụ na uda n'ogologo ogologo oge, ebe akara ụda olu (nke sitere na SoundStream neural codec) na-ejide nkọwa dị mma dị ka timbre na udidi. Nkebi nke mbụ na-ewepụta akara mmụta semantic site na ngwa ngwa ederede, emesia nkebi emechaa dejupụta nkọwa ụda olu dabara na semantics ndị ahụ. Ndozi ederede sitere na MuLM/MuLan, mgbakwunye egwu-ederede egwu a zụrụ azụ ka nkọwa ya na ala ọdịyo n'otu oghere. Ụzọ a haziri ahazi na-eme ka MusicLM nọgide na-egwu egwu n'ofe nkeji kama ịnyagharị ka obere oge gasịrị.
Nghọta nka nka
Echiche bụ isi bụ ngbanwe nhazi site na udidi n'ofe ọkwa ọkwa. Ihe nrịbama semantic siri ike na-adị obere ma na-agbanwe nwayọ, yabụ Transformer nwere ike ịṅomi ụdị ogologo oge na-enweghị nnukwu ogologo usoro. Ihe nrịbama Acoustic dị oke ma dị elu, mana ọ dị ha mkpa naanị ibu amụma amụma na semantics edoberelarị, na-eme ka ọkwa ọ bụla nwee ike ịnwe ya. SoundStream's residual vector quantization's na-ewepụta koodu ụda oyi akwa nke onye nrụpụta ikpeazụ na-atụgharị azụ n'ụdị ebili mmiri 24 kHz.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke MusicLM: Semantic Semantic na Acoustic Tokens
Ụzọ akara akara nke MusicLM ghọrọ ihe nlere anya maka sistemu ndị ọzọ dị ka MusicGen na ngwa egwu azụmahịa. Na-atụ anya ntụzịaka ụda olu siri ike (hum a tune, nweta nhazi zuru oke), egwu a haziri nke ọma nwere amaokwu na ukwe, yana njikwa ka mma karịa ngwa na igodo. Okwu ndị dị n'ogwu bụ iwu na ụkpụrụ: ịnye ikike data ọzụzụ, nkwenye onye na-ese ihe, na ntinye mmiri na-emepụta ọdịyo ka e wee nwee ike ịmata ya na egwu mmadụ mere bụ isi ugbu a na mbugharị.
Mmejuputa n'ezie n'ụwa
Ịtụgharị nkọwa ọnọdụ edere ka ọ bụrụ akara ihe nkiri ma ọ bụ akara ụgbọala, dịka. 'Epic orchestral jiri ukwe wuo'
Ịmepụta egwu ndabere dabere na isiokwu onyonyo ma ọ bụ ọbụna nkọwa eserese maka nrụnye nka
Na-agbatị abụ mkpirisi mkpirisi ma ọ bụ fụrụ afụ n'ime nhazi ngwa ngwa zuru oke
Na-emepụta egwu-egwu dị iche iche n'oge dị iche iche na ọnọdụ maka mgbasa ozi na ndị na-emepụta ọdịnaya
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the MusicLM: Hierarchical Semantic and Acoustic Tokens quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ọgbọ Egwu Ihe atụ
Ajụjụ a na-ajụkarị
What is MusicLM: Hierarchical Semantic and Acoustic Tokens?
MusicLM bụ ihe atụ ederede gaa na egwu Google nke na-ewepụta ọdịyo ogologo oge site n'usoro akara semantic maka nhazi egwu yana akara ụda maka nkọwa ụda.
Kedu ka MusicLM si emeso ọrụ nke imepụta egwu n'ụzọ bụ isi?
MusicLM na-esetịpụ ọgbọ egwu dị ka amụma na-agbagha agbagha maka akara ọdịyo dị iche, dịka otu ụdị asụsụ si ebu amụma okwu.
Kedu ọrụ nke token semantic na MusicLM?
Ihe nrịbama nke semantic (sitere na w2v-BERT) na-ejide usoro na-agbanwe ngwa ngwa dị ka egwu egwu na uda n'ogologo.
Kedu akụrụngwa na-enye nkọwa ụda dị mma dị ka timbre na udidi?
Ihe nrịbama Acoustic sitere na SoundStream neural codec wee tinye nkọwa dị mma dị ka timbre na udidi.
Kedu ka MusicLM si ejikọta ngwa ngwa ederede na ọdịyo egwu?
A zụrụ MuLan ka nkọwa ederede na maapụ ọdịyo dabara na isi ihe dị nso na oghere agbakwunyere na-ekekọrịta, na-enye nkwado ederede.
Kedu ihe kpatara nhazi ọkwa, nhazi nhazi na-enye aka na nhazi ogologo oge?
Ihe nrịbama semantic dị obere na-agbanwe nwayọ, yabụ onye ntụgharị nwere ike ịdepụta ụdị ogologo oge nke ọma tupu ejupụta nkọwa ụda olu.