AudioLM
AudioLM tsarin bincike ne na Google wanda ke samar da ingantaccen sauti - magana ko kiɗan piano - ta hanyar ɗaukar sauti kamar harshe da tsinkayar alama ta alama.
Dubawa
It matters because it showed you can produce coherent, natural-sounding audio continuations without any text transcript or musical score.
Zurfafa nutsewa
An gabatar da shi ta Google a cikin 2022, AudioLM yana sake tsara tsarar sauti a matsayin matsala ta ƙirar harshe: yana jujjuya raƙuman raƙuman ruwa zuwa alamu masu hankali sannan kuma yayi tsinkaya alama ta gaba, kamar yadda ƙirar rubutu ke tsinkayar kalma ta gaba. Babban dabararsa shine matsayi na nau'ikan alama. Alamu 'Semantic' (daga samfuri kamar w2v-BERT) suna ɗaukar tsari na dogon lokaci - sautin sauti, syntax, waƙa - yayin da alamun 'acoustic' (daga lambar lambar sautin sauti na SoundStream) suna ɗaukar cikakkun bayanai kamar asalin mai magana, katako, da yanayin rikodi. Ta farkon annabta alamomin ma'ana, sannan daidaita alamun sauti a kansu, AudioLM yana samar da ci gaba waɗanda ke dawwama cikin daƙiƙa da yawa yayin adana muryar asali ko kayan aiki. Bayan 'yan dakiku na magana, yana ci gaba da magana da murya ɗaya; idan aka ba piano, yana inganta a cikin salo iri ɗaya.
Fahimtar Fasaha
An horar da AudioLM akan sauti kawai - babu kwafi. SoundStream yana damfara sauti cikin alamun sauti ta hanyar ƙididdige ragowar vector, yayin da w2v-BERT ke ba da manyan alamomin ma'ana. Tarin nau'ikan nau'ikan harshe na Transformer yana annabta alamu a cikin matakai: na farko na tauraro don tsari, sannan ƙaƙƙarfan alamun sauti mai kyau don ingantaccen sake ginawa. Mai rikodin sauti na SoundStream a ƙarshe yana juya alamun da aka annabta a baya zuwa tsarin igiyar ruwa, yana samar da sauti wanda ke kiyaye muryar mai magana da daidaito.
Dabarun Tasiri
Shiga ku isa
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.
Kudin da kasafin kuɗi
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.
Gudu da sikelin
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.
Makomar AudioLM
Kayan girke-girke na tushen Alamar AudioLM ya zama ginshiƙan tsarin na baya: Google's AudioLM ra'ayoyin da aka ciyar da su cikin MusicLM don rubutu-zuwa kiɗa da SoundStorm don tsarawa cikin sauri, yayin da fage mai faɗi a yanzu yana haɗa alamomin ma'ana da sauti a cikin magana, kiɗa, da tasirin sauti. Yi tsammanin tsara mai sauri, ainihin lokaci, mafi tsayi daidaitattun bayanai, da sarrafawar multimodal inda rubutu ko wasu sigina ke tafiyar da ƙirar da aka horar da sauti zalla. Dabarun iri ɗaya kuma suna haɓaka damuwa game da rufewar murya da zurfin zurfafa sauti.
Aiwatar da Gaskiyar Duniya
Ci gaba da ɗan gajeren shirin magana a cikin muryar mai magana iri ɗaya da sautin magana ba tare da kwafi ba
Inganta sabon kiɗan piano wanda yayi daidai da salon taƙaitaccen rikodi
Yin hidima azaman kashin baya na tsara-jiwuwa don tsarin rubutu-zuwa kiɗa kamar MusicLM
Bincike cikin haɗin magana wanda ke adana prosody da rikodin sauti daga samfurin
Hatsari & Tsare-tsare
Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.
Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.
Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.
Taswirar Hanya
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.
Gwajin ingantattun masu magana daban-daban da yanayin baya.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AudioLM quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Keyword Spotting da Wake Words
Tambayoyin da ake yawan yi
What is AudioLM?
AudioLM tsarin bincike ne na Google wanda ke samar da ingantaccen sauti - magana ko kiɗan piano - ta hanyar ɗaukar sauti kamar harshe da tsinkayar alama ta alama. Yana da mahimmanci saboda ya nuna cewa zaku iya samar da daidaituwa, ci gaba da sauti na dabi'a ba tare da kowane rubutun rubutu ko maki na kiɗa ba.
Menene ainihin ra'ayi AudioLM ke amfani da shi don samar da sauti?
AudioLM yana jujjuya tsarin raƙuman ruwa zuwa alamu masu hankali kuma yana tsinkaya su bi da bi, yana amfani da tsarin alama na gaba na ƙirar harshe zuwa ɗanyen sauti.
Menene rawar alamar 'Semantic' a cikin AudioLM?
Alamu na Semantic (daga w2v-BERT) suna ɓoye babban tsari da daidaituwa, yayin da alamun sauti suna ɗaukar cikakkun bayanai na sauti.
Wane neural codec ne ke samar da alamun sauti na AudioLM?
SoundStream yana amfani da ragowar vector ƙididdigewa don matsar da sauti cikin alamun sauti kuma daga baya yana yanke alamun da aka annabta zuwa cikin tsarin igiyar ruwa.
Menene AudioLM ke buƙata azaman bayanan horo?
Babban abin lura shine cewa AudioLM yana horar da sauti kawai akan sauti ba tare da kowane lakabin rubutu ba, tsarin koyo kai tsaye daga sauti.
Me yasa AudioLM ke tsinkayar alamomin ma'ana kafin alamun sauti?
Ƙirƙirar ƙaƙƙarfan tsari na farko yana riƙe da daidaituwar fitarwa cikin lokaci; sannan ana sanya sharadi akan wannan tsarin don ƙara cikakkun bayanai masu inganci.