Ijwi rya Stream Neural Codec
Ijwi ryamajwi ni __AIU_PROTECTED_11 __ 'iherezo ryanyuma-iherezo rya neural audio codec igabanya imvugo numuziki kuri bitrate nkeya cyane mugihe ubungabunga ubuziranenge.
Incamake
It matters because it beats traditional codecs like Opus at the same bitrate and powers modern generative audio models.
Kwibira cyane
Yatangijwe na Google mu 2021, SoundStream ni codec yuzuye yuzuye yubatswe kuva mubice bitatu byatojwe hamwe: kodegisi ya convolisiyo ihindura imivumba mbisi ikurikirana ikomatanya ibice, ibisigisigi bya vector bisigaye (RVQ) byerekana izo vectors, hamwe na decoder yemeza ibyubaka. Yatojwe hamwe nigihombo cyo kwiyubaka hamwe na GAN-yuburyo butandukanye bwo kuvangura, bityo ibisohoka byumvikana nkibisanzwe aho kuba hafi. Ikiranga igihagararo ni 'scalable' cyangwa quantizer-guta ishuri: icyitegererezo kimwe gishobora gukora kuri bitrate kuva kuri 3 kugeza kuri 18 kbps ukoresheje gusa byinshi cyangwa bike bya kwanteri byerekana, nta kongera imyitozo. Kuri 3 kbps bivugwa ko irusha Opus kuri 12 kbps mu bizamini byo gutega amatwi, gukoresha imvugo, umuziki, n'amajwi rusange muri moderi imwe ishobora gukora mugihe nyacyo kuri terefone ya CPU.
Ubushishozi
Umuhengeri unyura mu myanzuro itambutse yerekana urugero rwinshi, itanga icyerekezo kimwe kuri buri kintu (urugero 75 frame / isegonda). RVQ noneho ikora buri gushyiramo nkigice cyerekana indangagaciro za codebook. Bitrate ihwanye nigipimo cyikigereranyo cyumubare wibikorwa bya quantisers inshuro bits kuri codebook. Umubare wa Quantizer wataye umurongo wa RVQ mugihe cyamahugurwa, guhatira kodegisi yambere gutwara amakuru yingenzi kuburyo codec itesha agaciro neza kubiciro biri hasi.
Ingaruka z'Ingamba
Kugera no kugera
Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
Igiciro na bije
Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
Umuvuduko n'igipimo
Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Kazoza ka SoundStream Neural Codec
SoundStream yashyizeho inyandikorugero nyuma codecs nka EnCodec na DAC inonosoye, kandi ibimenyetso byayo byihariye byahindutse substrate ya sisitemu ibyara nka AudioLM na MusicLM. Witege ko abakomokaho basunika kuri bitrate yo hepfo, ibimenyetso byubatswe byikubye kabiri nkibisubizo byindimi-moderi-yerekana amajwi yerekana amajwi, hamwe no gukoresha ibikoresho-byoherejwe guhamagara imbonankubone, ibyuma bifata amajwi, no gutambuka aho umurongo wa interineti nubukererwe bikabije.
Gushyira mu bikorwa Isi
Guhagarika amajwi guhamagara kuri ~ 3 kbps mugihe byumvikana neza kuruta codecs z'umurage kuri bitrates
Gukora amajwi yerekana amajwi agaburira __AIU_PROTECTED_11 __ 'AudioLM na MuzikaLM yerekana umusaruro
Igihe nyacyo-gito-cy-amajwi yerekana amajwi ku bikoresho bigendanwa hamwe na kodegisi ya CPU hamwe na decoding
Kubika cyangwa kohereza umuziki nijwi ryibidukikije neza muburyo bumwe bukora ubwoko bwibirimo
Ingaruka & Kurinda
Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Igishushanyo mbonera
Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the SoundStream Neural Codec quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Kode ya Audio
Ibibazo bikunze kubazwa
What is SoundStream Neural Codec?
Ijwi ryamajwi ni __AIU_PROTECTED_11 __ 'iherezo ryanyuma-iherezo rya neural audio codec igabanya imvugo numuziki kuri bitrate nkeya cyane mugihe ubungabunga ubuziranenge. Nibyiza kuko ikubita codecs gakondo nka Opus kuri bitrate imwe kandi igaha imbaraga amajwi yerekana amajwi agezweho.
Nibihe bitatu bigize ibice byubaka amajwi?
Ijwi ryimyubakire ryubatswe kuva kodegisi yemeza, ibisigisigi bya vector isigara itandukanya ibyashizwemo, hamwe na decoder yemeza, byose byahuguwe kurangiza.
Ni ubuhe buhanga butuma Moderi imwe ya SoundStream ikorera bitrate nyinshi itabanje kwitoza?
Mugihe cyamahugurwa, SoundStream ita umurongo wa quantizer ibice kuburyo kugirango usuzume ushobora gukoresha urwego rwa RVQ cyangwa ruto kugirango ukubite bitrate zitandukanye uhereye kumurongo umwe.
Muri __AIU_PROTECTED_11 __ 'ibizamini byo gutega amatwi, SoundStream kuri 3 kbps byavuzwe ko iruta codec kuri 12 kbps?
SoundStream kuri 3 kbps gusa ihuye cyangwa ikubite codec ikoreshwa cyane ya Opus ikora kuri 12 kbps mugusuzuma ubuziranenge.
Ni ubuhe bwoko bw'inyongera bw'amahugurwa SoundStream ikoresha kugirango ibisohoka byumvikane bisanzwe?
Kurenga igihombo cyo kwiyubaka, SoundStream ikoresha ivangura rirwanya (GAN) kuburyo kwiyubaka byumvikana nkukuri aho kuba hafi yumubare.
Nigute bitrate ya SoundStream ifitanye isano na numero zayo?
Umunzani wa Bitrate hamwe numubare wibikorwa bya RVQ ukora (inshuro ikigereranyo cyikigereranyo inshuro bits kuri codebook), bityo wongeyeho umubare uzamura bitrate nubuziranenge.