Codec ọdịyo akwara
Codec ọdịyo akwara na-eji mmụta miri emi na-achikota ụda n'ime obere iyi nke akara ngosi pụrụ iche wee wughachi ya na ntụkwasị obi dị elu.
Nchịkọta
They both crush bandwidth for calls and streaming and provide the token vocabulary that audio language models speak.
Ime miri emi
Codec ọdịyo akwara bụ ihe ngbanwe-decoder neural network a zụrụ azụ iji mpịachi ọdịyo wee wughachi ya. Ihe ngbanwe ahụ na-atụgharị ụdị waveform ka ọ bụrụ kọmpat kọmpat, quantizer snaps nke na-adaba na ntinye n'ime akwụkwọ koodu amụtara na-emepụta akara pụrụ iche, ma onye nrụpụta na-arụzigharị ụdị ifegharị ahụ. Usoro bụ isi bụ Residual Vector Quantization (RVQ), nke Google's SoundStream na Meta's EnCodec na-eji: ọtụtụ akwụkwọ koodu na-edobe, nke ọ bụla na-edobe njehie nke gara aga hapụrụ, yabụ ị nwere ike ịzụ ahịa bitrate maka ịdị mma site n'iji ọtụtụ koodu koodu ma ọ bụ ole na ole. Modelsdị ndị a na-eru ọmarịcha mma na oke bitrate dị ala, mgbe ụfọdụ kilobits ole na ole kwa nkeji, na-akụ codecs kpochapụwo dị ka Opus ma ọ bụ MP3. N'ụzọ dị mkpa, akara ngosi pụrụ iche bụ kpọmkwem ụdị ụdị dị ka VALL-E na MusicGen na-emepụta.
Nghọta nka nka
RVQ bụ obi nke imewe. Akwụkwọ koodu nke mbụ na-eweghara ihe dị oke njọ, akwụkwọ koodu ọ bụla na-esote na-atụle njehie fọdụrụnụ, na-edobe nkọwa kacha mma. Ọzụzụ na-ejikọta mfu nrụgharị, mgbe mgbe na ma oge na ngalaba dị iche iche, yana onye ịkpa oke na-eme ka mmepụta ahụ na-ada ụda n'ezie, gbakwunyere mfu nkwa nke na-edobe ntinye koodu n'akụkụ ndenye codebook ahọpụtara. Ihe si na ya pụta bụ ihe nnochite anya nwere ọgụgụ isi, nke na-adị mfe ma dị mfe maka transformer nke dị n'okpuru ka ọ bụrụ ihe nlereanya.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke Codec Audio Neural
Codecs na-agbakọta na ọbụna obere bitrates nwere obere codebook, na-eme ka akara ụda dị ọnụ ala maka ụdị asụsụ iji mepụta. Nchọpụta na-akwalite mgbasawanye, ụdị dị ala dị ala maka nzikọrịta ozi oge na-aga na codecs jikọtara ọnụ nke na-ejikwa okwu, egwu, na ụda izugbe n'otu ụdị. Dị ka generative audio na-agbawa, codec na-esiwanye na-emeso dị ka òkè tokenizer maka dum ubi, ya mere ndozi ebe a ripple n'ime ọ bụla ederede-ga-okwu na ụdị egwu e wuru n'elu.
Mmejuputa n'ezie n'ụwa
Na-akpakọ olu maka oku bandwit dị obere na ngwa ụdị walkie-talkie
Na-enye usoro token pụrụ iche nke VALL-E, AudioLM na MusicGen na-emepụta
Nchekwa nke ọma na ịkwanye ọdịyo dị elu na ntakịrị ntakịrị nke MP3 bitrates
Nbufe okwu ozugbo na ọnọdụ netwọkụ na-eme mkpọtụ ma ọ bụ amachibidoro
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Neural Audio Codecs quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
SoundStream Neural Codec
Ajụjụ a na-ajụkarị
What is Neural Audio Codecs?
Codec ọdịyo akwara na-eji mmụta miri emi na-achikota ụda n'ime obere iyi nke akara ngosi pụrụ iche wee wughachi ya na ntụkwasị obi dị elu. Ha abụọ na-egwepịa bandwit maka oku na nkwanye ma na-enye akara okwu nke ụdị asụsụ ọdịyo na-asụ.
Kedu ihe abụọ codec ọdịyo akwara na-eme nke ọma?
Codec akwara bụ netwọọdụ ihe ngbanwe nke na-echikota usoro ebili mmiri ka ọ bụrụ akara ngosi nwere kọmpụta wee wughachi ọdịyo sitere na ha.
Kedu usoro nha nha dị n'etiti codecs dị ka SoundStream na EnCodec?
RVQ na-akwakọba ọtụtụ akwụkwọ koodu ebe nke ọ bụla na-edekọ njehie fọdụrụ nke gara aga, na-eme ka azụmaahịa dị mma veso-bitrate.
Na Residual Vector Quantization, kedu ihe akwụkwọ koodu ọ bụla na-esochi ya na-etinye koodu?
Akwụkwọ koodu nke mbụ na-enye nsonye dị oke mkpa, akwụkwọ koodu ọ bụla mechaa na-atụle njehie fọdụrụnụ, na-agbakwunye nkọwa zuru oke.
Kedu ihe kpatara codec ọdịyo akwara dị mkpa maka ụdị ọdịyo na-emepụta?
Token ndị pụrụ iche nke codecs mepụtara na-aghọ okwu nke ụdị asụsụ odiyo na-ebu amụma ma mepụta.
Kedu ka iji ọtụtụ codebooks na codec neural si emetụta mmepụta?
Ịgbakwunye codebooks na-ebuli bitrate elu ma na-ewepụta nkọwa ndị ọzọ, na-eme ka ntụkwasị obi dịkwuo mma; iji obere trades àgwà maka mkpakọ.