Neural Audio Codecs
Codecs masu jiwuwa na jijiya suna amfani da zurfin koyo don danne sauti cikin ƙananan rafuka na alamomi masu hankali da sake gina shi da aminci.
Dubawa
They both crush bandwidth for calls and streaming and provide the token vocabulary that audio language models speak.
Zurfafa nutsewa
Codec mai jiwuwa mai jiwuwa cibiyar sadarwa ce mai ɓarna-dikodi wanda aka horar da shi don damfara sauti da sake gina shi. Mai rikodin rikodi yana jujjuya tsarin igiyar ruwa zuwa ƙaƙƙarfan latent, mai ƙididdigewa yana ɗauka wanda ke lanƙwasa zuwa shigarwar a cikin litattafan koyo waɗanda ke samar da sahihan bayanai, kuma mai yankewa yana sake gina tsarin igiyar ruwa. Makullin dabarar ita ce Residual Vector Quantization (RVQ), wanda Google's SoundStream da Meta's EnCodec ke amfani da su: littattafan code da yawa an tattara su, kowannensu yana ɓoye kuskuren da ya bari a baya, don haka zaku iya siyar da bitrate don inganci ta amfani da ƙarin ko kaɗan. Waɗannan samfuran sun kai inganci mai ban sha'awa a ƙananan bitrates, wani lokacin 'yan kilobits a cikin daƙiƙa guda, suna bugun manyan codecs kamar Opus ko MP3. Mahimmanci, alamomi masu hankali sune ainihin abin da samfura kamar VALL-E da MusicGen ke samarwa.
Fahimtar Fasaha
RVQ shine zuciyar zane. Littafin lamba na farko yana ɗaukar ƙayyadaddun ƙima, kuma kowane littafin code na gaba yana ƙididdige ragowar kuskuren, yana shimfiɗa mafi kyawun daki-daki. Horon ya haɗu da asarar sake ginawa, sau da yawa a cikin lokaci da wurare masu ban sha'awa, tare da mai nuna bambanci wanda ke kiyaye fitar da sauti na gaske, tare da asarar sadaukarwa wanda ke kiyaye abubuwan rikodin rikodin kusa da zaɓaɓɓun shigarwar codebook. Sakamako shine ƙwaƙƙwal, wakilcin matsayi wanda duka biyun mai matsewa ne kuma mai sauƙi ga na'urar wuta ta ƙasa don yin ƙira.
Dabarun Tasiri
Shiga ku isa
Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.
Kudin da kasafin kuɗi
Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.
Gudu da sikelin
Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.
Makomar Neural Audio Codecs
Codecs suna haɗuwa zuwa ko da ƙananan bitrates tare da ƙananan codebooks, suna yin alamun sauti mai rahusa don ƙirar harshe don samarwa. Bincike yana turawa zuwa yawo, ƙananan bambance-bambancen latency don sadarwa ta ainihi da kuma zuwa ga ƙaƙƙarfan codecs waɗanda ke ɗaukar magana, kiɗa, da sauti na gaba ɗaya a cikin samfuri ɗaya. Kamar yadda sautin ƙararrawa ke fashe, ana ƙara ɗaukar codec ɗin azaman alamar haɗin gwiwa ga dukkan filin, don haka haɓakawa a nan ya mamaye kowane rubutu-zuwa-magana da ƙirar kiɗan da aka gina a saman.
Aiwatar da Gaskiyar Duniya
Matsa murya don kiran ƙananan-ƙananan bandwidth da salon aikace-aikacen salon walkie-talkie
Samar da tsayayyen alamar alama wanda VALL-E, AudioLM, da MusicGen ke samarwa
Ingantacciyar ma'ajiya da yawo na sauti mai inganci a ɗan ƙaramin bitrates na MP3
Watsawar magana ta ainihi a cikin hayaniya ko ƙuntataccen yanayin cibiyar sadarwa
Hatsari & Tsare-tsare
Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.
Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.
Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.
Taswirar Hanya
Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.
Gwajin ingantattun masu magana daban-daban da yanayin baya.
Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.
Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Neural Audio Codecs quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
SoundStream Neural Codec
Tambayoyin da ake yawan yi
What is Neural Audio Codecs?
Codecs masu jiwuwa na jijiya suna amfani da zurfin koyo don danne sauti cikin ƙananan rafuka na alamomi masu hankali da sake gina shi da aminci. Dukansu suna murkushe bandwidth don kira da yawo kuma suna ba da ƙamus ɗin alama waɗanda ƙirar harshe mai jiwuwa ke magana.
Wadanne abubuwa biyu ne codec audio na jijiya ke yi da farko?
Codec na jijiyoyi cibiyar sadarwa ce mai rikodin rikodin sauti wanda ke matsar da tsarin igiyar ruwa zuwa ƙaƙƙarfan alamomi masu hankali sannan ya sake gina sautin daga gare su.
Wanne dabarar ƙididdigewa ce ke tsakiyar codecs kamar SoundStream da EnCodec?
RVQ yana tara litattafai masu yawa inda kowannensu ya ɓoye ragowar kuskuren da ya gabata, yana ba da damar ciniki mai inganci-da-bitrate.
A cikin Residual Vector Quantization, menene kowane littafin code na gaba ya ke rufawa asiri?
Littafin lambar farko yana ba da ƙayyadaddun ƙima, kuma kowane littafin lamba daga baya yana ƙididdige ragowar kuskuren, yana ƙara dalla-dalla mafi kyau.
Me yasa codecs audio na jijiya ke da mahimmanci don ƙirar sauti mai ƙira?
Alamu masu hankali waɗanda codecs ke samarwa sun zama ƙamus waɗanda ƙirar harshe mai jiwuwa ke hasashen da samarwa.
Ta yaya yin amfani da ƙarin littattafan codec a cikin codec na jijiyoyi yana shafar fitarwa?
Ƙara littattafai yana haɓaka bitrate amma yana ɗaukar ƙarin daki-daki, inganta aminci; ta yin amfani da ƙarancin ingancin kasuwancin don matsawa.