Awọn kodẹki Audio Neural
Awọn koodu ohun afetigbọ ti nkankikan lo ẹkọ ti o jinlẹ lati fun pọ ohun sinu awọn ṣiṣan kekere ti awọn ami iyasọtọ ati tun ṣe pẹlu iṣotitọ giga.
Akopọ
Awọn mejeeji fọ bandiwidi fun awọn ipe ati ṣiṣanwọle ati pese awọn fokabulari ami ti awọn awoṣe ede ohun n sọ.
Jin Dive
Kodẹki ohun nkankikan jẹ nẹtiwọọki ohun afetigbọ-iyipada koodu ti a kọ lati fun pọ ohun ati tun ṣe. Awọn kooduopo yi iyipada igbi kan pada si wiwakọ iwapọ, quantizer snaps ti o jẹ ki awọn titẹ sii sinu awọn iwe koodu ti o kọ ẹkọ ti n ṣe awọn ami iyasọtọ, ati pe oluyipada tun ṣe agbekalẹ igbi. Ilana bọtini jẹ Quantization Vector Residual (RVQ), ti a lo nipasẹ Google's SoundStream ati Meta's EnCodec: ọpọlọpọ awọn iwe koodu ti wa ni tolera, ọkọọkan fifi koodu si aṣiṣe ti o ku silẹ nipasẹ iṣaaju, nitorina o le ṣowo bitrate fun didara nipasẹ lilo diẹ sii tabi diẹ awọn iwe koodu. Awọn awoṣe wọnyi de didara iwunilori ni awọn iwọn kekere pupọ, nigbami awọn kilobits diẹ fun iṣẹju kan, lilu awọn kodẹki Ayebaye bi Opus tabi MP3. Ni pataki, awọn ami iyasọtọ jẹ deede kini awọn awoṣe bii VALL-E ati MusicGen ṣe ipilẹṣẹ.
Imọ-imọ-ẹrọ
RVQ jẹ okan ti apẹrẹ. Iwe koodu koodu akọkọ ṣe imudani isunmọ isunmọ, ati pe iwe koodu kọọkan ti o tẹle ṣe iwọn aṣiṣe ti o ku, sisọ awọn alaye ti o dara julọ. Ikẹkọ darapọ ipadanu atunkọ, nigbagbogbo ni akoko mejeeji ati awọn ibugbe iwoye, pẹlu iyasọtọ ọta ti o jẹ ki iṣelọpọ n dun gidi, pẹlu pipadanu ifaramo ti o tọju awọn abajade koodu koodu isunmọ si awọn titẹ sii koodu koodu ti a yan. Abajade jẹ iyasọtọ, aṣoju akoso ti o jẹ compressible mejeeji ati rọrun fun oluyipada isalẹ lati ṣe awoṣe.
Ipa Ilana
Wiwọle ati arọwọto
O ṣe ilọsiwaju iraye si nipasẹ transcription, alaye, ati awọn atọkun ohun.
Iye owo ati isuna
Awọn ẹgbẹ Media le firanṣẹ ohun didan yiyara pẹlu awọn isuna-owo kekere.
Iyara ati iwọn
Awọn ọna ṣiṣe ti nkọju si alabara le ṣe ilana awọn ibaraẹnisọrọ sisọ ni iwọn nla.
Ojo iwaju ti Awọn Codecs Audio Neural
Awọn kodẹki n ṣajọpọ si paapaa awọn iwọn kekere kekere pẹlu awọn iwe koodu diẹ, ṣiṣe awọn ami ohun ohun din owo fun awọn awoṣe ede lati ṣe ipilẹṣẹ. Iwadi n tẹriba si ṣiṣanwọle, awọn iyatọ lairi kekere fun ibaraẹnisọrọ akoko gidi ati si awọn koodu kodẹki iṣọkan ti o mu ọrọ, orin, ati ohun gbogbogbo ni awoṣe kan. Bii ohun afetigbọ ti ipilẹṣẹ, kodẹki naa ti ni itọju siwaju si bi ami iyasọtọ ti o pin fun gbogbo aaye, nitorinaa awọn ilọsiwaju nibi ripple sinu gbogbo ọrọ-si-ọrọ ati awoṣe orin ti a ṣe lori oke.
Real-World imuse
Ohùn titẹ fun ultra-low-bandwidth awọn ipe ati awọn ohun elo ara walkie-talkie
Pese ọna kika ami iyasọtọ ti VALL-E, AudioLM, ati MusicGen ṣe ipilẹṣẹ
Ibi ipamọ to munadoko ati ṣiṣanwọle ohun afetigbọ didara ni ida kan ti awọn bitrates MP3
Gbigbe ọrọ ni akoko gidi ni ariwo tabi awọn ipo nẹtiwọọki idinamọ
Awọn ewu & Awọn ọna iṣọ
ilokulo ohun ati awọn ewu afarawe ṣe pọ si nigbati igbanilaaye ba sonu.
Yiye le ju silẹ kọja awọn asẹnti, awọn ede-ede, tabi awọn agbegbe alariwo.
Ohun afetigbọ sintetiki le jẹ aṣiṣe fun ọrọ ododo laisi isamisi to yege.
Ilana Ilana imuse
Gba ifọkansi ti o fojuhan fun gbigba ohun, ti ẹda, ati ilotunlo.
Didara idanwo kọja awọn agbohunsoke oniruuru ati awọn ipo abẹlẹ.
Ṣetumo nigbati eniyan gbọdọ ṣe atunyẹwo tabi fọwọsi awọn abajade.
Aami ohun sintetiki ki o tọju awọn igbasilẹ provenance fun iṣiro.
Tesiwaju Ṣiṣawari
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Neural Audio Codecs quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Itọsọna atẹle
SoundStream nkankikan kodẹki
Awọn ibeere ti a beere nigbagbogbo
Kini Awọn Codecs Audio Neural?
Awọn koodu ohun afetigbọ ti nkankikan lo ẹkọ ti o jinlẹ lati fun pọ ohun sinu awọn ṣiṣan kekere ti awọn ami iyasọtọ ati tun ṣe pẹlu iṣotitọ giga. Wọn mejeeji fọ bandiwidi fun awọn ipe ati ṣiṣanwọle ati pese awọn fokabulari ami ti awọn awoṣe ede ohun n sọ.
Awọn nkan meji wo ni kodẹki ohun afetigbọ nkankikan ṣe ni akọkọ?
Kodẹki nkankikan jẹ nẹtiwọọki oluyipada koodu kan ti o rọ fọọmu igbi kan sinu awọn ami iyasọtọ iwapọ ati lẹhinna tun ṣe ohun ohun lati ọdọ wọn.
Ilana titobi wo ni o jẹ aringbungbun si awọn kodẹki bii SoundStream ati EnCodec?
RVQ akopọ ọpọ codebooks ibi ti kọọkan encodes awọn iṣẹku asise ti tẹlẹ, muu a didara-lapo-bitrate tradeoff.
Ni Quantization Vector Residual, kini ṣe koodu koodu ti o tẹle kọọkan?
Iwe koodu koodu akọkọ funni ni isunmọ isunmọ, ati pe iwe koodu kọọkan nigbamii ṣe iwọn aṣiṣe ti o ku, ṣafikun awọn alaye ti o dara julọ.
Kini idi ti awọn kodẹki ohun afetigbọ ti ara ṣe pataki fun awọn awoṣe ohun afetigbọ?
Awọn ami iyasọtọ ti o ṣejade nipasẹ awọn kodẹki di ọrọ-ọrọ ti awọn awoṣe ede ohun afetigbọ sọ asọtẹlẹ ati ṣe ipilẹṣẹ.
Bawo ni lilo awọn koodu koodu diẹ sii ni kodẹki nkankikan ṣe ni ipa lori iṣelọpọ?
Ṣafikun awọn koodu codebook mu iwọn bitrate ṣugbọn o gba alaye diẹ sii, imudarasi iṣootọ; lilo diẹ iṣowo didara fun funmorawon.