Kompresioŋ Audio EnCodec
EnCodec mooy __AIU_PROTECTED_13_ codec audio neuronal bu dëgër biy tënk kàddu ak music ci bitrate yu woyof lool ak kalite buy xëcc formaa yu gëna diis.
Résumé
It matters because it underpins modern generative audio systems and ships in open-source form for anyone to use.
Plongeur bu xóot
AI moo ko génne ci 2022, EnCodec dafa topp nafar SoundStream bu encodeur, vecteur residuel (RVQ), ak decodeur buñ tàggat ba ci njeexte, waaye dafay yokk yeneen coppite. Dafay jëfandikoo encodeur convolutionnel bu mëna streaming, spectrogram bu bari eskaal ak ñàkka tabaxaat domaine waxtu, ak diskriminatër yuy xeex ngir xam-xam bu baax. Benn ci liñu mëna wax mooy xeetu entropi bu ndaw bu sukkandiko ci Transformer biy gëna kompresse kode quantifié yi te duñu ñàkk, di gëna xëcc ay bit yu bari te du ñàkk benn kalite. EnCodec itam dugal na benn balancer buy scale ci saasi perte yu bari yi ci tàggat yaram ngir ñu mëna des ci seen bopp. Dafay jëfandikoo audio stéréo bu 24 kHz ak 48 kHz, muy dox ci bitrate yu melni 1.5, 3, 6, ak 12 kbps, te su 6 kbps yeggee ci kalite bu méngoo ak MP3 ci 64 kbps. Jeton yi dañuy dooleel MusicGen ak AudioGen.
Gis-gis xarala
Encodeur bu EnCodec dafay wàññi forme onde bi ci ay convolution yu jaar yoon ci benn rang bu nëbbu, bi RVQ di soppi ci indices codebook yuñ dajale. Benn xeetu làkku Transformer bu woyof dafay wax luy waaja xew ci jeton yii, ba noppi kode leen ci xayma, ba noppi delloosi kompresioŋ bu bees te doo fay. Equilibreur biy tàggat dafay baaxal gradient yi ci tabaxaat, spectral, ak perte adversarial suko defee benn terme du ëpp doole, loolu mooy tax tàggat yu bari-objectif nekk stabil ci bitrate bi yépp.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu kompresioŋ audio EnCodec
EnCodec mooy tokenizer biñ jagleel yenn model audio yu ubbeeku, te ay doomam ñu ngi push fidélité bu gëna rëy ci bitrate yu gëna ndaw, stereo bu mat ak tabaxaat music-grade, ak lëkkaloo bu gëna dëgër ak bind-ci-audio ak bind-ci-music generators. Xaarandil ñu gëna jëfandikoo ko ci jokkoo bu am bandwidth bu woyof, streaming ci jamono dëgg, ak nekk 'token audio' buñ miin buy may architecture yu mag yi ñu mëna jàng ak bind son.
Doxal ci àdduna dëgg
AIU_PROTECTED_13_'s MusicGen ak AudioGen defarkatu bind-ci-audio
Dajale kàddu 24 kHz ba 1.5-6 kbps ngir joxe xibaar bu yam ci yaatuwaayu band
Kodage music stéréo 48 kHz ak kalite bu jege MP3 ci bitrate yu gëna kawe
Liggéey ni codec drop-in bu ubbeeku ngir gëstu ak pipeline ML audio jaaraleko ci checkpoint yiñ génne
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the EnCodec Audio Compression quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Audio yuñ dugal ak jàngat ci representation
Laaj yi ñuy faral di laaj
What is EnCodec Audio Compression?
EnCodec mooy __AIU_PROTECTED_13_ codec audio neuronal bu dëgër biy tënk kàddu ak music ci bitrate yu woyof lool ak kalite buy xëcc formaa yu gëna diis. Dafa am solo ndax dafay jàppale sistem audio yu bees yi ak gaal yi ci forme open-source ngir ku nekk mëna ko jëfandikoo.
Ban mbootaay moo genne EnCodec?
EnCodec AI (FAIR) moo ko dugal ci 2022 muy codec audio neural bu dëggu.
Ban yeneen mbir la EnCodec yokk ngir gëna am compression ci ay tokenam?
EnCodec dafay tàggat ab Transformer bu ndaw ngir mëna wax luy waaja am ci token yi ak kode arithmetik yi, ñu am yeneen kompresioŋ yu amul perte ci kaw RVQ.
Lu tollu ci 6 kbps, kalite EnCodec dañu ko méngale ak MP3 ci ban bitrate?
EnCodec ci 6 kbps mingi yegg ci kalite bu nuróo ak MP3 ci 64 kbps, muy yokkute bu mag ci efficacité.
Ban jafe-jafe la 'balanceur' EnCodec di saafara ci diiru tàggat yaram?
Ak perte yu bari (tabax, spectral, adversarial), balanceur bi dafay baaxal seen gradient suko defee benn mébet du ëpp doole, dakkal tàggat yaram.
Ban xeetu kantite bu mag la EnCodec bokk ak SoundStream?
EnCodec melni SoundStream, dafay jëfandikoo kantite vecteur residuel ngir tànnal encodeur yi ci indices book code yuñ dajale.