SoundStream Neural Codec
SoundStream waa Google-dhammaadka-ilaa-dhamaadka cod-koodka maqalka neerfaha kaas oo ku cadaadiya hadalka iyo muusigga bitrate-yada aadka u hooseeya iyadoo la ilaalinayo tayada.
Dulmar
It matters because it beats traditional codecs like Opus at the same bitrate and powers modern generative audio models.
quusid qoto dheer
Waxaa soo bandhigay Google sanadka 2021, SoundStream waa codec neural ah oo si buuxda looga dhisay saddex qaybood oo la wada tababaray: koodhare kontorol ah oo u rogaya qaab-dhismeedka cayriin ee isku xigxiga ee vectors, quantizer vector haraaga (RVQ) kaas oo ka saara vectorskaas, iyo wax ka beddelka kacaanka. Waxaa lagu tababbaray khasaaraha dib-u-dhiska iyo qaab-takoorka iska soo horjeeda ee qaabka GAN, marka wax-soo-saarku wuxuu u eg yahay mid dabiici ah halkii uu tiro ahaan u dhow yahay. Sifada taagan waa 'la cabiri karo' ama tababbarka quantizer- dropout: hal nooc ayaa ka shaqayn kara guud ahaan bitrates qiyaastii 3 ilaa 18 kbps si fudud iyada oo la isticmaalayo wax ka badan ama ka yar oo lakabyo quantizer ah marka la eego, iyada oo aan dib loo tababarin. Marka la joogo 3 kbps waxaa lagu soo waramayaa in ay Opus kaga fiican tahay 12 kbps marka la eego tijaabooyinka dhegeysiga, maaraynta hadalka, muusiga, iyo maqalka guud ee hal nooc oo ku shaqayn kara wakhtiga dhabta ah ee CPU casriga ah.
Aragtida Farsamada
Qaabka mawjaduhu waxa uu dhex maraa rogrogga fidsan kuwaas oo si aad ah hoos ugu dhacay, soona saaraya hal xidhidh halkii jir (tusaale 75 fiim/ilbiriqsi). RVQ ka dib waxay u codeeeysaa wax kasta oo la dhexgelinayo sida xirmo tusmooyinka koodka. Bitrate waxay le'eg tahay heerka qaabaynta wakhtiyada tirada wakhtiyada qiyaasaha firfircoon ee buugii koodka. Ka tagista Quantizer waxay si aan kala sooc lahayn u gooyaa rasmada RVQ inta lagu jiro tababarka, taasoo ku qasabta buugaag codeedyo hore inay qaadaan macluumaadka ugu muhiimsan si codec-ku si qurux badan u hooseeyo heerar hoose.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka SoundStream Neural Codec
SoundStream waxay dejisay jaantuska markii dambe codecs sida EnCodec iyo DAC la safeeyey, iyo calaamadaheeda kala duwan waxay noqdeen substrate-ka nidaamyada wax-soo-saarka sida AudioLM iyo MusicLM. Filo faraca u riixaya xattaa xattaa bitrates hoose, calaamado habaysan oo macne ahaan loo habeeyey oo labanlaabanaya sidii wax-soo-saarka soosaarayaasha maqalka ee qaabka luqadda, iyo diritaanka qalabka si adag ee wicitaanada tooska ah, aalada maqalka, iyo qulqulka halka xawaaraha iyo daahitaanka si adag loo xaddiday.
Dhaqangelinta Adduunka-dhabta ah
Cadaadiska wicitaanada codka ilaa ~ 3 kbps iyadoo ay ka dhawaajinayaan codecyada dhaxalka ah ee bitrates sare
Soo saarista calaamado maqal oo kala duwan oo quudiya Google's AudioLM iyo moodooyinka wax-abuurka ee MusicLM
Ku daawashada maqalka-bandwidth-yar ee waqtiga-dhabta ah ee aaladaha mobilada oo leh koodka-CPU-ga iyo dejinta
Kaydinta ama gudbinta muusiga iyo dhawaaqa ambient si hufan oo hal moodeel ah kaas oo gacanta ku haya dhammaan noocyada nuxurka
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the SoundStream Neural Codec quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Codec-yada Maqalka Neural
Su'aalaha soo noqnoqda
What is SoundStream Neural Codec?
SoundStream waa Google-dhammaadka-ilaa-dhamaadka cod-koodka maqalka neerfaha kaas oo ku cadaadiya hadalka iyo muusigga bitrate-yada aadka u hooseeya iyadoo la ilaalinayo tayada. Waa arrin sababtoo ah waxay ku garaacday codecs-dhaqameedka sida Opus isla bitrate waxayna awood u yeelataa moodooyinka maqalka ee casriga ah.
Waa kuwee saddexda qaybood ee ka kooban dhismaha SoundStream?
SoundStream waxaa laga dhisay codeeyaha isdhaafsiga ah, hadhaaga vector quantizer kaas oo meesha ka saaraya wax-ku-xidhka, iyo furaha kontorol, dhammaan tobabar dhamaad ilaa dhamaad.
Farsamo noocee ah ayaa u oggolaanaysa hal nooc oo SoundStream ah inuu u adeego bitrates badan oo kala duwan iyada oo aan dib loo tababarin?
Inta lagu jiro tababarka, SoundStream waxay si aan kala sooc lahayn u daadisaa lakabyada quantizer si marka la eego aad u isticmaali karto in ka badan ama ka yar heerarka RVQ si aad ugu dhufato bitrates kala duwan hal nooc.
_AIU_PROTECTED_11__'s imtixaanadii dhageysiga, SoundStream at 3 kbps ayaa la sheegay in uu ka fiicnaaday koodka 12 kbps?
SoundStream kaliya 3 kbps ayaa u dhigma ama garaacday Opus codec-ka aadka loo isticmaalo ee ku socda 12 kbps qiimaynta tayada shakhsi ahaaneed.
Waa maxay nooca calaamada tababarka dheeraadka ah ee SoundStream u isticmaasho si ay u soo saarto dhawaaq dabiici ah?
Wixii ka dambeeya khasaaraha dib-u-dhiska, SoundStream waxay isticmaashaa takoorayaal iska soo horjeeda (GAN) si dib-u-dhisyadu u muuqdaan kuwo macquul ah halkii ay tiro ahaan u dhow yihiin.
Sidee buu SoundStream's bitrate-ku ula xidhiidhaa qiyaasaha?
Miisaanka Bitrate oo leh tirada lakabyada RVQ ee firfircoon (waqtiga xaddidaadda waqtiyada xaddidan ee buug-qodeedka), markaa ku darida qiyaasaha waxay kor u qaadaa xoogaa iyo tayada.