Jiilka maqalka ee SoundStorm barbar socda
SoundStorm waa Google moodeel maqal maqal ah oo soo saara hadalka iyo dhawaaqa isbarbar socda halkii uu ka ahaan lahaa hal calaamad markiiba, taasoo samaynaysa isku xidh maqal oo tayo sare leh si xawli ah.
Dulmar
It matters because it cuts generation latency for long clips from minutes to seconds without sacrificing fidelity.
quusid qoto dheer
SoundStorm, oo uu soo bandhigay Google sanadka 2023, waxay soo saartaa maqal u taagan sida calaamado cod-bixineed oo kala duwan oo ka socda koodka neerfaha ee loo yaqaan SoundStream. Moodooyinka hore sida AudioLM waxay soo saareen calaamadahan si toos ah, iyagoo saadaaliyay calaamad kasta oo isku xigta, taas oo gaabis ah maqal dheer. SoundStorm beddelkeeda waxay isticmaashaa hab aan toos ahayn, oo waji-xidho ku salaysan oo laga soo amaahday moodooyinka jiilka sawirka sida MaskGIT. Waxay ku bilaabataa calaamado badan oo la daboolay oo si isdabajoog ah u buuxinaya in ka badan sacab muggiis oo tillaabooyinka dejinta ah, iyada oo saadaalisa calaamado badan oo isku mid ah. Ku xiran calaamadaha semantic (laga bilaabo moodeel sida AudioLM ama SPEAR-TTS), waxay ku dhejin kartaa 30 ilbiriqsi oo wada-hadal dabiici ah qiyaastii nus ilbiriqsi TPU, qiyaastii 100 jeer ka dhakhso badan saldhigyada asaasiga ah iyada oo la waafajinayo tayada iyo joogteynta hadalka.
Aragtida Farsamada
SoundStorm wuxuu qaabeeyaa heerarka kala sareynta ee cabbirka vector-ka (RVQ) ee ka imanaya SoundStream. Inta lagu jiro tababarka, calaamadaha random waa la daboolaa oo moodelku wuxuu bartaa inuu saadaaliyo. Marka la eego waxay ku shaqaysaa dejinta isbarbar-dhigga kalsoonida: mar kasta oo soo noqnoqonaysa waxay saadaalisaa dhammaan calaamadaha daboolan, waxay ilaalisaa kuwa ugu kalsoonida badan, oo dib u daboola inta kale. Waxay kala saartaa heerarka RVQ ee aan fiicneyn marka hore, ka dibna kuwa ka sii fiican, iyadoo ku gaareysa maqal buuxa tallaabooyin aad uga yar marka loo eego jiilka calaamad-sumadda.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka SoundStorm Isbarbardhiga Maqalka Jiilka
Isbarbardhigga maaskaro-ku-dhigista ku saleysan waxay noqoneysaa aalad caadi ah oo degdeg ah, maqal la xakameyn karo. Ka filo inay awood u yeelato wakiilada wada sheekeysiga ee wakhtiga-dhabta ah, isku xidhka codka degdega ah, iyo qaab-dhismeedka dheer ee podcast ama jiilka maqalka halkaas oo daahitaanku uu mar ka dhigay moodooyinka autoregressive-ka mid aan macquul ahayn. Isku darka qaboojinta semantic adag iyo calaamadaynta biyaha waxay hagaajin doontaa xaqiiqada wada hadalka iyo raadinta. Isla fikradda dib-u-habaynta dib-u-habaynta waxay u badan tahay inay ku midoobaan hababka fidinta, oo kala firdhiya xariiqda u dhexeeya codec-token iyo koronto-dhaliyeyaasha-maqalka.
Dhaqangelinta Adduunka-dhabta ah
Soo saarista 30-ilbiriqsi wadahadal lagu hadlo ee caawiyayaasha codka AI ilbidhiqsi gudahood
Isku-dubbarid wada-hadallo-rogmado badan leh oo leh codad ku-hadlo joogto ah si loo habeeyo
Ku-xoojinta qoraalka-hadalka-hadalka-hooseeya ee wakiilada is-dhex-galka ah halkaasoo moodooyinka autoregressive-ka ah ay daahmeen
Soo saarida qaab dheer oo maqal ah oo laga sheekeeyay si dhakhso ah iyadoo la buuxinayo calaamadaha dhawaaqa ee barbar socda
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the SoundStorm Parallel Audio Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Faafinta Daahsoon ee Maqalka Deggan
Su'aalaha soo noqnoqda
What is SoundStorm Parallel Audio Generation?
SoundStorm waa Google moodeel maqal maqal ah oo soo saara hadalka iyo dhawaaqa isbarbar socda halkii uu ka ahaan lahaa hal calaamad markiiba, taasoo samaynaysa isku xidh maqal oo tayo sare leh si xawli ah. Waa arrin sababtoo ah waxay gooysaa daahitaanka jiilka ee cajaladaha dheer ee daqiiqado ilaa ilbiriqsi iyada oo aan loo hurayn daacadnimada.
Waa maxay hal-abuurka muhiimka ah ee ka dhigaya SoundStorm ka dhaqso badan AudioLM?
SoundStorm waxay ku beddeshaa aayar tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib tartiib ah oto75555ለዉ aloo-token loogu calaamadeeyey ay ugu beddeshay calaamado isbarbar yaac ah oo isbarbar yaac ah, iyadoo la saadaaliyay calaamado badan oo isku mar ah.
Farsamokee ka soo jeeda jiilka sawirka ayaa SoundStorm la qabsanayaa?
SoundStorm waxa ay amaahatay istiraatijiyadda dejinta kalsoonida-ku-salaysan, waji-xidhka iyo-buuxinta ee ay ku caan baxday MaskGIT ee isku-dhafka sawirka.
Waa maxay matalaad noocee ah ayay soo saartaa SoundStorm?
SoundStorm waxa ay saadaalisaa calaamadaha dhawaaqa kala duwan ee uu soo saaro codec-ka SoundStream, kaas oo markii danbe loo kala saaray qaab mowjad ah.
Qiyaastii intee in le'eg ayay SoundStorm ku qaadanaysaa in ay soo saarto 30 ilbiriqsi oo maqal ah TPU?
SoundStorm waxay ku soo saari kartaa 30 ilbiriqsi oo maqal ah qiyaastii 0.5 ilbiriqsi, oo ku saabsan 100x ka dhaqsiyaha badan marka loo eego aasaaska autoregressive.
Sidee buu SoundStorm u go'aamiyaa calaamada la saadaaliyay ee la sii hayo inta lagu guda jiro codeynta?
Dib-u-eegis kasta waxa ay sii haysaa saadaasha kalsoonida ugu sarreysa oo ay dib u qariso kuwa aan la hubin ee gudbinta xigta.