I-SoundStorm Parallel Audio Generation
I-SoundStorm iyimodeli Google ekhiqiza umsindo ekhiqiza inkulumo nomsindo ngokuhambisana kunethokheni eyodwa ngesikhathi, okwenza ukuhlanganiswa komsindo kwekhwalithi ephezulu kusheshe kakhulu.
Uhlolojikelele
It matters because it cuts generation latency for long clips from minutes to seconds without sacrificing fidelity.
I-Deep Dive
I-SoundStorm, eyethulwe ngu-Google ngo-2023, ikhiqiza umsindo omelwe njengamathokheni ahlukene e-acoustic avela kukhodekhi ye-neural ebizwa ngokuthi i-SoundStream. Amamodeli angaphambilini afana ne-AudioLM akhiqize lawa mathokheni ngokuzenzakalelayo, ebikezela ithokheni ngayinye ngokulandelana, ehamba kancane ngomsindo omude. I-SoundStorm esikhundleni salokho isebenzisa indlela engeyona eye-autoregressive, esekelwe kumaski ebolekwe kumamodeli okukhiqiza izithombe afana ne-MaskGIT. Iqala ngamathokheni amboziwe kakhulu futhi iwagcwalise ngokuphindaphindiwe ngaphezulu kwezinyathelo ezimbalwa zokukhipha amakhodi, ibikezela amathokheni amaningi ngesikhathi esisodwa ngokuhambisana. Ifakwe kumathokheni e-semantic (kusuka kumodeli efana ne-AudioLM noma i-SPEAR-TTS), ingahlanganisa imizuzwana engu-30 yengxoxo yemvelo cishe engxenyeni yesekhondi ku-TPU, cishe izikhathi eziyi-100 ngokushesha kunezisekelo ezizenzakalelayo kuyilapho ifanisa ikhwalithi yazo nokuvumelana kwesipikha.
I-Technical Insight
I-SoundStorm imodelisa isigaba samazinga e-residual vector quantization (RVQ) asuka ku-SoundStream. Ngesikhathi sokuqeqeshwa, amathokheni angahleliwe ambozwa futhi imodeli ifunda ukubikezela. Uma kucatshangelwa ukuthi isebenzisa ukuhlaziya okuhambisanayo okusekelwe ukuzethemba: ekuphindaphindeni ngakunye ibikezela wonke amathokheni afihliwe, igcina aqiniseka kakhulu, futhi imaski kabusha amanye. Inquma amaleveli e-RVQ amaholoholo kuqala, bese kuba ngcono, ifinyelela umsindo ogcwele ngezinyathelo ezimbalwa kakhulu kunesizukulwane sethokheni nethokheni.
I-Strategic Impact
Finyelela futhi ufinyelele
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Izindleko kanye nesabelomali
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Isivinini nesikali
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Ikusasa le-SoundStorm Parallel Audio Generation
Ukukhipha amakhodi okusekelwe kumaski okuhambisanayo kuba ithuluzi elivamile lomsindo osheshayo, olawulekayo. Lindela ukuthi inikeze amandla ama-ejenti ezingxoxo zesikhathi sangempela, ukuhlanganiswa kwezwi okusheshayo, kanye nokukhiqizwa kwe-podcast yefomu ende noma i-audiobook lapho ukubambezeleka kwenza amamodeli azenzakalelayo angasebenzi. Ukuyihlanganisa ne-semantic conditioning enamandla kanye ne-watermarking kuzothuthukisa ubuqiniso bengxoxo kanye nokulandeleka. Umbono ofanayo wokwenza ngcono okuphindaphindwayo kungenzeka uhlangane nezindlela zokusabalalisa, ufiphaze umugqa phakathi kwamathokheni ekhodekhi kanye namajeneretha omsindo aqhubekayo.
Ukuqaliswa Komhlaba Wangempela
Ikhiqiza izingxoxo ezikhulunywayo zemizuzwana engama-30 zabasizi bezwi be-AI ngaphansi kwesekhondi
Ihlanganisa izingxoxo ezinezikhathi eziningi ezinamazwi esipikha angashintshi e-prototyping
Inika amandla ukubambezeleka okuphansi kombhalo ukuya enkulumweni kuma-ejenti asebenzisanayo lapho amamodeli e-autoregressive esalibele
Ukukhiqiza umsindo olandiswayo wefomu elide ngokushesha ngokugcwalisa amathokheni e-acoustic ngokuhambisana
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the SoundStorm Parallel Audio Generation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukusabalalisa Okufihlekile Komsindo Okuzinzile
Imibuzo evame ukubuzwa
What is SoundStorm Parallel Audio Generation?
I-SoundStorm iyimodeli Google ekhiqiza umsindo ekhiqiza inkulumo nomsindo ngokuhambisana kunethokheni eyodwa ngesikhathi, okwenza ukuhlanganiswa komsindo kwekhwalithi ephezulu kusheshe kakhulu. Ibalulekile ngoba inciphisa ukubambezeleka kwesizukulwane ngeziqeshana ezinde ukusuka kumaminithi ukuya kumasekhondi ngaphandle kokudela ukwethembeka.
Iyiphi into entsha eqanjiwe eyenza i-SoundStorm isheshe kune-AudioLM?
I-SoundStorm ithatha indawo ye-autoregressive, i-token-by-token isizukulwane ngokukhipha amakhodi okuphambene okuzenzakalelayo, ibikezela amathokheni amaningi ngesikhathi esisodwa.
Iyiphi inqubo evela esizukulwaneni sesithombe eyenziwa yi-SoundStorm?
I-SoundStorm iboleka isu lokukhipha amakhodi elisekelwe ukuzethemba, imaski-futhi-gcwalisa kabusha elidume i-MaskGIT ekuhlanganiseni izithombe.
I-SoundStorm ikhiqiza luphi uhlobo lokumelela?
I-SoundStorm ibikezela amathokheni ahlukene e-acoustic akhiqizwa i-codec ye-SoundStream, kamuva aqoshwa abe yi-waveform.
I-SoundStorm ithatha isikhathi esingakanani ukwenza imizuzwana engu-30 yomsindo ku-TPU?
I-SoundStorm ingahlanganisa imizuzwana engu-30 yomsindo cishe ngamasekhondi angu-0.5, cishe izikhathi ezingu-100 ngokushesha kunezisekelo ezizenzakalelayo.
I-SoundStorm inquma kanjani ukuthi imaphi amathokheni abikezelwe okufanele awagcine ngesikhathi kukhishwa amakhodi?
Ekuphindaphindeni ngakunye igcina izibikezelo zethokheni yokwethembeka okuphezulu futhi iphinde imaski engaqinisekile ngokudlula okulandelayo.