I-WaveGlow Flow-based Vocoder
I-WaveGlow iyivowuda ye-neural esekelwe ku-flow-based evela ku-NVIDIA ehlanganisa amaza enkulumo kusuka kuma-mel-spectrograms ngokudlula okukodwa ngaphandle kokuhlehla.
Uhlolojikelele
It matters because it delivers high-quality audio faster than real time using only a simple likelihood loss.
I-Deep Dive
I-WaveGlow, ekhishwe u-Prenger, u-Valle, noCatanzaro e-NVIDIA ngo-2018, ihlanganisa imibono evela ku-Glow ne-WaveNet ukuze kwakhiwe ivokhoda esheshayo futhi elula ukuyiqeqesha. Ngokungafani namavokhoda e-GAN, iwukugeleza okuvamile: ifunda imephu engaguquki phakathi kokusabalalisa okulula kwe-Gaussian kanye nefomethi yegagasi yomsindo, efakwe kusimo se-mel-spectrogram. Ukuqeqeshwa kukhulisa amathuba okuba khona kwelogi yedatha, ngakho-ke akudingi ukucwasa okuhlukile, akukho ukuhlehla okuzenzakalelayo, futhi akukho ukuhluza okubili kukathisha nomfundi obekudingwa izindlela zangaphambilini ezihambisanayo ze-WaveNet. Ukuze ukhiqize umsindo wenza isampula yomsindo we-Gaussian futhi usebenzise inethiwekhi eguquguqukayo ngokuhlehla. I-WaveGlow ikhiqiza inkulumo yekhwalithi eqhathaniswa ne-WaveNet ngenkathi ihlanganisa ngokushesha kakhulu kunesikhathi sangempela ku-GPU yesimanje.
I-Technical Insight
I-WaveGlow inqwabelanisa izinyathelo zokugeleza ezingaguquki, ngasinye sihlanganisa isendlalelo esihambisanayo esihambisanayo ne-convolution engu-1x1 engaguquki ebolekwe ku-Glow. Amasampuli omsindo aqoqwe abe ama-vector ngokusebenzisa umsebenzi wokuminyanisa ukuze izendlalelo ezihlanganisayo zikwazi ukuziguqula kahle. Ngoba sonke isinyathelo asiguquki, indlela eya phambili ibala amathuba okuqeqeshwa futhi isikhombisi-ndlela esihlehlayo sibeka umsindo kumsindo ukuze siqonde. Inethiwekhi eyodwa kanye nenhloso eyodwa engemihle yokuba nethuba lokungena kwenza ukuqeqeshwa kuzinze futhi kube lula.
I-Strategic Impact
Finyelela futhi ufinyelele
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Izindleko kanye nesabelomali
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Isivinini nesikali
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Ikusasa le-WaveGlow Flow-based Vocoder
I-WaveGlow ibonise ukuthi ama-vocoder ahlanzekile angaqhudelana nekhwalithi ezenzakalelayo, abe nomthelela wokugeleza kwakamuva namamodeli omsindo ahambisana nokugeleza. Ubulula bayo bokulahlekelwa okukodwa buhlala bukhanga, nakuba ama-vocoder e-GAN afana ne-HiFi-GAN manje evame ukunqoba ngosayizi nangesivinini. Uma ubheka phambili, imibono esuselwe ekugelezeni kanye nokuhambisana nokugeleza iyabuya ku-TTS yesimanje esondelene nokusabalalisa, futhi imiklamo engaguquki yesitayela se-WaveGlow iyaqhubeka nokwazisa ucwaningo mayelana nokungenzeka kwangempela, ukulawuleka, kanye nesizukulwane se-waveform esisebenzayo.
Ukuqaliswa Komhlaba Wangempela
Imataniswa ne-Tacotron 2 epayipini le-TTS eliyinkomba le-NVIDIA ukuze kukhiqizwe inkulumo yekhwalithi yesitudiyo yemvelo
Ukuhlanganiswa kwenkulumo ye-GPU esheshayo yokulandisa, ukukopisha, nokugeleza komsebenzi wokudala okuqukethwe
Ukukhiqiza ukuqeqeshwa nomsindo wedemo ocwaningweni lapho ukuqeqeshwa okuzinzile, kokulahlekelwa okukodwa kukhethwa khona
Okukhipha izwi kwesikhathi sangempela kumasistimu asebenzisanayo asebenza ngehadiwe ye-NVIDIA
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the WaveGlow Flow-Based Vocoder quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Isizukulwane Senkulumo Esebhokisini Lezwi
Imibuzo evame ukubuzwa
What is WaveGlow Flow-Based Vocoder?
I-WaveGlow iyivowuda ye-neural esekelwe ku-flow-based evela ku-NVIDIA ehlanganisa amaza enkulumo kusuka kuma-mel-spectrograms ngokudlula okukodwa ngaphandle kokuhlehla. Ibalulekile ngoba iletha umsindo wekhwalithi ephezulu ngokushesha kunesikhathi sangempela isebenzisa kuphela ukulahleka okungenzeka kube lula.
I-WaveGlow ihlanganisa imibono yezakhiwo kusuka kumaphi amamodeli amabili?
I-WaveGlow ihlanganisa ukwakheka kokugeleza okungaguquki kwe-Glow ngedizayini eyimodeli yomsindo ye-WaveNet.
Uhlobo luni lwemodeli i-WaveGlow?
I-WaveGlow iwukugeleza okujwayelekile okufunda imephu engaphenduleki phakathi komsindo we-Gaussian nomsindo.
I-WaveGlow ikhiqiza kanjani i-waveform ngesikhathi sokubikezela?
Ngenxa yokuthi inethiwekhi ayiguquki, udweba umsindo we-Gaussian bese uhambisa ukugeleza uhlehle, ufakwe ku-mel-spectrogram.
Iyiphi inhloso eyenziwa yi-WaveGlow ngesikhathi sokuqeqeshwa?
Njengokugeleza, i-WaveGlow ikhulisa ukuvela kwelogi okuyiyonayona, okungadingi ukucwasa noma ukucwiliswa emanzini.
Yiziphi izingxenye ezimbili ezakha isinyathelo ngasinye esingaguquki ku-WaveGlow?
Isinyathelo ngasinye sokugeleza sibhangqa isendlalelo esihambisanayo esihambisanayo nesiguquguqukayo esingaguquki esingu-1x1 esithathwe ku-Glow.