I-MelGAN Generative Vocoder
I-MelGAN iyivoda esekelwe ngokugcwele ye-GAN eshintsha ama-mel-spectrogram abe amaza omsindo angahluziwe ngendlela eyodwa eya phambili esheshayo.
Uhlolojikelele
It mattered because it proved high-quality, non-autoregressive speech synthesis could run hundreds of times faster than real time on a GPU.
I-Deep Dive
UMelGAN, wethulwa nguKumar et al. ngo-2019, ikhiqiza umsindo ngaphandle kwe-loop ehamba kancane yesampula-by-sampuli esetshenziswa yi-WaveNet. Ijeneretha yayo iyinqwaba yama-convolutions aguquliwe enza isampula ye-mel-spectrogram (imvamisa yamabhendi angama-80) kufika esilinganisweni sesampula somsindo, namabhulokhi ayinsalela asebenzisa ama-convolutions anwetshiwe ukuze kunwetshwe inkambu yokwamukela. Ukuqamba okusha okubalulekile bekuwukuqeqeshwa ngabacwasi abaningi abasebenza esikalini somsindo esihlukile (ifomethi yegagasi yoqobo kanye nezinguqulo ezingasampuliwe phansi), ngamunye ebheka amawindi agqagqene. Ukulahlekelwa okufanisa isici kuqhathanisa ukwenziwa kusebenze kombandlululi phakathi komsindo wangempela noma mbumbulu, ukuzinzisa ukuqeqeshwa kwe-GAN. Imodeli incane ngezindinganiso ze-neural-audio futhi isebenza ngokushesha kunesikhathi sangempela ngisho naku-CPU, iyenza isebenziseke ekugxiliseni nasekukhulumeni umbhalo uye enkulumeni kudivayisi.
I-Technical Insight
Umhlukanisi wezilinganiso eziningi we-MelGAN usebenzisa amanethiwekhi amathathu afanayo abheka umsindo ngokulungiswa okugcwele, uhhafu, kanye nekota, isakhiwo ngasinye sokuthwebula kumabanga ahlukene wefrikhwensi. Okubalulekile ukuthi, i-MelGAN incike ekulahlekelweni okufaniswayo (ibanga elingu-L1 phakathi kwamamephu wesici esibandlululayo womsindo wangempela uma uqhathaniswa nokukhiqizwa) kunokulahlekelwa okusobala kokwakhiwa kabusha kwe-spectrogram, okukhuthaza ijeneretha ukuthi ifanise isendlalelo sezibalo zomsindo wangempela ngokwesendlalelo.
I-Strategic Impact
Finyelela futhi ufinyelele
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Izindleko kanye nesabelomali
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Isivinini nesikali
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Ikusasa le-MelGAN Generative Vocoder
UMelGAN uhlanyele umndeni wamavokhoda we-GAN. Abayilandela, i-HiFi-GAN kanye ne-UnivNet, bagcine indlela esheshayo yokungalawuleki kodwa bengeze ababandlululi bezikhathi eziningi kanye nezixazululo eziningi kumafrikhwensi aphezulu ahlanzekile. Isakhiwo sihlala ku-TTS ekudivayisi nasekusakazeni lapho ukubambezeleka nosayizi wemodeli kubalulekile, futhi imibono yakhona yokubandlulula iqhubeka nokuba nomthelela kuma-codec e-neural kanye nezinhlelo zokukhiqiza umculo lapho ukuqeqeshwa okuphikisayo kuthuthukisa ikhwalithi yokucabanga.
Ukuqaliswa Komhlaba Wangempela
Umbhalo uye inkulumo ekudivayisini kuzisizi zeselula lapho i-vokhoda encane, esheshayo igwema uhambo lokubuya nokubuya
Amapayipi okuguqula izwi esikhathi sangempela aguqula i-mel-spectrogram yesipika ibe yizwi eliqondiwe
Amathuluzi egeyimu nawopopayi ahlanganisa ingxoxo yomlingiswa kusukela kuma-spectrogram akhiqiziwe ane-latency ephansi
Izisekelo zocwaningo zama-GAN omsindo, lapho ukulahlekelwa kokufanisa isici sika-MelGAN kusetshenziswa kabusha emculweni nasekukhiqizeni umphumela womsindo.
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the MelGAN Generative Vocoder quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-DiffWave Diffusion Vocoder
Imibuzo evame ukubuzwa
What is MelGAN Generative Vocoder?
I-MelGAN iyivoda esekelwe ngokugcwele ye-GAN eshintsha ama-mel-spectrogram abe amaza omsindo angahluziwe ngendlela eyodwa eya phambili esheshayo. Bekubalulekile ngoba kufakazele ukuthi ukuhlanganiswa kwenkulumo kwekhwalithi ephezulu, okungalawuleki kungasebenza ngokushesha izikhathi ezingamakhulu kunesikhathi sangempela ku-GPU.
Yikuphi okokufaka okuguqulelwa yi-MelGAN ibe igagasi lomsindo elingahluziwe?
I-MelGAN iyivokhoda: ithatha isici se-acoustic, i-mel-spectrogram, futhi ihlanganise i-waveform ehambisanayo.
Kungani iMelGAN ishesha kakhulu kune-WaveNet ekuqondeni?
I-WaveNet ikhiqiza amasampula esisodwa ngesikhathi ngokuzenzakalelayo; Ijeneretha ye-MelGAN ye-convolutional ikhiqiza lonke i-waveform endaweni eyodwa ehambisanayo eya phambili.
Imuphi umklamo wokucwasa ohlukile owethulwe ngu-MelGAN?
I-MelGAN isebenzisa ababandlululi abaningi abafanayo abahlola i-waveform yasekuqaleni nezinguqulo ezehlisiwe ukuze ithwebule isakhiwo ngezikali ezihlukene.
Yikuphi ukulahlekelwa okusiza ukuzinzisa ukuqeqeshwa kwezitha kuka-MelGAN?
Ukulahlekelwa okufanisa isici kunciphisa ibanga le-L1 phakathi kwamamephu wesici esibandlululayo ngomsindo wangempela noma okhiqiziwe, okuqondisa ijeneretha nokuzinzisa ukuqeqeshwa.
Ijeneretha ye-MelGAN iyinyusa kanjani inkambu yayo yokwamukela?
Amabhulokhi ayinsalela anama-convolutions anwetshiwe anweba inkambu yokwamukela kahle, avumele imodeli yejeneretha isakhiwo sesikhashana sebanga elide.