MelGAN Generative Vocoder
MelGAN inonyatso convolutional GAN-based vocoder inoshandura mel-spectrograms kuita mbishi odhiyo waveform mune imwechete inokurumidza kumberi kupfuura.
Pfupiso
It mattered because it proved high-quality, non-autoregressive speech synthesis could run hundreds of times faster than real time on a GPU.
Kudzika Kwakadzika
MelGAN, yakaunzwa naKumar et al. muna 2019, inogadzira odhiyo isina inononoka sampuli-ne-sample loop inoshandiswa neWaveNet. Jenareta yaro murwi wezvakachinjika convolutions izvo upsample mel-spectrogram (kazhinji 80 frequency mabhendi) kusvika kuodhiyo sampuli mwero, nemabhuraki akasara anoshandisa akadhirowewa convolutions kuwedzera munda unogamuchira. Chinhu chikuru chekuvandudza kwaive kudzidziswa nevakawanda vanosarura vachishanda pazvikero zvakasiyana zvekuteerera (iyo yekutanga waveform pamwe neshanduro dzakaderedzwa), imwe neimwe ichitarisa mafafitera ari pamusoro. Kurasikirwa-kufananidza kurasikirwa kunofananidza kusarura ma activation pakati pechokwadi uye manyepo odhiyo, kudzikamisa kudzidziswa kweGAN. Iyo modhi idiki ne-neural-odhiyo zviyero uye inomhanya nekukurumidza kupfuura nguva chaiyo kunyangwe paCPU, ichiita kuti ive inoshanda kune yakamisikidzwa uye pane-mudziyo mameseji-ku-kutaura.
Technical Insight
MelGAN's multi-scale discriminator anoshandisa matatu akafanana network achitarisa odhiyo yakazara, hafu, uye kota resolution, yega yega yekutapa chimiro pamatanho akasiyana. Sezvineiwo, MelGAN inotsamira pakurasikirwa kwechikamu (L1 chinhambwe pakati pekusarura mamepu echokwadi vs. Yakagadzirwa odhiyo) pane yakajeka spectrogram kurasikirwa kwekuvakazve, iyo inokurudzira jenareta kuti ienderane neiyo chaiyo odhiyo's statistics layer by layer.
Strategic Impact
Svika uye svika
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
Mutengo uye bhajeti
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
Kumhanya uye chiyero
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.
Ramangwana reMelGAN Generative Vocoder
MelGAN akadyara mhuri yemavokodha eGAN. Vatsivi vayo, HiFi-GAN neUnivNet, vakachengeta nzira yekukurumidza isiri-autoregressive asi yakawedzera-akawanda-nguva uye akawanda-resolution kusarura kweakachena ma frequency. Iyo dhizaini inogara mu-on-mudziyo uye kutenderera TTS uko latency uye modhi saizi zvine basa, uye ayo ekusarura mazano anoramba achipesvedzera neural codecs uye mimhanzi chizvarwa masisitimu uko kudzidziswa kweanopikisa kunovandudza maonero.
Real-World Implementation
Pa-mudziyo mameseji-ku-kutaura mune nhare mbozha apo kavhakodha kadiki, inokurumidza kunzvenga mafambiro emakore
Chaiyo-nguva inoshandura inzwi mapaipi anoshandura mel-spectrogram yemutauri kuita izwi rinonangwa
Maturusi emitambo neanopopotera anogadzira nhaurirano yemunhu kubva kune akagadzirwa spectrograms ine yakaderera latency
Tsvagiridzo yekutanga yeaodhiyo GAN, uko MelGAN inofananidzira kurasikirwa inoshandiswa zvakare mumhanzi uye kugadzirwa kweruzha.
Njodzi & Guardrails
Kushandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.
Implementation Roadmap
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.
Ramba Uchiongorora
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the MelGAN Generative Vocoder quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gaidhi rinotevera
DiffWave Diffusion Vocoder
Mibvunzo inowanzo bvunzwa
What is MelGAN Generative Vocoder?
MelGAN inonyatso convolutional GAN-based vocoder inoshandura mel-spectrograms kuita mbishi odhiyo waveform mune imwechete inokurumidza kumberi kupfuura. Izvo zvine basa nekuti yakaratidza yemhando yepamusoro, isiri-autoregressive yekutaura synthesis inogona kumhanya mazana enguva nekukurumidza kupfuura nguva chaiyo paGPU.
Ndeipi yekuisa iyo MelGAN inoshandura kuita yakaomeswa waveform?
MelGAN ivokodha: inotora acoustic chimiro chinomiririra, iyo mel-spectrogram, uye inogadzirisa inoenderana waveform.
Nei MelGAN ichikurumidza kupfuura WaveNet pakufungidzira?
WaveNet inogadzira sampuli imwe panguva autoregressively; MelGAN's convolutional jenareta inogadzira iyo waveform yese mune imwechete yakafanana kumberi kupfuura.
Ndeipi dhizaini yerusarura yakaunzwa naMelGAN?
MelGAN inoshandisa akawanda akafanana anosarura anoongorora iyo yekutanga waveform uye yakaderedzwa shanduro kutora chimiro pazvikero zvakasiyana.
Ndekupi kurasikirwa kunobatsira kudzikamisa kudzidziswa kwaMelGAN?
Iko kurasikirwa-kufananidza kurasikirwa kunoderedza iyo L1 chinhambwe pakati pekusarura mamepu echokwadi uye anogadzirwa odhiyo, kutungamira jenareta uye kudzikamisa kudzidziswa.
Jenareta yeMelGAN inowedzera sei munda wayo wekugamuchira?
Mabhuroko akasara ane maconvolutions akatambanudzwa anowedzera nzvimbo yekugamuchira zvakanaka, zvichiita kuti jenareta modhi yenguva refu yechimiro chenguva.