Ubuyobozi bwa Audio AI
Iringaniza WaveGAN Vocoder
Parallel WaveGAN nijwi ryihuta ryijwi rihindura mel-spectrogramu muburyo bwamajwi mbisi ikoresheje GAN ntoya, ikabyara icyarimwe icyarimwe.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
Nibyingenzi kuko itanga hafi-nyayo-nyayo, ireme-mvugo nziza hamwe nicyitegererezo.
Kwibira cyane
Ijwi ni icyiciro cya nyuma cyumuyoboro wa TTS: ihindura ikarita yerekana imiterere ya acoustic (mubisanzwe mel-spectrogramu) mumajwi nyirizina wumva. Parallel WaveGAN, yatanzwe na Yamamoto, Indirimbo, na Kim muri 2019, ibikora hamwe na generator yo mu bwoko bwa WaveNet idahwitse yatojwe nkumuyoboro uhanganye. Aho guhanura icyitegererezo kimwe cyamajwi icyarimwe nka WaveNet yumwimerere, itanga imiterere yose yumurongo ugereranije, bigatuma yihuta cyane. Ibyingenzi byingenzi bihuza igihombo cyo guhangana nigisubizo cyigihe gito cyo guhinduka kwa Fourier (STFT), bityo moderi ihuye nikimenyetso nyacyo mugihe kinini nubunzani. Igisubizo ni generator ntoya (ibipimo bya miriyoni 1,4) ikora inshuro nyinshi kurenza igihe nyacyo kuri GPU.
Gushyira mu bikorwa Isi
Ijambo-nyaryo risohoka mumajwi igendanwa abafasha aho ubukererwe nubunini bwikitegererezo bifite akamaro
Gukora nka generator ya generator ihujwe na moderi ya acoustic nka Tacotron 2 cyangwa FastSpeech
Ku gikoresho-cy-inyandiko-ku-bikoresho kubikoresho byoroshye bidashobora kwishingikiriza ku gicu
Sisitemu yo guhindura amajwi yongeye guhinduranya spekrogramu mu majwi asanzwe yumvikana
Kazoza Kuringaniza WaveGAN Vocoder
Parallel WaveGAN yafashije gushiraho amajwi ya GAN nkibisanzwe bifatika, kandi igihombo cyayo kinini-STFT igihombo kigaragara mubasimbuye nka HiFi-GAN hamwe na sisitemu nyinshi zitemba. Inzira nyabagendwa yerekeza kuri buri gihe ntoya, amajwi-yihuta yo gutabaza kubafasha ku bikoresho, ibyuma bifata amajwi, hamwe no guhindura amajwi bizima, hiyongereyeho amajwi rusange asanzwe avuga abavuga batagaragara. Witegereze guhuza hamwe na TTS iherezo-iherezo no kohereza neza kuri mobile igendanwa.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Kugera no kugera. Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
- Igiciro na bije. Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
- Umuvuduko n'igipimo. Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Witondere
- Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
- Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
- Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Intambwe ikurikira
- Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
- Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
- Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
- Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the Parallel WaveGAN Vocoder quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
Vocoder Iringaniye Niki?
Parallel WaveGAN nijwi ryihuta ryijwi rihindura mel-spectrogramu muburyo bwamajwi mbisi ikoresheje GAN ntoya, ikabyara icyarimwe icyarimwe. Nibyingenzi kuko itanga hafi-nyayo-nyayo, ireme-mvugo nziza hamwe na moderi yoroheje.
Nuwuhe murimo wijwi nka Parallel WaveGAN?
Ijwi ni icyiciro cya nyuma cya TTS gihuza amajwi nyirizina avuye muri acoustic nka mel-spectrogram.
Nigute Parallel WaveGAN itanga urugero rwamajwi ugereranije na WaveNet yumwimerere?
Kuringaniza WaveGAN ntabwo ari autoregressive, itanga icyerekezo cyose icyarimwe aho kuba icyitegererezo nicyitegererezo, bigatuma cyihuta cyane.
Ni ikihe gihombo ari ingenzi kuri Parallel WaveGAN usibye igihombo cyo guhangana?
Ihuza igihombo cyo guhangana nigihombo kinini cya STFT igereranya ubunini bwa spekrogramu kumunzani.
Ni ubuhe bwubatsi generator ya Parallel WaveGAN ikoresha?
Imashini itanga umuyoboro umeze nka WaveNet wubatswe kuva kwaguka, kugengwa na mel-spectrogramu n urusaku.
Ni ukubera iki Parallel WaveGAN ishimishije kubohereza?
Hafi ya miriyoni 1,4 ni ntoya kandi ikora inshuro nyinshi byihuse kuruta igihe nyacyo, cyiza cyo gukoresha ibikoresho.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo