Ubuyobozi bwa Audio AI

Iringaniza WaveGAN Vocoder

Parallel WaveGAN nijwi ryihuta ryijwi rihindura mel-spectrogramu muburyo bwamajwi mbisi ikoresheje GAN ntoya, ikabyara icyarimwe icyarimwe.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza Kuringaniza WaveGAN Vocoder
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Nibyingenzi kuko itanga hafi-nyayo-nyayo, ireme-mvugo nziza hamwe nicyitegererezo.

Kwibira cyane

Ijwi ni icyiciro cya nyuma cyumuyoboro wa TTS: ihindura ikarita yerekana imiterere ya acoustic (mubisanzwe mel-spectrogramu) mumajwi nyirizina wumva. Parallel WaveGAN, yatanzwe na Yamamoto, Indirimbo, na Kim muri 2019, ibikora hamwe na generator yo mu bwoko bwa WaveNet idahwitse yatojwe nkumuyoboro uhanganye. Aho guhanura icyitegererezo kimwe cyamajwi icyarimwe nka WaveNet yumwimerere, itanga imiterere yose yumurongo ugereranije, bigatuma yihuta cyane. Ibyingenzi byingenzi bihuza igihombo cyo guhangana nigisubizo cyigihe gito cyo guhinduka kwa Fourier (STFT), bityo moderi ihuye nikimenyetso nyacyo mugihe kinini nubunzani. Igisubizo ni generator ntoya (ibipimo bya miriyoni 1,4) ikora inshuro nyinshi kurenza igihe nyacyo kuri GPU.

Gushyira mu bikorwa Isi

Ijambo-nyaryo risohoka mumajwi igendanwa abafasha aho ubukererwe nubunini bwikitegererezo bifite akamaro

Gukora nka generator ya generator ihujwe na moderi ya acoustic nka Tacotron 2 cyangwa FastSpeech

Ku gikoresho-cy-inyandiko-ku-bikoresho kubikoresho byoroshye bidashobora kwishingikiriza ku gicu

Sisitemu yo guhindura amajwi yongeye guhinduranya spekrogramu mu majwi asanzwe yumvikana

Kazoza Kuringaniza WaveGAN Vocoder

Parallel WaveGAN yafashije gushiraho amajwi ya GAN nkibisanzwe bifatika, kandi igihombo cyayo kinini-STFT igihombo kigaragara mubasimbuye nka HiFi-GAN hamwe na sisitemu nyinshi zitemba. Inzira nyabagendwa yerekeza kuri buri gihe ntoya, amajwi-yihuta yo gutabaza kubafasha ku bikoresho, ibyuma bifata amajwi, hamwe no guhindura amajwi bizima, hiyongereyeho amajwi rusange asanzwe avuga abavuga batagaragara. Witegereze guhuza hamwe na TTS iherezo-iherezo no kohereza neza kuri mobile igendanwa.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Kugera no kugera. Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
  • Igiciro na bije. Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
  • Umuvuduko n'igipimo. Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Witondere

  • Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
  • Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
  • Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Intambwe ikurikira

  1. Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
  2. Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
  3. Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
  4. Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Parallel WaveGAN Vocoder quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Vocoder Iringaniye Niki?

Parallel WaveGAN nijwi ryihuta ryijwi rihindura mel-spectrogramu muburyo bwamajwi mbisi ikoresheje GAN ntoya, ikabyara icyarimwe icyarimwe. Nibyingenzi kuko itanga hafi-nyayo-nyayo, ireme-mvugo nziza hamwe na moderi yoroheje.

Nuwuhe murimo wijwi nka Parallel WaveGAN?

Ijwi ni icyiciro cya nyuma cya TTS gihuza amajwi nyirizina avuye muri acoustic nka mel-spectrogram.

Nigute Parallel WaveGAN itanga urugero rwamajwi ugereranije na WaveNet yumwimerere?

Kuringaniza WaveGAN ntabwo ari autoregressive, itanga icyerekezo cyose icyarimwe aho kuba icyitegererezo nicyitegererezo, bigatuma cyihuta cyane.

Ni ikihe gihombo ari ingenzi kuri Parallel WaveGAN usibye igihombo cyo guhangana?

Ihuza igihombo cyo guhangana nigihombo kinini cya STFT igereranya ubunini bwa spekrogramu kumunzani.

Ni ubuhe bwubatsi generator ya Parallel WaveGAN ikoresha?

Imashini itanga umuyoboro umeze nka WaveNet wubatswe kuva kwaguka, kugengwa na mel-spectrogramu n urusaku.

Ni ukubera iki Parallel WaveGAN ishimishije kubohereza?

Hafi ya miriyoni 1,4 ni ntoya kandi ikora inshuro nyinshi byihuse kuruta igihe nyacyo, cyiza cyo gukoresha ibikoresho.