Chidzidzo cheAI yeRuzha

Tacotron 2

Tacotron 2 is an end-to-end text-to-speech system kubva Google (2017) inoshandura zvinyorwa zvakanyorwa zvakananga kuita mel-spectrogram, iyo neural vocoder inoshandura kuita kutaura kwehupenyu.

Teerera kugwaro iriAI-yakarondedzerwa · ~2 min

Pa peji ino2 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reTacotron 2
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

It produced audio rivaling human recordings on key benchmarks.

Kudzika Kwakadzika

Tacotron 2 ine zvikamu zviviri zvikuru. Chekutanga, kutevedzana-kune-kutevedzana network ine hanya inoverenga mavara ezvinyorwa uye inofanotaura mel-spectrogram furemu nefuremu. Encoder inosandura mavara kuita maratidziro akavanzika, chigadziriso chinotarisisa nzvimbo chinoyananisa mavara nemafuremu ekuteerera, uye autoregressive decoder inoburitsa spectrogram apo 'stop token' inodzidza panopera kutaura. Chechipiri, yakagadziridzwa WaveNet vocoder inoshandura iyo mel-spectrogram kuita mbishi waveform. Nekuparadzanisa dambudziko nenzira iyi, Tacotron 2 inodzidza prosody, mataurirwo, uye kufamba kubva kudhata ine kushoma-injiniya ruoko. Iyo yakawana chirevo chepfungwa chibodzwa padhuze nehunyanzvi kurekodha, zvichiita kuti ive chiratidzo mune zvakasikwa-inonzwika synthesis uye template yeyakazotevera neural TTS.

Kuitwa muNyika yeChokwadi

Kusimbisa manzwi anonzwika mu Google's text-to-kutaura zvigadzirwa nevabatsiri

Kugadzira rondedzero inonakidza yemabhuku ekuteerera uye podcasts

Kupa manzwi evaverengi vescreen uye software yekuwanika

Kushanda seyekutanga yekutsvagisa uye muenzaniso wekudzidzisa kune neural TTS mapaipi

Ramangwana reTacotron 2

Tacotron 2's maviri-nhanho dhizaini yakafuridzira wave neural TTS. Nekukurumidza vasiri-autoregressive vatevedzeri vakaita seFastSpeech 2 yakabvisa inoteedzana decoder yekumhanyisa uye kugadzikana, uye iyo WaveNet vocoder ikozvino inowanzochinjirwa kuHiFi-GAN kana mamodheru. Munda uri kufamba wakananga kumagumo-kusvika-kumagumo uye akawanda-mutauri, anobuditsa, uye zero-kupfura izwi cloning masisitimu, asi Tacotron 2 inoramba iri nheyo yereferensi yemapombi e spectrogram.

Kuzvishandisa

Nei zvichikosha

  • Svika uye svika. Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
  • Mutengo uye bhajeti. Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
  • Kumhanya uye chiyero. Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.

Chenjera

  • Kushandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
  • Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
  • Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.

Matanho anotevera

  1. Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
  2. Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
  3. Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
  4. Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Tacotron 2 quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

What is Tacotron 2?

Tacotron 2 is an end-to-end text-to-speech system kubva Google (2017) inoshandura zvinyorwa zvakanyorwa zvakananga kuita mel-spectrogram, iyo neural vocoder inoshandura kuita kutaura kwehupenyu. Yakaburitsa odhiyo inokwikwidza rekodhi revanhu pane akakosha mabhenji.

Ndeipi inomiririra yepakati iyo Tacotron 2 inofanotaura kubva pane zvinyorwa?

Tacotron 2's sequence-to-sequence network inofanotaura mel-spectrogram, iyo vocoder yobva yachinja kuita odhiyo.

Chii chinoshandura Tacotron 2's spectrogram kuita waveform chaiyo?

Tacotron 2 pairi yayo spectrogram predictor ine yakagadziridzwa WaveNet vocoder kuti ibudise yekupedzisira yakaomeswa odhiyo.

Ndeipi dambudziko rinobatsira kudzivirira nzvimbo?

Nekutarisisa marongero ekare, kutarisa-kwenzvimbo kunoderedza kukundikana senge mazwi ari kudzokororwa kana kudonhedzwa.

How does Tacotron 2 determine that it has generated the end of an utterance?

Tacotron 2 predicts a stop token alongside mel frames; generation ends when the learned stopping condition is met.

Ndeapi akazara maitiro ekuvaka anoshandiswa nemavara-kune-spectrogram chikamu?

Tacotron 2 inoshandisa encoder-decoder sequence-to-sequence modhi ine tarisiro kumamepu mavara kune spectrogram mafuremu.