I-Tacotron 2
I-Tacotron 2 iwuhlelo olusuka ngasekugcineni lombhalo uye-enkulumweni olusuka ku-Google (2017) olushintsha umbhalo obhaliwe uwenze i-mel-spectrogram, lapho i-neural vocoder iguqulela inkulumo efana nempilo.
Uhlolojikelele
It produced audio rivaling human recordings on key benchmarks.
I-Deep Dive
I-Tacotron 2 inezingxenye ezimbili eziyinhloko. Okokuqala, inethiwekhi yokulandelana-kuya-kulandelana ngokunaka ifunda izinhlamvu zombhalo futhi ibikezele uhlaka lwe-mel-spectrogram ngohlaka. Isifaki khodi sishintsha izinhlamvu zibe izethulo ezifihliwe, indlela yokunaka ebucayi indawo iqondanisa umbhalo nozimele bomsindo, futhi isikhiphi khodi esizenzakalelayo sikhipha i-spectrogram kuyilapho 'ithokheni yokumisa' ifunda lapho amazwi ephela. Okwesibili, i-vocoder ye-WaveNet eguquliwe iguqula leyo mel-spectrogram ibe i-waveform eluhlaza. Ngokuhlukanisa inkinga ngale ndlela, i-Tacotron 2 ifunda i-prosody, ukuphimisela, nokuhamba kancane kusuka kudatha ngobunjiniyela bezandla obuncane. Ithole amaphuzu amaphakathi ombono eduze nokurekhodwa okuphrofeshinali, okuyenza ibe yingqopha-mlando ku-synthesis ezwakalayo yemvelo kanye nesifanekiso se-neural TTS yakamuva.
I-Technical Insight
I-mel-spectrogram iyisixhumi esibonakalayo esihlakaniphile phakathi kwamanethiwekhi amabili: ihlangene futhi kulula ngemodeli yokunaka ukuyibikezela, kodwa inothe ngokwanele ukuthi i-vocoder yakhe kabusha umsindo othembekile. Ukunaka okuzwelayo kwendawo kuvimbela ukwehluleka okuvamile okufana namagama aphindaphindiwe noma eqiwe ngokucabangela ukuqondanisa kwangaphambilini, futhi idekhoda ezenzakalelayo enethokheni yokumisa efundiwe ivumela imodeli ukuthi isingathe imisho yobude obuguquguqukayo kahle.
I-Strategic Impact
Finyelela futhi ufinyelele
Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.
Izindleko kanye nesabelomali
Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.
Isivinini nesikali
Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.
Ikusasa le-Tacotron 2
Umklamo wezigaba ezimbili we-Tacotron 2 ugqugquzele igagasi le-neural TTS. Abalandeli abasheshayo abangasebenzisi ngokuzenzakalela njenge-FastSpeech 2 bakhiphe isiqophi sekhodi esilandelanayo ukuze uthole isivinini nokuzinza, futhi ivowuda ye-WaveNet manje ivame ukushintshwa nge-HiFi-GAN noma amamodeli okusabalalisa. Inkambu isiya ngasekugcineni okupheleleyo kanye nezinhlelo zokuhlanganisa izikhulumi eziningi, ezicacile, nezingashoti, kodwa i-Tacotron 2 isalokhu iyinkomba eyisisekelo yamapayipi asekelwe ku-spectrogram.
Ukuqaliswa Komhlaba Wangempela
Inika amandla amazwi emisindo yemvelo kumikhiqizo nabasizi be-Google
Ikhiqiza ukulandisa okuvezayo kwama-audiobook nama-podcasts
Ukunikeza amazwi ezifundi zesikrini kanye nesofthiwe yokufinyeleleka
Ukukhonza njengesisekelo socwaningo kanye nesibonelo sokufundisa samapayipi e-neural TTS
Izingozi & Guardrails
Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.
Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.
Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.
Ukuqalisa Umhlahlandlela
Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.
Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.
Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.
Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tacotron 2 quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
I-Prosody Modeling
Imibuzo evame ukubuzwa
What is Tacotron 2?
I-Tacotron 2 iwuhlelo olusuka ngasekugcineni lombhalo uye-enkulumweni olusuka ku-Google (2017) olushintsha umbhalo obhaliwe uwenze i-mel-spectrogram, lapho i-neural vocoder iguqulela inkulumo efana nempilo. Ikhiqize ukuqoshwa komuntu okuqhudelana komsindo kumabhentshimakhi abalulekile.
Isiphi isethulo esiphakathi esibikezelwa iTacotron 2 embhalweni?
Inethiwekhi ye-Tacotron 2 yokulandelana-kuya-kulandelana ibikezela i-mel-spectrogram, i-vocoder bese iphenduka ibe umsindo.
Yini eguqula i-spectrogram ye-Tacotron 2 ibe i-waveform yangempela?
I-Tacotron 2 ibhanqa isibikezelo sayo se-spectrogram nevokhoda ye-WaveNet eguquliwe ukuze ikhiqize umsindo wokugcina ongahluziwe.
Iyiphi inkinga ukunaka okuthinta indawo kusiza ukuyigwema?
Ngokucabangela ukuqondanisa kwangaphambilini, ukunaka okubucayi kwendawo kunciphisa ukwehluleka okufana namagama aphindaphindwayo noma awehliswe.
I-Tacotron 2 yazi kanjani ukuthi kufanele iyeke nini ukukhiqiza inkulumo?
I-autoregressive decoder ibikezela ithokheni yokuma, ivumele imodeli iphathe imisho yobude obuhlukahlukene.
Isiphi isitayela sezakhiwo esisetshenziswa ingxenye ye-text-to-spectrogram?
I-Tacotron 2 isebenzisa imodeli ye-encoder-decoder yokulandelana-kuya-kulandelana ngokunaka izinhlamvu zemephu kumafreyimu e-spectrogram.