Takootron 2
Tacotron 2 waa hab-dhammaad-ilaa-dhamaadka qoraalka-ilaa-hadalka nidaamka Google (2017) kaas oo qoraalka qoran si toos ah ugu beddela mel-spectrogram, kaas oo cod-yaqaanka neural-ku u beddelo hadal nololeed oo kale ah.
Dulmar
It produced audio rivaling human recordings on key benchmarks.
quusid qoto dheer
Tacotron 2 waxay leedahay laba qaybood oo waaweyn. Marka hore, shabakad isku xig-xigsi leh oo fiiro gaar ah leh waxay akhridaa xarfaha qoraalka waxayna saadaalisaa mel-spectrogram frame by frame. Codeeyuhu wuxuu u rogaa jilayaasha matalaad qarsoon, habka dareenka xasaasiga ah ee goobta ayaa ku toosiya qoraalka xarafyada maqalka ah, iyo codeeyaha autoregressive wuxuu soo saaraa spectrogram halka 'stop token' uu baranayo marka odhaahdu dhammaato. Midda labaad, codeeyaha WaveNet ee wax laga beddelay ayaa u beddelaya mel-spectrogram-ka qaab mowjad cayriin ah. Marka loo qaybiyo dhibaatada habkan, Tacotron 2 waxa ay bartaa prosody, ku dhawaaqida, iyo ka shaqaynta xogta iyada oo ugu yar farsamada gacanta. Waxay gaadhay dhibco celcelis ahaan ra'yi ah oo u dhow duubista xirfadleyda, taasoo ka dhigaysa calaamad muujinaysa isku-dhafka dhawaaqa dabiiciga ah iyo qaab-dhismeedka TTS dambe ee neerfaha.
Aragtida Farsamada
mel-spectrogram-ka waa is-dhex-galka xariifnimada leh ee u dhexeeya labada shabakadood: waa mid kooban oo sahlan in qaabka dareenka la saadaaliyo, haddana qani ku filan cod-bixiyaha inuu dib u dhiso codka kalsoonida sare leh. Dareenka xasaasiga ah ee goobta ayaa ka hortagaya guuldarrooyinka caadiga ah sida ereyada soo noqnoqda ama la booday iyadoo la tixgalinayo toosin hore, iyo furaha autoregressive oo leh calaamad joogsi la bartay ayaa u ogolaanaya moodelku inuu si xarago leh u qabsado weedhaha dhererka doorsooma.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka Takotron 2
Naqshadaynta laba-heer ee Tacotron 2 waxay dhiirigelisay mowjadaha neural TTS. Ku-xigeennada degdega ah ee aan madax-bannaanayn sida FastSpeech 2 waxay ka saareen furaha isku xigxiga ee xawaaraha iyo xasilloonida, iyo codadka WaveNet hadda waxaa badanaa lagu beddelaa HiFi-GAN ama moodooyinka fidinta. Goobtu waxay u socotaa si buuxda dhamaadka-ilaa-dhamaadka iyo kuwa badan oo ku hadla, hababka muujinta, iyo eber-shot codaynta, laakiin Tacotron 2 ayaa weli ah tixraaca aasaasiga ah ee dhuumaha ku salaysan spectrogram.
Dhaqangelinta Adduunka-dhabta ah
Ku-xoojinta codadka dabiiciga ah ee Google agabka qoraalka-hadalka iyo caawiyayaasha
Soo saarista sheeko qeexan oo loogu talagalay buugaagta maqalka iyo podcasts
Bixinta codadka akhristayaasha shaashadda iyo sooftiweerka gelitaanka
U adeegida aasaaska cilmi-baarista iyo tusaale-barashada tubooyinka TTS neural
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Tacotron 2 quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Modeling Prosody
Su'aalaha soo noqnoqda
What is Tacotron 2?
Tacotron 2 waa hab-dhammaad-ilaa-dhamaadka qoraalka-ilaa-hadalka nidaamka Google (2017) kaas oo qoraalka qoran si toos ah ugu beddela mel-spectrogram, kaas oo cod-yaqaanka neural-ku u beddelo hadal nololeed oo kale ah. Waxa ay soo saartay cajalado ku xifaaltama oo bini'aadamka oo ku salaysan bartilmaameedyada muhiimka ah.
Waa maxay matalaadda dhexe ee Tacotron 2 ka saadaalisay qoraalka?
Shabakadda isku xigxiga ee Tacotron 2 ayaa saadaalisa mel-spectrogram, kaas oo cod-bixiye uu markaas isu rogo maqal.
Maxaa u beddela spectrogram-ka Tacotron 2 qaab mawjad dhab ah?
Tacotron 2 waxay ku lammaanaysaa saadaasha spectrogram-keeda oo leh codad WaveNet la beddelay si loo soo saaro maqalka cayriin ee ugu dambeeya.
Dhibaato noocee ah ayaa dareenka xasaasiga ah ee goobta ka caawiya ka hortagga?
Marka la tixgeliyo toosin hore, dareenka xasaasiga ah ee goobta ayaa yareynaya guuldarrooyinka sida erayada lagu celceliyo ama la tuuray.
Sidee ayuu Tacotron 2 u garanayaa goorta la joojinayo abuurista odhaah?
Codeeyaha autoregressive wuxuu saadaaliyaa calaamada joogsiga, taasoo u oggolaanaysa moodalku inuu qabto jumlado dhererkoodu kala duwan yahay.
Waa maxay qaabka guud ee qaab-dhismeedka ay qaybta qoraalka-ilaa-spectrogram isticmaashaa?
Tacotron 2 waxay isticmaashaa qaab-ku-xiran-ilaa-taxane-gacan-qaabeeya-gacanta iyadoo fiiro gaar ah loo leeyahay jilayaasha khariidadda ee fiimyada spectrogramka.