FastPitch ipolowo-Controllable TTS
FastPitch jẹ iyara, awoṣe ọrọ-si-ọrọ ti kii ṣe autoregressive ti o sọ asọtẹlẹ ipolowo (igbohunsafẹfẹ ipilẹ) ti gbogbo ami titẹ sii, jẹ ki o ṣatunkọ intonation ati tcnu nipa sisọ awọn asọtẹlẹ wọnyẹn ni irọrun.
Akopọ
O ṣe pataki nitori pe o ṣe agbejade mel-spectrogram ni kikun ni afiwe — yiyara pupọ ju awọn awoṣe itẹlera atijọ lọ — lakoko ti o funni ni taara, iṣakoso itumọ lori orin ohun.
Jin Dive
FastPitch, ti a ṣe nipasẹ NVIDIA ni ọdun 2020, kọ lori ile-iṣẹ FastSpeech ti o jọra nipa fifi asọtẹlẹ ipolowo han gbangba. Fun foonu ti titẹ sii kọọkan tabi ohun kikọ o ṣe asọtẹlẹ iye-ipilẹ-igbohunsafẹfẹ kan, lẹhinna ṣe atunṣe mel-spectrogram decoder lori elegbegbe ipolowo yẹn. Nitori ipolowo jẹ iyasọtọ, ifihan agbara kika eniyan, o le ṣe isodipupo, yipada, tabi ṣe atunṣe ọwọ ṣaaju iṣelọpọ lati yi tcnu, jẹ ki ọrọ dun diẹ sii laaye, tabi ṣe atunṣe ifijiṣẹ alapin - laisi atunṣeto. Gbogbo spectrogram ni a ṣejade ni iwe-iwọle siwaju kan (ti kii ṣe autoregressive), nitorinaa iran jẹ aijọju aṣẹ ti titobi yiyara ju awọn awoṣe autoregressive bi Tacotron 2, ati ipolowo asọtẹlẹ tun ṣe ilọsiwaju adayeba gbogbogbo.
Imọ-imọ-ẹrọ
FastPitch ṣe iwọn igbohunsafẹfẹ ipilẹ-otitọ ilẹ-otitọ lori iye akoko ami-ami kọọkan lakoko ikẹkọ, nitorinaa asọtẹlẹ kọ ẹkọ iye ipolowo kan fun aami ju fun fireemu kan - ṣiṣe iṣakoso isokuso ṣugbọn ogbon inu. Ni itọkasi, ipolowo ami-ami kan jẹ ikede kọja iye akoko asọtẹlẹ ami naa ati fi kun bi ami ifihan agbara si ẹrọ oluyipada-orisun. Nitoripe ko si isopo esi adaṣe, gbogbo awọn fireemu iṣelọpọ jẹ iṣiro ni igbakanna lori ohun elo ti o jọra, imukuro ikojọpọ aṣiṣe ati iyara lọra ti awọn oluyipada igbese-nipasẹ-Igbese.
Ipa Ilana
Wiwọle ati arọwọto
O ṣe ilọsiwaju iraye si nipasẹ transcription, alaye, ati awọn atọkun ohun.
Iye owo ati isuna
Awọn ẹgbẹ Media le firanṣẹ ohun didan yiyara pẹlu awọn isuna-owo kekere.
Iyara ati iwọn
Awọn ọna ṣiṣe ti nkọju si alabara le ṣe ilana awọn ibaraẹnisọrọ sisọ ni iwọn nla.
Ojo iwaju ti FastPitch ipolowo-Controllable TTS
Imọ-imọ-iṣakoso ti o han gbangba ti FastPitch n ni ipa awọn ọna ṣiṣe tuntun ti o ṣafihan agbara, iye akoko, ati imolara bi awọn ifihan agbara ṣiṣatunṣe lẹgbẹẹ ipolowo, fifun awọn olupilẹṣẹ ni wiwo adapọ-ọkọ fun ohun. Reti isọdọkan wiwọ pẹlu awọn vocoders neural bi HiFi-GAN fun awọn opo gigun ti akoko gidi-si-opin, iṣakoso ipele ipele fireemu ti o dara julọ fun iṣelọpọ orin, ati awọn iyatọ pupọ ati awọn agbohunsoke pupọ. Bi TTS iṣakoso ti ntan sinu awọn ohun elo laaye, iṣipopada ẹrọ kekere-kekere ati gbigbe ara asọye yoo jẹ awọn itọnisọna pataki.
Real-World imuse
Jẹ ki awọn oluranlọwọ oluranlọwọ ohun ṣe igbelaruge ipolowo lori awọn ọrọ bọtini nitorina awọn idahun ti a sọ dun dun diẹ sii
Ṣiṣẹda orin tabi ọrọ aladun nipasẹ ṣiṣatunṣe ọwọ ni igbohunsafẹfẹ ipilẹ-akọsilẹ kọọkan
Itọkasi akoko gidi ni awọn irinṣẹ ti o nilo ọpọlọpọ awọn laini ti a ṣopọ ni iyara nitori iyipada afiwera rẹ
Ṣiṣatunṣe alapin tabi ifijiṣẹ roboti ni awọn ikede ti iṣelọpọ nipasẹ iwọn iwọn ilawọn ipolowo asọtẹlẹ
Awọn ewu & Awọn ọna iṣọ
ilokulo ohun ati awọn ewu afarawe ṣe pọ si nigbati igbanilaaye ba sonu.
Yiye le ju silẹ kọja awọn asẹnti, awọn ede-ede, tabi awọn agbegbe alariwo.
Ohun afetigbọ sintetiki le jẹ aṣiṣe fun ọrọ ododo laisi isamisi to yege.
Ilana Ilana imuse
Gba ifọkansi ti o fojuhan fun gbigba ohun, ti ẹda, ati ilotunlo.
Didara idanwo kọja awọn agbohunsoke oniruuru ati awọn ipo abẹlẹ.
Ṣetumo nigbati eniyan gbọdọ ṣe atunyẹwo tabi fọwọsi awọn abajade.
Aami ohun sintetiki ki o tọju awọn igbasilẹ provenance fun iṣiro.
Tesiwaju Ṣiṣawari
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the FastPitch Pitch-Controllable TTS quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Itọsọna atẹle
Ijapa TTS Autoregressive Synthesis
Awọn ibeere ti a beere nigbagbogbo
Kini FastPitch Pitch-Controllable TTS?
FastPitch jẹ iyara, awoṣe ọrọ-si-ọrọ ti kii ṣe autoregressive ti o sọ asọtẹlẹ ipolowo (igbohunsafẹfẹ ipilẹ) ti gbogbo ami titẹ sii, jẹ ki o ṣatunkọ intonation ati tcnu nipa sisọ awọn asọtẹlẹ wọnyẹn ni irọrun. O ṣe pataki nitori pe o ṣe agbejade kikun mel-spectrogram ni afiwe - yiyara pupọ ju awọn awoṣe atẹle ti agbalagba - lakoko fifun taara, iṣakoso itumọ lori orin aladun ohun.
Ifihan afikun wo ni FastPitch ṣe asọtẹlẹ ni gbangba fun ami titẹ sii kọọkan?
FastPitch ṣe afikun asọtẹlẹ ipolowo kan ti o ṣe agbejade iye-ipilẹ-igbohunsafẹfẹ kan fun ami titẹ sii, ti a lo lati ni majemu decoder spectrogram.
Bawo ni FastPitch ṣe ṣe ipilẹṣẹ mel-spectrogram ni kiakia?
FastPitch kii ṣe autoregressive: o ṣe iṣiro gbogbo awọn fireemu ti o jade ni igbakanna ju igbesẹ kan lọ ni akoko kan, ti o jẹ ki o yarayara ju awọn awoṣe adaṣe lọ.
Bawo ni olumulo kan ṣe le yi tcnu ninu iṣelọpọ FastPitch laisi ikẹkọ bi?
Nitori ipolowo jẹ ifihan gbangba, ifihan ọtọtọ, isodipupo tabi ṣiṣatunṣe ọwọ ni elegbegbe ipolowo asọtẹlẹ taara paarọ tcnu ati igbesi aye.
Lakoko ikẹkọ, bawo ni ibi-afẹde ipolowo sọtọ fun ami kan?
FastPitch ṣe iwọn igbohunsafẹfẹ ipilẹ-ilẹ-otitọ kọja awọn fireemu ami-ami kọọkan, nitorinaa awoṣe kọ iye ipolowo ogbon inu kan fun aami.
Awoṣe agbalagba wo ni FastPitch paapaa yiyara ju nitori yago fun isọdọtun?
Tacotron 2 decodes autoregressively, fireemu nipa fireemu; Yiyipada afiwera FastPitch jẹ ki o ni aijọju aṣẹ ti titobi yiyara.