Modeling prosodi
Modeling prosody dafay jàngal masin yi melodi kàddu, ritm, ton, stress, ak ritm yiy yéeg ci kaw kàddu yi.
Résumé
It is what separates a flat robotic voice from one that sounds genuinely human.
Plongeur bu xóot
Prosody mooy music làkk: yéeg ak wàcci ton bi (intonation), ba ñaata fan lañuy tëye son yi (diir bi), kawe gi (energie), ak fi aksan bi di wàcci. Signal yooyu dañuy yor luñuy tekki ci kàddu yi kese duñu ko am, di màndargaal laaj ak wax, sarcasm, urgence, wala ban baat moo am solo. Sistem yu bees yiy soppi bind ci kàddu dañuy wane prosody ak reso neuronal yuy wax luy waaja am ci ton yi, diir bi fonem yi di yàgg, ak doole jiy joge ci bind bi. Tacotron 2 jàng lu bari ci lii ci anam wu nëbbu ci bàyyi xel, fekk FastSpeech 2 daf ko leer ci di wax luy yàgg, pitch, ak doole muy màndarga yuñ mëna tàggat. Prosody bu baax mingi aju ci contexte bi sistem bi mënul am ci ponctuation kese, moo tax model yi di gëna jëfandikoo frase yi ko wër ba ci audio royuwaay ngir defar ton bu dëggu bi.
Gis-gis xarala
Tone bi dañu koy toppe ci fréquence fundamental bi (F0) ci baat bi, di viteesu pli vocal yi di yëngu. Modèle yu melni FastSpeech 2 dañuy yokk benn adaptatëru variance buy wax luy waaja am ci F0, energie, ak diir bi fonem bu nekk di doxee ci ay dex yu wuute, ba noppi ñu defar dekodeeru spectrogram bi ci kaw. Ndax mbind mi du mëna wax lu bari ci prosody (benn santaane amna lu bari luñu koy jàng), loolu mooy jafe-jafe benn-ci-ñu bari, kon sistem yi dañuy jëfandikoo latents variational wala encoder referansi ngir tànn benn joxe bu amul benn moyenne ci monotone.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu modelu prosody
Prosody mingi dem ci xam-xam contexte ci paragraphe yépp ak waxtaan yi, suko defee nettalikat bi mën tabax tension wala chatbot mën méngoo ak humeur jëfandikukat bi. Modèlu wax ak làkk yu bari dañuy jàng prosody boole ci luñuy tekki, loolu mooy tax ñu mëna tànn butoŋu emphasis, emotion, ak ni ñuy waxee jaaraleko ci tegtali bind bu leer. Xaarandi audiobooks, doublage, ak ay assistant yuy wuutale joxe gi ci seen bopp, boole ci di doxal bu baax ci kaw disfluencies ak noyyi ngir jàll wàll wi mujj ci vale bu yéeme bi.
Doxal ci àdduna dëgg
Sistemu nettali audiobook yuy wuutale ton ak ritm suko defee chapitre yi di sone luy fësal lu bari te baña sone benn tone
Jàppalekat yi ci net bi dañuy yëkkati intonaasioŋ ci njeexitalu laaj waaw/déedet suko defee mu leer ni laaj la
Jumtukaayi doblage filmu ak wideo yu méngoo ak ritm bi aktër bi di jouer
Jàngat ekraŋ ngir yombal jëfandikoo gi, di fësal kàddu yu am solo yi, suko defee jëfandikukat yu silmaxa yi gëna gaaw ci xam li frase bi di tekki
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Prosody Modeling quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
XLNet Modeling
Laaj yi ñuy faral di laaj
What is Prosody Modeling?
Modeling prosody dafay jàngal masin yi melodi kàddu, ritm, ton, stress, ak ritm yiy yéeg ci kaw kàddu yi. Mooy tàqale baat robot bu plat ak baat buy nuru baat nit dëgg.
Ban màndarga moo gëna mëna fësal prosody ci wax?
Prosody dafay wax ci màndarga yi gëna mag ci kàddu yi, intonaasioŋ (ton), ritm ak guddaay, stress, ak doole (kawewaay), yu yéeg ci kaw kàddu yi.
Ci modelu prosody, lan mooy fréquence fundamental (F0)?
F0 mooy fréquence bi gëna am solo ci baat bi, di viteesu yëngug pli vocal yi, nu koy dégg ni ton wala melodi bu baat bi.
naka la ko FastSpeech 2 gëne yombalee ci wàllu prosody ci yeneen model yu njëkk ya?
FastSpeech 2 dugal na adaptatëru variance buy wax luy yàgg, ton, ak doole ci anam wu leer, loolu mooy tax ñu gëna mëna yor prosody bi te baña bàyyi xel ci mbiri àdduna.
Lan moo waral ñu jàpp ni wax luy prosody ci mbind kese mooy jafe-jafe bu benn ci ñu bari?
Benn baat bi mën nañu ko joxe ci anam yu bari, lépp di aju ci mébet ak yëg-yëg, kon xeetu nit ñi dañu wara tànnee ci njàngale yu bari yu baax ci prosodic, duñu xayma benn tontu.
Ban tegtal mooy gëna fësal ni frase bu ñuy wax ci Àngle mooy waaw/déedet?
Laajte waaw/déedet ci Àngle dañuy jeexee ci intonasioŋ bu yéeg, muy luy wuutale ci kàddu yi doonte ay baat yu nuróo lañu.