Orisun-Filter Vocoding ati WORLD
Vocoder jẹ ohun elo kan ti o mu ọrọ yato si awọn bulọọki ile rẹ ti o tun ṣe.
Akopọ
The source-filter model and the WORLD vocoder are classic methods that power text-to-speech and voice conversion by separating what your vocal cords do from what your mouth shapes.
Jin Dive
Awoṣe-àlẹmọ orisun n ṣapejuwe ọrọ bi awọn ege meji ti n ṣiṣẹ papọ: orisun kan ( ariwo lati awọn okun ohun gbigbọn rẹ fun awọn ohun ti a sọ, tabi afẹfẹ alariwo fun whispers ati awọn kọnsonanti) kọja nipasẹ àlẹmọ (apẹrẹ ti ọfun rẹ, ẹnu, ati imu). Vocoder ṣe itupalẹ ohun ti o gbasilẹ lati ṣe iṣiro awọn ege wọnyi, lẹhinna ṣajọpọ ohun titun lati ọdọ wọn. AGBAYE, ti a tu silẹ nipasẹ Masanori Morise ni ayika 2016, jẹ vocoder ti o ni agbara giga ti o yọkuro awọn aye mẹta: F0 (agbegbe ipolowo ti orisun), apoowe spectral (àlẹmọ, nipasẹ CheapTrick algorithm rẹ), ati aperiodicity (iye ariwo ni ibamu si ohun orin, nipasẹ PLATINUM/D4C). Awọn ṣiṣan mẹta wọnyi le ṣe atunṣe ni ominira lẹhinna tun ṣe atunto, ṣiṣe WORLD iṣẹ-iṣẹ fun TTS parametric ati awọn eto ohun orin.
Imọ-imọ-ẹrọ
Agbára ayé ń wá látinú ìyapa mímọ́. CheapTrick ṣe iṣiro apoowe iwoye didan ti o lagbara si awọn aṣiṣe F0 kekere, lakoko ti ipolowo orin DIO/Harvest ati D4C ṣe iwọn aperiodicity iye. Nitori ipolowo, timbre, ati ariwo n gbe ni awọn ṣiṣan paramita lọtọ, o le yi F0 soke octave kan laisi iyipada tani ohun ti o dun bi, tabi gigun gigun laisi iyipada ipolowo. Awọn vocoders Neural bi WaveNet nigbamii ṣe awoṣe igbi ni taara, ṣugbọn AYE wa ni iyara, itumọ, ati laisi iwe-aṣẹ.
Ipa Ilana
Wiwọle ati arọwọto
O ṣe ilọsiwaju iraye si nipasẹ transcription, alaye, ati awọn atọkun ohun.
Iye owo ati isuna
Awọn ẹgbẹ Media le firanṣẹ ohun didan yiyara pẹlu awọn isuna-owo kekere.
Iyara ati iwọn
Awọn ọna ṣiṣe ti nkọju si alabara le ṣe ilana awọn ibaraẹnisọrọ sisọ ni iwọn nla.
Ojo iwaju ti Orisun-Filter Vocoding ati WORLD
Awọn vocoders ti n ṣisẹ ifihan agbara mimọ ti gba pupọ nipasẹ awọn vocoders neural (HiFi-GAN, WaveRNN) fun iseda ti oke-opin, ṣugbọn AYE ko ti parẹ. O yege bi iyara, opin iwaju ore-ọrẹ Sipiyu inu awọn opo gigun ti iyipada ohun, awọn iṣelọpọ orin, ati awọn ipilẹ iwadi, ati awọn ẹya F0-plus-spectral-envelope ti o tun jẹ ifunni ọpọlọpọ awọn awoṣe nkankikan. Reti awọn ọna ṣiṣe arabara nibiti awọn aye-itumọ ara-aye ṣe itọsọna awọn decoders ti ara, fifun awọn olupilẹṣẹ ni iṣakoso kongẹ lori ipolowo ati timbre laisi irubọ otitọ.
Real-World imuse
Awọn irinṣẹ iyipada ohun ti o yipada ipolowo agbọrọsọ ati timbre lakoko ti o jẹ ki ọrọ ni oye
Awọn olupilẹṣẹ ohun orin (gẹgẹbi ilolupo eda UTAU/NNSVS) ti o tun ṣe awọn akọsilẹ ni awọn ipolowo tuntun
Awọn ọna ṣiṣe ọrọ-si-ọrọ parametric ti o ṣe agbekalẹ F0, spectral, ati awọn ṣiṣan aperiodicity ṣaaju ki o to fokodi
Awọn ipilẹ ti iwadii ọrọ fun iyipada ipolowo, gigun akoko, ati ṣiṣatunṣe prosody laisi atunṣeto
Awọn ewu & Awọn ọna iṣọ
ilokulo ohun ati awọn ewu afarawe ṣe pọ si nigbati igbanilaaye ba sonu.
Yiye le ju silẹ kọja awọn asẹnti, awọn ede-ede, tabi awọn agbegbe alariwo.
Ohun afetigbọ sintetiki le jẹ aṣiṣe fun ọrọ ododo laisi isamisi to yege.
Ilana Ilana imuse
Gba ifọkansi ti o fojuhan fun gbigba ohun, ti ẹda, ati ilotunlo.
Didara idanwo kọja awọn agbohunsoke oniruuru ati awọn ipo abẹlẹ.
Ṣetumo nigbati eniyan gbọdọ ṣe atunyẹwo tabi fọwọsi awọn abajade.
Aami ohun sintetiki ki o tọju awọn igbasilẹ provenance fun iṣiro.
Tesiwaju Ṣiṣawari
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Source-Filter Vocoding and WORLD quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Itọsọna atẹle
Demucs Orin Orisun Iyapa
Awọn ibeere ti a beere nigbagbogbo
What is Source-Filter Vocoding and WORLD?
Vocoder jẹ ohun elo kan ti o mu ọrọ yato si awọn bulọọki ile rẹ ti o tun ṣe. Awoṣe asẹ-orisun ati olugbohunsafẹfẹ WORLD jẹ awọn ọna Ayebaye ti o ṣe agbara ọrọ-si-ọrọ ati iyipada ohun nipa yiya sọtọ ohun ti awọn okun ohun rẹ ṣe lati ohun ti ẹnu rẹ ṣe.
Ninu awoṣe orisun-àlẹmọ ti ọrọ, kini 'àlẹmọ' naa ṣe aṣoju?
Àlẹmọ jẹ ariwo ti ngba ohun - irisi ọfun, ẹnu, ati imu ti o ṣe awọ ohun naa. Orisun ni ariwo-okun ariwo tabi ariwo afẹfẹ.
Awọn paramita mẹta wo ni agbaye vocoder yọ jade lati ọrọ?
AGBAYE sọ ọrọ sisọ sinu igbohunsafẹfẹ ipilẹ (F0), apoowe iwoye (timbre/filter), ati aperiodicity (ariwo dipo iwọntunwọnsi ohun orin).
Kini orukọ algoridimu AYÉ fun ṣiṣe iṣiro apoowe iwoye?
CheapTrick ṣe iṣiro apoowe iwoye didan ti o lagbara si awọn aṣiṣe kekere ni iṣiro ipolowo.
Kini idi ti yiya ipolowo kuro lati apoowe iwoye ṣe wulo?
Nitori ipolowo (F0) ati timbre (apowe iwoye) jẹ awọn ṣiṣan ominira, o le gbe soke tabi isalẹ ipolowo lakoko ti o tọju idanimọ agbọrọsọ.
Bawo ni WORLD ṣe afiwe si awọn vocoders ti ara bi HiFi-GAN?
AGBAYE jẹ gbohungbohun ti n ṣisẹ ifihan agbara: yara, itumọ, ati ore-ọrẹ Sipiyu. Awọn vocoders nkankikan ni igbagbogbo ṣaṣeyọri adayeba ti o ga ṣugbọn o wuwo.