Isi mmalite-Filter Vocoding na ỤWA
Vocoder bụ ngwá ọrụ na-ekewapụta okwu n'ime ihe owuwu ya ma wughachi ya.
Nchịkọta
The source-filter model and the WORLD vocoder are classic methods that power text-to-speech and voice conversion by separating what your vocal cords do from what your mouth shapes.
Ime miri emi
Ụdị ihe nzacha isi iyi na-akọwa okwu dị ka ibe abụọ na-arụkọ ọrụ ọnụ: isi iyi (mkpọtụ ụda olu gị na-ama jijiji maka ụda ụda olu, ma ọ bụ ikuku na-eme mkpọtụ maka ntanye na consonants) gafere site na nzacha (ụdị nke akpịrị gị, ọnụ na imi gị). Onye vocoder na-enyocha ọdịyo e dekọrọ iji tụọ mpekere ndị a, wee mepụta ọdịyo ọhụrụ site na ha. ỤWA, nke Masanori Morise wepụtara na gburugburu 2016, bụ ụda olu dị elu nke na-ewepụta paramita atọ: F0 (contour nke isi iyi), envelopu spectral (nyocha, site na ya CheapTrick algọridim), na aperiodicity ( ole mkpọtụ megide ụda, site na PLATINUM / D4C). Enwere ike gbanwee iyi atọ ndị a n'onwe ha wee megharịa ya, na-eme ka ụwa bụrụ ihe na-arụ ọrụ maka parametric TTS na sistemụ ụda olu.
Nghọta nka nka
Ike ụwa na-abịa site na nkewa dị ọcha. CheapTrick na-eme atụmatụ envelopu dị larịị nke siri ike ruo obere mperi F0, ebe DIO/Harvest track pitch na D4C na-atụkwa bandịrị aperiodicity. N'ihi na pitch, timbre, na mkpọtụ na-ebi na mmiri mmiri dị iche iche, ị nwere ike ịmegharị F0 n'otu octave na-agbanweghị onye olu dị ka, ma ọ bụ gbatịa oge na-enweghị mgbanwe ụda. Vocoders Neural dị ka WaveNet mechara mepụta ụdị ifegharị ahụ ozugbo, mana ụwa ka na-adị ngwa ngwa, enwere ike ịkọwa, na enweghị ikike.
Mmetụta atụmatụ
Nweta na iru
Ọ na-eme ka nnweta ya dịkwuo mma site na ndegharị, ịkọ akụkọ, na ntụgharị olu.
Ọnụ ego na mmefu ego
Ndị otu mgbasa ozi nwere ike ibubata ọdịyo a na-egbu maramara ngwa ngwa site na iji obere mmefu ego.
Ọsọ na ọnụ ọgụgụ
Sistemụ na-eche ihu ndị ahịa nwere ike hazie mkparịta ụka n'ọtụtụ buru ibu.
Ọdịnihu nke Isi mmalite-Nyocha Vocoding na ỤWA
Ndị vocoders neural (HiFi-GAN, WaveRNN) ejidela ụda olu na-eme mgbaama dị ọcha maka ịdị elu dị elu, mana ụwa apụbeghị. Ọ na-adị ndụ dị ka ngwa ngwa, ihu enyi enyi CPU n'ime pipeline ntụgharị olu, ndị na-abụ abụ, na usoro nyocha, yana njirimara F0-plus-spectral-envelopu ka na-eri ọtụtụ ụdị akwara. Na-atụ anya sistemụ ngwakọ ebe usoro ntụgharị ụdị ụdị ụwa na-eduzi ndị na-ahụ maka akwara, na-enye ndị okike ikike ịchịkwa pitch na timbre na-achụghị eziokwu.
Mmejuputa n'ezie n'ụwa
Ngwa ntụgharị olu nke na-agbanwe ụda olu na-ekwu okwu na timbre mgbe ọ na-eme ka ọ bụrụ nghọta okwu
Ndị na-emepụta ụda olu (dị ka UTAU/NNSVS gburugburu ebe obibi) na-emegharị ndetu na ọkwa ọhụrụ.
Sistemụ ederede-gaa-na-okwu Parametric nke na-emepụta F0, spectral, na aperiodicity iyi tupu ịtụ vootu
Usoro nyocha okwu maka ngbanwe ụda olu, ịgbatị oge, na ndezi prosody na-enweghị ọzụzụ
Ihe ize ndụ & okporo ụzọ nche
Iji olu eme ihe na ihe egwu mpụta ga-abawanye mgbe nkwenye na-efu.
Izi ezi nwere ike ịdaba n'ofe ụda olu, olumba ma ọ bụ gburugburu mkpọtụ.
Enwere ike imehie ọdịyo sịntetik dị ka ezigbo okwu na-enweghị akara doro anya.
Map mmejuputa
Nweta nkwenye doro anya maka ijide olu, imechi, na ijigharị.
Nwale ogo n'ofe ndị na-ekwu okwu dị iche iche yana ọnọdụ ndabere.
Kọwaa mgbe mmadụ ga-enyocha ma ọ bụ kwado nsonye.
Deba aha ọdịyo sịntetik ma debe ndekọ ihe ndekọ maka ịza ajụjụ.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Source-Filter Vocoding and WORLD quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Nkewa Isi Iyi Egwu Demucs
Ajụjụ a na-ajụkarị
What is Source-Filter Vocoding and WORLD?
Vocoder bụ ngwá ọrụ na-ekewapụta okwu n'ime ihe owuwu ya ma wughachi ya. Ụdị ihe nzacha isi iyi na ụda olu ỤWA bụ ụzọ kpochapụrụ na-eme ka ederede gaa na-okwu na ntụgharị olu site na ikewapụ ihe ụdọ olu gị na-eme na ihe ọnụ gị na-akpụ.
N'ụdị isi-nyocha nke okwu, kedu ihe 'nyo' na-anọchi anya ya?
Ihe nzacha bụ ụda traktị ụda olu - udi akpịrị, ọnụ, na imi na-agba ụda olu. Isi mmalite bụ ụda ụda olu ma ọ bụ ikuku na-eme mkpọtụ.
Kedu paramita atọ nke ụwa vocoder na-ewepụta n'okwu?
ỤWA na-emebi okwu n'ime ugboro ole dị mkpa (F0), envelopu spectral (timbre/ filter), na aperiodicity (mkpọtụ na nguzozi ụda).
Gịnị bụ aha algọridim nke ỤWA maka atụle envelopu spectral?
CheapTrick na-eme atụmatụ envelopu dị larịị nke siri ike ruo obere mperi na atụmatụ pitch.
Gịnị mere ikewapụ pitch na spectral envelopu ji baa uru?
N'ihi na pitch (F0) na timbre (envelopu spectral) bụ iyi nwere onwe, ị nwere ike ibuli ma ọ bụ wetuo olu mgbe ị na-echekwa njirimara ọkà okwu.
Kedu ka ụwa si atụnyere ụda olu dị ka HiFi-GAN?
ỤWA bụ ụda olu na-eme mgbaama: ngwa ngwa, enwere ike ịkọwa, yana enyi na enyi CPU. Vocoders akwara na-enwetakarị ọdịdị dị elu mana ha dị arọ karị.