Audio AI JAGORA

Source-Tace Vocoding da DUNIYA

Vocoder kayan aiki ne wanda ke raba magana cikin tubalan gininsa kuma ya sake gina shi.

Dubawa

Vocoder kayan aiki ne wanda ke raba magana cikin tubalan gininsa kuma ya sake gina shi. Samfurin tace-tushen da kuma muryar DUNIYA hanyoyi ne na yau da kullun waɗanda ke ba da ƙarfin rubutu-zuwa-magana da canza murya ta hanyar raba abin da igiyoyin muryar ku ke yi da abin da bakinku ya siffata.

Source-Tace Vocoding da DUNIYA yana zaune a cikin ayyukan audio-AI wanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai.

Zurfafa nutsewa

Samfurin tace-tushen ya bayyana magana azaman guda biyu suna aiki tare: tushe (ƙarashin sautin muryar ku don sautin murya, ko iska mai hayaniya don raɗaɗi da baƙaƙe) ta hanyar tacewa (siffar makogwaro, baki, da hanci). Vocoder yana nazarin sautin da aka yi rikodi don kimanta waɗannan guda, sannan ya haɗa sabon sauti daga gare su. DUNIYA, wanda Masanori Morise ya sake shi a kusa da 2016, babban vocoder ne mai inganci wanda ke fitar da sigogi guda uku: F0 (madaidaicin madaurin tushe), ambulaf mai gani (tace, ta hanyar CheapTrick algorithm), da aperiodicity (nawa amo da sautin, ta hanyar PLATINUM/D4C). Ana iya canza waɗannan rafukan guda uku da kansu sannan a sake haɗa su, suna mai da DUNIYA dokin aiki don madaidaicin TTS da tsarin murya.

Fahimtar Fasaha

Ikon DUNIYA yana zuwa daga rabuwa mai tsabta. CheapTrick yana ƙididdige ambulaf mai santsi wanda ke da ƙarfi ga ƙananan kurakurai na F0, yayin da DIO/Harvest filin waƙa da D4C ke auna ƙarfin saƙo. Saboda farar sauti, katako, da hayaniya suna rayuwa a cikin rafukan ma'auni daban-daban, zaku iya matsawa F0 sama da octave ba tare da canza wanda sautin yake sauti ba, ko tsayin lokaci ba tare da canza sauti ba. Ƙwayoyin murya kamar WaveNet daga baya sun tsara tsarin motsi kai tsaye, amma DUNIYA ta kasance cikin sauri, fassarar, kuma ba ta da lasisi.

Jagorar Tushen-Tace Vocoding da DUNIYA

Vocoder kayan aiki ne wanda ke raba magana cikin tubalan gininsa kuma ya sake gina shi. Samfurin tace-tushen da kuma muryar DUNIYA hanyoyi ne na yau da kullun waɗanda ke ba da ƙarfin rubutu-zuwa-magana da canza murya ta hanyar raba abin da igiyoyin muryar ku ke yi da abin da bakinku ya siffata. Source-Tace Vocoding da DUNIYA yana zaune a cikin ayyukan audio-AI wanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai. Don gina zurfin fahimta, bi Source-Tace Vocoding da DUNIYA azaman samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, fayyace zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi masu amfani da Source-Filter Vocoding da DUNIYA suna ɗaukar inganci, jinkiri, da yarda a matsayin daidaitattun sassa na dabarun turawa. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A lokaci guda, rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar Tushen-Tace Vocoding da DUNIYA

Masu amfani da siginar sigina masu tsafta sun mamaye vocoders na jijiyoyi (HiFi-GAN, WaveRNN) don dabi'ar saman-ƙarshen, amma DUNIYA ba ta ɓace ba. Yana rayuwa a matsayin mai sauri, ƙarshen abokantaka na CPU a cikin bututun jujjuya murya, masu haɗar waƙa, da tushen bincike, kuma fasalulluka na F0-plus-spectral-envelope ɗin sa har yanzu suna ciyar da samfuran jijiya da yawa. Yi tsammanin tsarin haɗaɗɗiyar inda ma'auni masu fassara irin nau'in DUNIYA ke jagorantar dikodi na jijiyoyi, yana ba masu ƙirƙira daidaitaccen iko akan farar da katako ba tare da sadaukar da gaskiya ba.

Aiwatar da Gaskiyar Duniya

Kayan aikin musanya muryar da ke canza sautin lasifika da damara yayin da ake fahimtar magana

Rarraba masu haɗa murya (kamar yanayin yanayin UTAU/NNSVS) waɗanda ke sake haɗa bayanin kula a sabbin filaye.

Tsarukan rubutu-zuwa-magana waɗanda ke haifar da F0, spectral, da rafukan aperiodicity kafin yin magana.

Tushen bincike na magana don jujjuyawar sauti, shimfiɗa lokaci, da gyaran gyare-gyare ba tare da sake horarwa ba

Hanyoyin Aiwatarwa

Source-Tace Vocoding da DUNIYA a aikace

Kayan aikin musanya muryar da ke canza sautin lasifika da damara yayin da ake fahimtar magana.

Kayan aikin musanya muryar da ke canza sautin lasifika da katako yayin da ke riƙe ƙungiyoyi masu fahintar magana yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙima masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'i, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.

Source-Tace Vocoding da DUNIYA a aikace

Rarraba masu haɗa murya (kamar yanayin yanayin UTAU/NNSVS) waɗanda ke sake haɗa bayanin kula a sabbin filaye.

Rarraba masu haɗa murya (kamar yanayin yanayin UTAU/NNSVS) waɗanda ke sake haɗa bayanin kula a sabbin fage Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suke ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin duk abubuwan da aka samu da ƙimar kuɗi akan lokaci.

Source-Tace Vocoding da DUNIYA a aikace

Tsarukan rubutu-zuwa-magana waɗanda ke haifar da F0, spectral, da rafuffukan aperiodicity kafin yin magana.

Tsarukan rubutu-zuwa-magana waɗanda ke haifar da F0, spectral, da rafukan daɗaɗɗen rafuka kafin ƙididdigewa Ƙungiyoyi yawanci suna samun kyakkyawan sakamako lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da farashi na kuskure akan lokaci.

Source-Tace Vocoding da DUNIYA a aikace

Tushen bincike na magana don jujjuyawar sauti, shimfiɗa lokaci, da gyaran gyare-gyare ba tare da sake horarwa ba.

Tushen bincike na magana don jujjuyawar fira, shimfida lokaci, da gyaran gyare-gyare ba tare da sake horarwa Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don shari'o'in gefe, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.

!

Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.

!

Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.

Taswirar Hanya

1

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Gwajin ingantattun masu magana daban-daban da yanayin baya.

Gwajin ingantattun masu magana daban-daban da yanayin baya. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike