Isha-kala-shaandhaynta codaynta iyo ADUUNKA
Codkadeeyuhu waa qalab hadalka kala sooca dhismihiisa oo dib u dhisa.
Dulmar
Qaabka source-filter iyo WORLD vocoder waa habab classic ah oo awood u yeesha qoraalka ilaa hadalka iyo beddelka codka iyagoo kala soocaya waxa xadhkaha codka sameeyaan iyo waxa afkaaga u qaabeeyo.
quusid qoto dheer
Tusaalaha isha-shaandhaynta ayaa hadalka ku tilmaamaya laba qaybood oo wada shaqaynaya: il (dhawaaqa ka imanaya xadhkaha codka gariiraya ee sanqadhaha codka leh, ama hawada buuqa badan ee xanshaada iyo shibbanayaasha) dhex mara shaandhada (qaabka sanka leh ee cunaha, afka, iyo sanka). Vocoder-ku waxa uu falanqeeyaa maqal la duubay si uu u qiyaaso qaybahan, ka dibna ka soo saara cod cusub. DUNIDA, oo ay sii daysay Masanori Morise agagaarka 2016, waa cod-bixiye tayo sare leh oo soo saara saddex qaybood: F0 (qaabka isha isha), baqshadda muuqaalka (shaandhada, iyada oo loo marayo algorithm CheapTrick), iyo aperiodicity (intee in le'eg qaylada ka soo horjeeda codka, iyada oo loo marayo PLATINUM/D4C). Saddexdan durdurradan si madax-bannaan ayaa loo beddeli karaa ka dibna dib ayaa loo falanqeyn karaa, taasoo ka dhigaysa ADUUNKA faras-shaqaale u leh TTS-ga iyo heesaha codka.
Aragtida Farsamada
Awoodda adduunku waxay ka timaaddaa kala-bax nadiif ah. CheapTrick waxa uu qiyaasaa baqshad siman oo spectral ah oo adag oo ku adag khaladaadka F0 yar, halka DIO/Harvest track garoonka iyo D4C ay cabbiraan xadiga xawliga. Sababtoo ah garoonka, timbre, iyo sanqadhku waxay ku nool yihiin durdurro qiyaaseed oo kala duwan, waxaad kor u qaadi kartaa F0 octave adoon bedelin qofka codku u eg yahay, ama fidin muddada adiga oo aan beddeleynin codka. Codbixiyeyaasha neerfaha sida WaveNet ayaa markii dambe qaabeeyay qaab-dhismeedka mawjada si toos ah, laakiin dunidu si degdeg ah ayay u ahaanaysaa, la tarjumi karaa, oo bilaa shati ah.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka isha-shaandhaynta cod bixinta iyo ADUUNKA
Cod-bixiyeyaal siyaalo saafi ah oo sax ah ayaa inta badan la wareegay cod-bixiyeyaasha neural (HiFi-GAN, WaveRNN) ee dabiiciga ugu sarreeya, laakiin dunidu ma lumin. Waxay u noolaataa si degdeg ah, dhammaadka hore ee saaxiibtinimo ee CPU gudaha dhuumaha beddelka codka, soo-saareyaasha heesaha, iyo saldhigyada cilmi-baarista, iyo astaamaha baqshadda F0-plus-spectral-spectral-ka ayaa wali quudiya noocyo badan oo neural ah. Filo nidaamyada isku-dhafka ah halkaasoo cabbirrada la tarjumi karo ee qaabka ADUUNKA hagayaan qalabka dareemayaasha, siinaya abuurayaasha si sax ah u xakameynaya garoonnada iyo alwaaxyada iyagoon u hurayn xaqiiqada.
Dhaqangelinta Adduunka-dhabta ah
Aaladaha beddelka codka ee beddela garoonka afhayeenka iyo timbre iyadoo hadalka lagu ilaalinayo mid la fahmi karo
Soosaarayaasha codka heesa (sida UTAU/NNSVS deegaanka) ee dib u habeeya qoraalada meelaha cusub
Nidaamyada qoraalka-hadalka u dhigma ee soo saara F0, spectral, iyo durdurrada hawada sare ka hor codaynta
Saldhigyada cilmi-baarista hadalka ee beddelka garoonka, waqti-fidinta, iyo tafatirka prosody iyada oo aan dib loo tababarin
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Source-Filter Vocoding and WORLD quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Kala soocida Isha Muusiga ee Demucs
Su'aalaha soo noqnoqda
Waa maxay Source-Filter Vocoding iyo WORLD?
Codkadeeyuhu waa qalab hadalka kala sooca dhismihiisa oo dib u dhisa. Moodeelka isha-shaandhaynta iyo cod-bixiyaha ADUUNKA waa habab qadiimi ah oo awood u leh qoraalka-hadalka iyo beddelka codka iyadoo la kala saarayo waxa xadhkaha codku sameeyo iyo waxa afkaagu qaabeeyo.
Qaabka isha-shaandhaynta hadalka, maxay 'shaandhaynta' u taagan tahay?
Shaandheeyaha waa dhawaaqa mareenka codka - qaabka cunaha, afka, iyo sanka ee midabeeya codka. Isha ayaa ah xadhkaha dhawaaqa ama qulqulka hawada ee buuqa badan.
Waa kuwee saddexda cabbir ee cod-bixiyaha ADUUNKA uu ka soo saaro hadalka?
ADUUNKU waxa uu hadalka u kala qaybiyaa soo noqnoqoshada aasaasiga ah (F0), baqshadda spectral (timbre/filter), iyo aperiodicity ( buuq ka soo horjeeda dheelitirka codka).
Waa maxay magaca Algorithm ee ADUUNKA ee lagu qiyaasi karo baqshadda spectral?
CheapTrick waxa uu qiyaasaa baqshad siman oo spectral ah oo ku adag khaladaadka yaryar ee qiyaasta garoonka.
Maxay faa'iido u leedahay ka soocidda gafka iyo baqshadda spectral?
Sababtoo ah garoonka (F0) iyo timbre (baqshad muuqaal ah) waa durdurro madax-bannaan, waxaad kor u qaadi kartaa ama hoos u dhigi kartaa codka adigoo ilaalinaya aqoonsiga hadalka.
Sidee ADUUNku u barbardhigaa codbixiyayaasha neural sida HiFi-GAN?
ADUUNKA waa cod-bixiye calaamad-barad: dheereeya, la tarjumi karo, iyo CPU-saaxiibtinimo. Codeeyayaasha neural sida caadiga ah waxay gaadhaan dabiici sare laakiin way ka culus yihiin.