Audio AI JAGORA

WaveNet

WaveNet, wanda DeepMind ya gabatar a cikin 2016, wata hanyar sadarwa ce ta ci gaba wacce ke haifar da ingantaccen sautin samfuri ɗaya a lokaci guda, yana samar da magana mai ban sha'awa da kiɗa.

Dubawa

WaveNet, wanda DeepMind ya gabatar a cikin 2016, wata hanyar sadarwa ce ta ci gaba wacce ke haifar da ingantaccen sautin samfuri ɗaya a lokaci guda, yana samar da magana mai ban sha'awa da kiɗa. Ya kafa ma'auni na zamani don ingantaccen rubutu-zuwa-magana.

WaveNet yana zaune a cikin ayyukan audio-AI wanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai.

Zurfafa nutsewa

WaveNet sigar ƙirar ƙira ce ta autoregressive: tana tsinkaya kowane samfurin sauti da aka sharadi akan duk samfuran da ke gabansa, yawanci a samfuran 16,000 ko 24,000 a sakan daya. Babban bidi'a ita ce tari na rikice-rikice masu lalacewa. Causal yana nufin samfurin kawai yana kallon baya a cikin lokaci, yana kiyaye tsarin tsara; dilation yana nufin kowane Layer ya tsallake adadin samfurori masu girma da yawa, don haka matsakaicin tari ya rufe dubban samfurori (filin karɓa mai faɗi) ba tare da tsada mai yawa ba. An daidaita shi akan fasalulluka na harshe ko mel-spectrogram, WaveNet yana samar da magana mafi dabi'a fiye da madaidaitan vocoders waɗanda suka gabace shi, yana rufe yawancin gibin ga rikodin ɗan adam da kuma ƙarfafa sigar farko na Google Mataimakin.

Fahimtar Fasaha

Dillated convolutions su ne mabuɗin dabara: tare da ƙimar dilation na 1, 2, 4, 8, da sauransu, hanyar sadarwa kawai dubun-dubatar zurfi za ta iya halartar dubban samfuran da suka gabata, suna ɗaukar cikakkun cikakkun bayanai na igiyar ruwa da tsayin daka. Samfuran samfuran kowane ƙima na samfurin azaman rarrabuwar kayyade (asali matakan 256 ta hanyar mu-law companding), da raka'o'in kunnawa gated tare da ragowar haɗin kai da tsallake-tsallake suna tabbatar da horon wannan tulin mai zurfi.

Jagorar WaveNet

WaveNet, wanda DeepMind ya gabatar a cikin 2016, wata hanyar sadarwa ce ta ci gaba wacce ke haifar da ingantaccen sautin samfuri ɗaya a lokaci guda, yana samar da magana mai ban sha'awa da kiɗa. Ya kafa ma'auni na zamani don ingantaccen rubutu-zuwa-magana. WaveNet yana zaune a cikin ayyukan audio-AI wanda ke canza magana, kiɗa, da sauti don sadarwa, samun dama, da samar da kafofin watsa labarai. Don gina fahimta mai zurfi, bi da WaveNet a matsayin samfurin aiki, ba fasali ɗaya ba: ayyana sakamakon da ake so, bayyana zato, da raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.

A aikace, ƙungiyoyi masu ƙarfi da ke amfani da WaveNet suna kula da inganci, jinkiri, da yarda a matsayin daidaitattun sassa na dabarun turawa. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A lokaci guda, rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.

Dabarun Tasiri

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya.

Yana inganta samun dama ta hanyar rubutu, ba da labari, da mu'amalar murya. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi.

Ƙungiyoyin kafofin watsa labaru na iya jigilar sauti mai gogewa cikin sauri tare da ƙaramin kasafin kuɗi. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni.

Tsarin fuskantar abokin ciniki na iya aiwatar da hulɗar magana a mafi girman ma'auni. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.

Makomar WaveNet

Asalin WaveNet ya kasance yana jinkirin saboda samfurin yana kan layi. Masu nasara sun gyara wannan: Parallel WaveNet da WaveRNN sun ba da damar haɗin kai na lokaci-lokaci, kuma daga baya kwarara- da masu muryoyin tushen GAN kamar WaveGlow da HiFi-GAN, da masu watsa vocoders, haɓaka inganci da sauri gaba. WaveNet's autoregressive ra'ayoyin ra'ayoyin juyin juya hali suna rayuwa a cikin waɗannan tsarin kuma sun yi tasiri ga gine-gine fiye da sauti, suna tabbatar da gadonsa a cikin ƙirar ƙira.

Aiwatar da Gaskiyar Duniya

Samar da sautunan sauti na dabi'a don Google Mataimakin da Google Rubutu-zuwa-Magana ta gajimare

Yin aiki azaman vocoder na jijiyoyi wanda ke juya mel-spectrograms zuwa nau'ikan raƙuman ruwa a cikin bututun TTS kamar Tacotron 2

Haɓaka ainihin piano da kiɗan kayan aiki daga ɗanyen sauti

Haɗin murya don kayan aikin samun dama da ba da labari mai jiwuwa

Hanyoyin Aiwatarwa

WaveNet a aikace

Samar da sautunan sauti na halitta don Google Mataimaki da Google Rubutu-zuwa-Magana ga gajimare.

Ƙirƙirar muryoyin sauti na halitta don Google Mataimaki da Google Ƙungiyoyin Rubutu-zuwa-Magana na gajimare yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin abubuwan samarwa da ƙimar kuskure akan lokaci.

WaveNet a aikace

Yin aiki azaman vocoder neural wanda ke juya mel-spectrograms zuwa nau'ikan raƙuman ruwa a cikin bututun TTS kamar Tacotron 2.

Yin aiki a matsayin vocoder na jijiyar jiki wanda ke juya mel-spectrograms zuwa nau'ikan raƙuman ruwa a cikin bututun TTS kamar Tacotron 2 Teams yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin abubuwan samarwa da ƙimar kuskure akan lokaci.

WaveNet a aikace

Haɓaka ainihin piano da kiɗan kayan aiki daga ɗanyen sauti.

Haɓaka ingantacciyar piano da kiɗan kayan aiki daga ƙwararrun masu sauti yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓaka ɗan adam don ƙararraki, da bin duk nasarorin samarwa da farashi na kuskure akan lokaci.

WaveNet a aikace

Haɗin murya don kayan aikin samun dama da ba da labari mai jiwuwa.

Haɗin murya don kayan aikin samun dama da ba da labari na littattafan mai jiwuwa Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙima masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin duk nasarorin samarwa da farashi na kuskure akan lokaci.

Hatsari & Tsare-tsare

!

Rashin amfani da murya da haɗarin kwaikwaya yana ƙaruwa lokacin da aka rasa izini.

!

Daidaituwa na iya faɗuwa cikin lafuzza, yaruka, ko mahalli masu hayaniya.

!

Ana iya kuskuren sauti na roba don ingantacciyar magana ba tare da bayyananniyar lakabi ba.

Taswirar Hanya

1

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani.

Sami tabbataccen izini don ɗaukar murya, cloning, da sake amfani. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

2

Gwajin ingantattun masu magana daban-daban da yanayin baya.

Gwajin ingantattun masu magana daban-daban da yanayin baya. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

3

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar.

Ƙayyade lokacin da dole ne ɗan adam ya duba ko ya amince da abubuwan da aka fitar. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

4

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi.

Yi lakabin sauti na roba da kuma adana bayanan da aka tabbatar don yin lissafi. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.

Ci gaba da Bincike