WaveNet
WaveNet, bi DeepMind dugal ci 2016, reso neuronal la woon buy defar ay audio yu ñor benn-benn, di defar kàddu ak music yu yéeme.
Résumé
It set the modern standard for high-fidelity text-to-speech.
Plongeur bu xóot
WaveNet xeetu generatif autoregressif la: dafay wax luy waaja am ci misaalu audio bu nekk ci misaal yi ko jiitu, lu gëna bari ci 16,000 wala 24,000 misaal ci segond bu nekk. Li gëna am solo ci liggéeyam mooy ñu boole ay convolution causal yu yaatu. Causal dafay tekki ni model bi dafay xoolaat ci ginaaw ci jamono, di baña yàq doxalinu jamono; dilation dafay tekki ni couche bu nekk dafay romb limu échantillons yuy gëna yokk, kon benn stack bu ndaw dafay muur ay junni échantillons (muy barab bu yaatu buy jot) te du am xaalis bu bari. WaveNet dafa aju ci màndarga làkk yi wala spectrogram mel, muy defar kàddu yu gëna natural yeneen vocoder concatenatif ak parametrik yi ko jiitu, mu tëj lu bari ci enregistremaa yu nit ñi, ba noppi dooleel xeetu Google Assistant yu njëkk ya.
Gis-gis xarala
Convolution yu yaatu ñooy gëna am solo: ak dilatation yu 1, 2, 4, 8, ak ñoom seen, reso bu am fukki-fukki diisaay yu xóot kese ñoo mëna toppatoo ay junni-junni misaal yu njëkk, di jàpp detaay yu baax ak structure prosodique bu gëna gudd. Modèlu génne yi dañuy wane valeur bu nekk ci misaal bi ni distribution categorique (ci ndoorte li 256 niveau jaaraleko ci mu-law companding), ak yunit yiy aktive yuñ tëj boole ci residual ak skip connexions ngir dakkal tàggat bi ci stack bu xóot bi.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu WaveNet
WaveNet bi njëkk defa yeex ndax sampling bi dafay toppalante. Ñi ci topp dañu defar lii: WaveNet parallel ak WaverRNN ñoo may synthese ci jamono dëgg, ginaaw ga vocodeur yu lalu ci flow ak GAN yu melni WaveGlow ak HiFi-GAN, boole ci vocodeur diffusion, dañu gëna yokk kalite ak gaawaay. Xalaatal WaveNet yiy dellu ginaaw, dilated-convolution ñu ngi dundu ci sistem yooyu te dañu am njeexital ci architecture yu weesu audio yi, di gëna dëgëral legatam ci modeling generatif.
Doxal ci àdduna dëgg
Defar ay baat yuy sone bu baax ngir assistant ak Cloud Text-ci-Speech
Dafay nekk vocodeur neuronal buy soppi spectrogram mel yi ci forme vague ci gasoduc TTS yu melni Tacotron 2
Dajale piano ak music instrumental yu dëggu ci audio bu ñor
Synthese baat ngir jumtukaayi yombal jëfandikoo gi ak nettali audiobook
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the WaveNet quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Gis Deepfake Audio
Laaj yi ñuy faral di laaj
What is WaveNet?
WaveNet, bi DeepMind dugal ci 2016, reso neuronal la woon buy defar ay audio yu ñor benn-benn, di defar kàddu ak music yu yéeme. Dafa taxawal standard bu bees bi ci wàllu fidélité bu kawe ci bind ci kàddu.
naka la WaveNet di defaree audio?
WaveNet autoregressif la: dafay wax luy waaja am ci misaalu audio bu nekk ci misaal yi ko jiitu.
Lan mooy jéego yu am solo yi ci WaveNet?
Dilated causal convolutions may reso bi mu mëna muur ay junni misaal yu weesu ci anam wu jaar yoon, di xoolaat ci ginaaw ci jamono.
Lu tax yaatuwaayu jàppale WaveNet?
Yokkateg dilatation exponentiel bi dafay joxe barab bu yaatu buy jot ci ay junni misaal yu am ay couche yu néew.
Lan moo nekkoon njariñ li gëna mag ci WaveNet bi njëkk?
Ndax misaal bu nekk mingi aju ci yi ko jiitu, defar bi dafa toppalante, moo tax mu yeex, loolu moo waral Parallel WaveNet ak yeneen ñi ci topp.
Ci pipeline bind-ci-kaddu, WaveNet dafay faral di nekk lan?
WaveNet mën na jël spektrogram mel (lu melni, ci Tacotron 2) ba noppi defar jëmmu onde bu mujj biy sonal.