Vokoder UnivNet bu am dayo yu bari
UnivNet vocoder GAN la buy àtte audio yiñ defar ci spectrogram yu bari yuñ xayma ci dayo STFT yu wuute, di gëna ñaw ay detay yu fréquence yu kawe.
Résumé
It aims to be a universal vocoder that generalizes well to unseen speakers and recording conditions.
Plongeur bu xóot
UnivNet, Jang ak ñeneen ñi ñoo ko xalaat. ci 2021, dafay xeex benn ñakk kattan bu bari ci vocoders GAN: fréquence yu kawe yu muffle wala yu fees dell ak ay mbiri art. Generatëram mingi aju ci spectrogram mel yu mat ba noppi di jëfandikoo ay convolution yu mën soppiku ci barab (LVC), fu ñuy seetlu kernel yu convolution yi ci saasi ci man-mani dugal yi suko defee filtre bi mëna ànd ak ëmbiit li ci gox bi. Xalaat bi gëna am solo mooy spectrogram biy tànnal dayo yu bari (MRSD): ludul àtte forme onde bu ñor bi kese, UnivNet dafay xayma STFT yu bari yu am palanteer yu wuute ak dayo hop yu wuute, ba noppi di doxal diskriminatër yi ci magnitude spectrogram yooyu. Loolu dafay puus generatër bi mu am detay spectral yu rafet ak structure temporel bu yaatu. UnivNet dafa tàggat ci kàddukat yu bari, mu defar kàddu yu neex ngir kàddu yu mu musul gis ci jamonoy tàggat, moo tax ñu jox ko etiketu universel.
Gis-gis xarala
Convolution variable barab bu UnivNet dafay defar kernel bi ci anam wu dinaamik ci man-mani mel yi jaaraleko ci reso kernel-predictor bu ndaw, kon jéego bu nekk dafay jëfandikoo filtre buy méngoo ak ëmbiit li moo gën kernel buñ bokk. Buñu ko boole ak spectrogram bi am resolusioŋ yu bari, biy dajale ay kompromis yu bari ci jamono-fréquence ci benn yoon, loolu dafay jëm ci bande fréquence bu kawe bi vocoder GAN yu gëna yomba bëgg di blur wala di hum.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu Vocoder UnivNet bu bari dayo
Xeetu spectrogram bu bari dayo bu UnivNet nekkaatna luñuy jëfandikoo ci stack TTS yu bees yi ak sistem yu am doole yu melni BigVGAN ak codec audio neural. Xaarandil kaadar universel bi, waxkat-agnostik ngir wéy di yaatu ci baat buy way, synthese làkk yu bari, ak audio bandwidth bu mat 48 kHz, ci noonu la xalaatu kernel biy méngoo di yëgle model yu am doole ci aparey yi wara jëfandikoo kàddu yu bari te kenn du waxkat bu nekk.
Doxal ci àdduna dëgg
sarwis TTS yu bari-oparlër yu wara sone ci baat yi nekkul ci done tàggat
Tuyo klonaasu baat fu benn vocoder universel di liggéey ci kàddukat yu bari
Audiobook bu dëggu ak nettali podcast soxla sibilance bu dëgër ak fréquence yu kawe
Vocoder backend ngir sistem TTS yu yam ba ci njeexte yuy boole ab waxkatu spectrogram ak ab defarkatu onde bu dëgër
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the UnivNet Multi-Resolution Vocoder quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Vokoder neuronal
Laaj yi ñuy faral di laaj
What is UnivNet Multi-Resolution Vocoder?
UnivNet vocoder GAN la buy àtte audio yiñ defar ci spectrogram yu bari yuñ xayma ci dayo STFT yu wuute, di gëna ñaw ay detay yu fréquence yu kawe. Li muy fexe mooy nekk vocoder universel buy generalise bu baax ci kàddukat yiñ gisul ak anam yi ñuy enregistre.
Lan mooy màndarga siif bu UnivNet?
Diskriminatëru spectrogram bu bari dayo bu UnivNet dafay jàngat STFT yu bari yu am palanteer yu wuute ak dayo hop ngir jàpp njaay yu wuute ci waxtu-fréquence.
Ban jafe-jafe ci vocoders GAN yu njëkk ya la UnivNet doon wut?
Su UnivNet di tànnee spectrogram yu bari, dafay gëna yombal leeralu fréquence yu kawe yi vocoder GAN yu yomb yi di faral di nëbb.
Lan moy konvolusioŋ yiy soppiku ci barab (LVC) ci UnivNet?
LVC dafay jëfandikoo ab reso buy wax luy waaja am ci kernel, suko defee barab bu nekk di jëfandikoo ay filtre yuy méngoo ak ëmbiit li, yu bawoo ci mel-spectrogram biy kondisione.
Lu tax ñuy wax UnivNet ni vocoder bu ñépp bokk?
UnivNet dafa tàggat ci waxkat yu bari, dafay boole kàddu yu baax ba ci kàddu yu mu musul dajeel ci tàggat, moo tax universel.
naka la ko spectrogram bi am dayo yu bari di jàppale generatër bi?
Xeeti dayo STFT yi dañuy fësal diggante yu wuute ci diggante waxtu ak frequence, kon boole leen ñépp dafay puus generatër bi ci detay ak structure bu jaar yoon.