UnivNet Codka Xallinta Badan
UnivNet waa cod-bixiyaha GAN kaas oo xukuma soo saaray maqalka iyadoo la adeegsanayo spectrograms badan oo lagu xisaabiyay qaraaro kala duwan oo STFT ah, fiiqaya faahfaahinta soo noqnoqoshada sare.
Dulmar
It aims to be a universal vocoder that generalizes well to unseen speakers and recording conditions.
quusid qoto dheer
UnivNet, waxaa soo jeediyay Jang et al. sanadka 2021, waxa ay wax ka qabanaysaa daciifnimada ay wadaagaan cod-bixiyayaasha GAN: af-xidhan ama wax-soo-saar badan Xaaladeeda koronto-dhaliyaha ee mel-spectrograms-buuxa waxayna isticmaashaa goob-isbedeli kara convolutions (LVC), halkaas oo kernels convolution lagu saadaaliyo duulista sifada gelinta si filtarku ula qabsado waxa ku jira gudaha. Fikradda ciwaanka ahi waa kala-takoorka spectrogram-ka badan (MRSD): Halkii ay ka xukumi lahayd kaliya waveform-ka cayriin, UnivNet waxay xisaabisaa dhawr STFT oo leh daaqado iyo cabbirro kala duwan waxayna ku shaqaysaa takoorayaal cabbirradaas. Tani waxay ku riixaysaa koronto-dhaliye si uu u helo tafaasiisha muuqaal qurxoon iyo qaab-dhismeedka ku meel gaarka ah labadaba. Waxaa lagu tababaray ku hadla badan, UnivNet waxay soo saartaa hadal dabiici ah oo loogu talagalay codadka aysan waligood arkin inta lagu jiro tababarka, iyada oo kasbanaysa calaamadeeda caalamiga ah.
Aragtida Farsamada
UnivNet goobteeda isbedbedelka badan ee isku dhafka ah waxay ka soo saartaa miisaankeeda kernel si firfircoon uga soo dhalaalaysa sifooyinka mel iyada oo loo sii marayo shabakad saadaasha kernel-yar, markaa mar kasta tillaabo kasta waxay si wax ku ool ah u isticmaashaa shaandheynta la qabsiga maadada halkii ay ka ahaan lahayd kernel go'an. Marka lagu daro kala-takoorka kala-soocida kala-duwan ee xallinta kala-duwanaanshaha, kaas oo ka kooban dhowr is-dhaafsi-wakhti-soo noqnoqda isku mar, tani waxay si toos ah u beegsanaysaa kooxda-soo noqnoqoshada sare halkaas oo vocoders GAN-ga fudud ay u muuqdaan inay blurayaan ama humayaan.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka UnivNet Codka Xallinta Badan
UnivNet's multi-xalinta spectrogram takoorku waxa uu noqday shay caadi ah xidhmooyin TTS casriga ah iyo hababka saameeya sida BigVGAN iyo codecs maqal neural. Filo qaabaynta caalamiga ah, ku hadla-agnostic si ay u sii ballaariso xagga heesaha codka, isku-dhafka luuqadaha badan, iyo maqal-bandwidth-buuxa ah 48 kHz, halka fikradda la-qabsiga-kernel-ka ay ku wargelinayso moodooyinka qalabka wax-ku-ool ah ee ay tahay inay qabtaan codad kala duwan iyada oo aan la hagaajin-hagaajin-dhammaan-dhaqaale kasta.
Dhaqangelinta Adduunka-dhabta ah
Adeegyada TTS-ku-hadlayaasha badan oo ay tahay inay u muuqdaan kuwo dabiici ah codadka aan ku jirin xogta tababarka
Dhuumaha codka isku xidhka halkaas oo hal codad caalami ah uu u adeego ku hadla bartilmaameedyo badan
Buug maqal ah oo daacad ah oo sarreeya iyo sheeko podcast ah oo u baahan sibilance qallafsan iyo soo noqnoqoshada sare
Codka dhabarka dambe ee nidaamka TTS-dhamaadka-ilaa-dhamaadka kaas oo isku xidha saadaasha spectrogram-ka leh koronto-dhaliye qaab-dhismeed adag
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the UnivNet Multi-Resolution Vocoder quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Cod-bixiyayaasha Neural
Su'aalaha soo noqnoqda
What is UnivNet Multi-Resolution Vocoder?
UnivNet waa cod-bixiyaha GAN kaas oo xukuma soo saaray maqalka iyadoo la adeegsanayo spectrograms badan oo lagu xisaabiyay qaraaro kala duwan oo STFT ah, fiiqaya faahfaahinta soo noqnoqoshada sare. Waxa ay higsaneysaa in ay noqoto codeeye caalami ah oo si fiican u soo kooba ku hadla aan la arkin iyo xaaladaha duubista.
Waa maxay astaanta saxeexa ee takoorka UnivNet?
UnivNet's multi-resolution spectrogram discriminator wuxuu falanqeeyaa dhowr STFT oo leh daaqado iyo cabbiro kala duwan si ay u qabtaan ganacsiyo kala duwan oo waqti-soo noqnoqda ah.
Waa maxay dhibatada hore ee GAN vocoders ay UnivNet si gaar ah u bartilmaameedsato?
Iyada oo lagu takoorayo xallinta spectrogram-ka badan, UnivNet waxay hagaajinaysaa tafaasiisha soo noqnoqoshada sare ee codbixiyayaasha GAN ee fudud ay inta badan dhalaalayaan.
Waa maxay is-bedbeddelka goobta-beddelka (LVC) ee UnivNet?
LVC waxay isticmaashaa shabakad saadaasha kernel-ka si ay goob kastaa u khusayso shaandhada la qabsiga nuxurka ee ka soo jeeda qaboojiyaha mel-spectrogram.
Waa maxay sababta UnivNet loogu tilmaamay cod-bixiye caalami ah?
Lagu tababbaray ku hadla badan, UnivNet waxay soo saartaa hadalka dabiiciga ah xitaa codadka aysan waligood la kulmin tababarka, markaa mid caalami ah.
Sidee buu u caawinayaa koronto-dhaliyaha?
Xallinta kala duwan ee STFT waxay xoogga saaraysaa is-dhaafsiga-waqtiga-soo noqnoqda ee kala duwan, sidaa darteed is-waafajinta dhammaantood waxay ku riixaysaa koronto-dhaliyaha xagga faahfaahinta saxda ah iyo qaab-dhismeedka.