HiFi-GAN iyo GAN Vocoders
HiFi-GAN waa cod-bixiye hal-abuur leh oo u beddela mel-spectrogram qaab mowjad maqal ah oo cayriin ah isla markiiba, soo saara hadal-tayada istuudiyaha oo aad uga dheereeya wakhtiga dhabta ah.
Dulmar
It became the standard final stage of modern text-to-speech because it is fast, lightweight, and hard to distinguish from real recordings.
quusid qoto dheer
Codkadeeyuhu waa tallaabada ugu dambeysa ee inta badan dhuumaha TTS: qaabka sida Tacotron ama FastSpeech wuxuu saadaaliyaa mel-spectrogram (sawirka is haysta ee soo noqnoqda waqti ka dib), cod-bixiyehu wuxuu buuxiyaa shaybaarada qaab-dhismeedka dhabta ah. Cod-bixiyeyaashii hore ee neerfaha sida WaveNet waxay u dhawaaqeen si weyn laakiin waxay soo saareen muunad maqal ah, taasoo ka dhigaysa inay si xanuun leh u gaabiyaan. HiFi-GAN, oo ay sii daayeen Kong, Kim, iyo Bae sanadka 2020, waxay ku bedeshay loop-ka autoregressive hal matoor-dhaliye u tababaran iska soo horjeeda. Xeeladdeeda ugu muhiimsan waa adeegsiga kala-sooc badan oo ku xukuma codka cabbirro kala duwan iyo qaabab kala duwan oo xilliyeed ah, taasoo ku qasbaysa koronto-dhaliye inuu helo tayada wanaagsan iyo muddada garoonka labadaba. Natiijadu waa 22 kHz hadalka oo lagu farsameeyay boqollaal jeer ka dhakhso badan wakhtiga dhabta ah ee GPU-ga, oo leh cod run- run ah oo tayo leh.
Aragtida Farsamada
Soo-saare HiFi-GAN waxa uu muunad-sameeyayaasha mel-spectrogram-ka ku soo kordhiyaa is-beddelo la beddelay, oo leh meelo la isku dhejiyey oo meel-marin-qaadasho badan leh oo isku dhafan cabbirro kala duwan oo kernel ah iyo kala-furan si ay u qabtaan qaababka hirarka kala duwan. Laba qoys oo takoorid ah ayaa sameeya booliiska: Takoorka Muddada Badan ayaa dib u qaabeeya calaamada 1D ee shabakadaha 2D ee ugu muhiimsan sida 2, 3, 5, 7, 11 si ay u qabtaan xilliyada garaafyada, iyo Takoor-Miisaan-Muti-Multi-Multi-Multi-Scale Discriminator-Multi-Scale Discriminator wuxuu ku eegayaa mawjada dhawr qaraar oo la soo koobay. Mel-spectrogram-ka iyo khasaaraha is-waafajinta ayaa tababarka ku sii xasiloon.
Saamaynta Istiraatijiyadeed
Helitaanka iyo gaarsiinta
Waxay wanaajisaa marin u helida iyada oo loo marayo qoraal-qorid, sheeko, iyo is-dhexgalyo cod.
Qiimaha iyo miisaaniyada
Kooxaha warbaahintu waxay ku soo rari karaan codka sifaysan si degdeg ah iyagoo wata miisaaniyado yaryar.
Xawaaraha iyo miisaanka
Nidaamyada u jeedda macmiisha waxay ka baaraandegi karaan isdhexgalka hadalka si weyn.
Mustaqbalka HiFi-GAN iyo GAN Vocoders
Codeeyayaasha GAN way sii yaraanayaan oo dhaqso badan yihiin: faraca sida BigVGAN waxay ku daraan firfircoonida lidka ku ah alliased si ay u guudeeyaan heesaha aan la arkin, aaladaha, iyo luqadaha, halka UnivNet iyo Vocos ay riixayaan dhanka caalamiga ah, isku dhafka kooxda oo dhan. Kala duwanaanshiyaha qalabka iyo qalabka hadda waxay ku shaqeeyaan codaynta taleefoonnada iyo dhegaha-dhegaha ee caawiyayaasha daahsoon. Si isa soo taraysa, fidinta iyo moodooyinka maqalka ah ee isu-dheelli-tiraya ayaa lagu shubay-gan-dhaliye-hal-baas, isku-darka aaminnimada faafinta iyo xawaaraha GAN. Filo codbixiyeyaashu inay u libdhi doonaan koodka maqalka neerfaha ee ujeeddada guud ee awoodda hadalka iyo muusigga labadaba.
Dhaqangelinta Adduunka-dhabta ah
Soo saarida wax soo saarka hadalka ee caawiyayaasha farsamada iyo abka hagidda ee u baahan jawaabo aan dib u dhac maqal ah lahayn.
Awoodaynta xidhidhiyaha codka wakhtiga-dhabta ah iyo qalabaynta halka mel-spectrogram-ka-cloned laga dhigay maqal dhawaaq-dabiici ah.
Wadista buug-maqalka iyo aaladaha ka sheekaynta podcast-ka ee soo saara saacadaha hadalka si degdeg ah oo raqiis ah.
U adeegaya sidii marxaladda mowjad-waveform-ka gudaha heesaha-codka-sameeyayaasha iyo bandhigyada muusiga iyada oo la adeegsanayo cod-bixiyayaasha caalamiga ah ee qaabka BigVGAN.
Khatarta & Dariiqyada Ilaalada
Si xun u isticmaalka codka iyo khataraha is-yeelyeelku way kordhaan marka oggolaanshaha la waayo.
Saxnimadu waxay hoos ugu dhici kartaa lahjadaha, lahjadaha, ama jawiga buuqa badan.
Maqalka synthetic waxaa lagu khaldi karaa hadal dhab ah iyada oo aan si cad loo calaamadin.
Qorshe Hawleedka Dhaqangelinta
Hel ogolaansho cad oo ku saabsan qabashada codka, xidhitaanka, iyo dib u isticmaalka
Tijaabi tayada ku hadasha kala duwan iyo xaaladaha asalka.
Qeex marka bani'aadamku ay tahay inuu dib u eego ama oggolaado wax soo saarka.
Ku calaamadee codka synthetic oo xafid diiwaannada la-xisaabtanka.
Sii wad Sahaminta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the HiFi-GAN and GAN Vocoders quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Hagaha xiga
Isbarbardhigga WaveGAN Vocoder
Su'aalaha soo noqnoqda
What is HiFi-GAN and GAN Vocoders?
HiFi-GAN waa cod-bixiye hal-abuur leh oo u beddela mel-spectrogram qaab mowjad maqal ah oo cayriin ah isla markiiba, soo saara hadal-tayada istuudiyaha oo aad uga dheereeya wakhtiga dhabta ah. Waxay noqotay heerka ugu dambeeya heerka ugu dambeeya ee qoraalka-hadalka casriga ah sababtoo ah waa dhakhso, fufud, oo ay adagtahay in laga sooco duubista dhabta ah.
Waa maxay shaqada aasaasiga ah ee cod-bixiyaha sida HiFi-GAN ee dhuumaha qoraalka-hadalka?
Codkadeeyuhu waa marxaladda ugu danbeysa ee soo saarta muunado qaab mawjad oo dhab ah oo laga soo qaaday mel-spectrogram oo uu soo saaray qaab acoustic ah.
Muxuu HiFi-GAN aad uga dheereeyaa cod-bixiyaha hore ee WaveNet?
WaveNet waxay soo saartay muunad maqal ah oo muunad ah (si toos ah), halka HiFi-GAN's soo-saare quudin-dhaliye uu ku soo saaro qaab-dhismeedka mawjada hal tallaal, isagoo ku gaadhay xawaare aad uga dheereeya-waqtiga-dhabta ah.
Muxuu HiFi-GAN si gaar ah u caawiyaa qabashada?
Takoorka Muddada-badan waxa uu qaab-dhismeedka 1D u qaabeeyaa 2D isagoo isticmaalaya xilliyo tiro-koob ah si loo ogaado qaab-dhismeedka xilliyeed ee ku xidhan garoon.
Cod-bixiyayaasha GAN waxa loo tababaray 'si liddi ku ah'. Maxay ka dhigan tahay halkan?
Habaynta GAN, koronto-dhaliyuhu waxa uu bartaa in uu soo saaro mowjadaha mawjadaha waaqiciga ah ee ku filan in lagu nacasyo shabakadaha takoorka ee loo tababaray in ay runta ka sheegaan maqalka synthetic.
Vocoder kee dambe ayaa ku fidiya HiFi-GAN si uu u guudiyo si ka wanaagsan codadka, heesaha, iyo qalabka aan la arkin?
BigVGAN waxay kor u qaadaysaa HiFi-GAN waxayna ku daraysaa hawlqabadyada xilliyeed ee lidka ku ah, hagaajinta guud ahaan maqalka qaybinta ka baxsan sida heesaha iyo qalabka.