Ubuyobozi bwa Audio AI
HiFi-GAN na GAN Vocoders
HiFi-GAN nijwi ryibyara-rirwanya amajwi ahindura mel-spectrogramu mumajwi mbisi yamajwi hafi ako kanya, itanga imvugo-nziza ya studio yihuta cyane kuruta igihe nyacyo.
Umva iki gitaboAI-byavuzwe · ~2 min
Kuriyi page2 min soma
Incamake
It became the standard final stage of modern text-to-speech because it is fast, lightweight, and hard to distinguish from real recordings.
Kwibira cyane
Ijwi ni intambwe yanyuma mu miyoboro myinshi ya TTS: icyitegererezo nka Tacotron cyangwa FastSpeech gihanura mel-spectrogramu (ishusho yerekana inshuro nyinshi mugihe), kandi amajwi yuzuza ibyitegererezo nyirizina. Indangururamajwi zambere nka WaveNet yumvikanye neza ariko itanga amajwi sample-by-sample, bigatuma itinda kubabaza. HiFi-GAN, yasohowe na Kong, Kim, na Bae mu 2020, yasimbuye uwo muzingi wa autoregressive hamwe na generator imwe yo kugaburira imbere yatojwe nabi. Amayeri yingenzi ni ugukoresha ivangura ryinshi risuzuma amajwi ku munzani itandukanye no mu bihe bitandukanye, bigatuma generator ibona imiterere myiza hamwe nigihe cyikibanza neza. Igisubizo ni 22 kHz imvugo yashizwemo inshuro magana byihuse kuruta igihe nyacyo kuri GPU, hamwe nubwiza bwo guhangana nubutaka-ukuri amajwi.
Gushyira mu bikorwa Isi
Kubyara umusaruro uvugwa wabafasha basanzwe hamwe na porogaramu zo kugendana zikeneye ibisubizo nta gutinda kumvikana.
Guha imbaraga amajwi nyayo yo gukoroniza hamwe nibikoresho bya dubbing aho mel-spekrogramu ya clon ikozwe mumajwi asanzwe yumvikana.
Gutwara amajwi ya audiobook na podcast yo kuvuga inkuru ihuza amasaha yo kuvuga vuba kandi bihendutse.
Gukora nkicyerekezo cyimbere imbere yo kuririmba-amajwi synthesizers hamwe na demo yumuziki ukoresheje BigVGAN-yuburyo bwa majwi rusange.
Kazoza ka HiFi-GAN na Vocoders ya GAN
Abavuza amajwi ba GAN bakomeje kuba bato kandi byihuse: ababakomokaho nka BigVGAN bongeraho ibikorwa birwanya anti-aliased kugirango bahuze muri rusange abaririmbyi, ibikoresho, n'indimi zitagaragara, naho UnivNet na Vocos biganisha kuri synthesis rusange, yose. Streaming na on-device variants ubu ikoresha amajwi imbere muri terefone no gutwi kubufasha buke bwihuse. Kwiyongera, gukwirakwiza amajwi no guhuza amajwi yerekana amajwi arimo gutondekwa muburyo bwa GAN-imwe ya generator imwe, bivanga ubudahemuka bwa diffusion hamwe numuvuduko wa GAN. Tegereza abavuga amajwi bazimangana muri rusange-intego ya neural amajwi ya codecs ikoresha imvugo numuziki.
Kubishyira mubikorwa
Impamvu ari ngombwa
- Kugera no kugera. Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
- Igiciro na bije. Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
- Umuvuduko n'igipimo. Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.
Witondere
- Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
- Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
- Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.
Intambwe ikurikira
- Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
- Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
- Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
- Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.
Komeza Ubushakashatsi
Ibaruwa y'amakuru y'ubuntu
Ibuka amakuru ya buri munsi ya AI
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Take the HiFi-GAN and GAN Vocoders quiz
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Ibibazo bikunze kubazwa
What is HiFi-GAN and GAN Vocoders?
HiFi-GAN nijwi ryibyara-rirwanya amajwi ahindura mel-spectrogramu mumajwi mbisi yamajwi hafi ako kanya, itanga imvugo-nziza ya studio yihuta cyane kuruta igihe nyacyo. Byahindutse icyiciro cya nyuma cyimyandikire igezweho-ku-mvugo kuko yihuta, yoroheje, kandi biragoye gutandukanya ibyanditswe byafashwe.
Nuwuhe murimo wibanze wijwi nka HiFi-GAN mumurongo winyandiko-mvugo?
Ijwi ni intambwe yanyuma ihuza ingero zifatika zifatika kuva mel-spectrogramu yakozwe na moderi ya acoustic.
Kuki HiFi-GAN yihuta cyane kurenza amajwi ya WaveNet?
WaveNet yabyaye amajwi icyitegererezo-by-icyitegererezo (autoregressively), mugihe HiFi-GAN itanga ibyokurya bitanga imbaraga imbere yumurongo umwe, ikagera kumuvuduko mwinshi-kuruta-igihe-nyacyo.
Niki HiFi-GAN's Multi-Period Discriminator ifasha cyane gufata?
Ivangura rya Multi-Period ivugurura imiterere ya 1D ihinduka 2D ikoresheje ibihe-byibanze kugirango umenye imiterere yigihe ihujwe nikibuga.
GAN abavuga amajwi bahuguwe 'muburyo butandukanye.' Ibyo bivuze iki hano?
Muburyo bwa GAN, generator yiga kubyara imiyoboro ifatika ihagije kugirango ibeshye imiyoboro ivangura yatojwe kuvuga nyayo uhereye kumajwi yubukorikori.
Ninde wacuranga nyuma wagura HiFi-GAN kugirango rusange muri rusange amajwi atagaragara, kuririmba, nibikoresho?
BigVGAN yapimye HiFi-GAN kandi yongeraho ibikorwa byo kurwanya anti-aliase buri gihe, itezimbere rusange mumajwi adakwirakwizwa nko kuririmba nibikoresho.
Komeza wige
Kuyobora
Abandi bayobozi batoranijwe kuriyi ngingo