Ubuyobozi bwa Audio AI

MelGAN Vocoder

MelGAN nijwi ryuzuye rya GAN rishingiye kumajwi rihindura mel-spectrogramu muburyo bwamajwi mbisi mumajwi imwe yihuta.

Incamake

MelGAN nijwi ryuzuye rya GAN rishingiye kumajwi rihindura mel-spectrogramu muburyo bwamajwi mbisi mumajwi imwe yihuta. Byari bifite akamaro kuko byagaragaye ko bifite ireme ryiza, bitavugwaho rumwe imvugo ishobora gukora inshuro magana byihuse kuruta igihe nyacyo kuri GPU.

MelGAN Generative Vocoder yicaye mumajwi-AI ikora ihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

MelGAN, yatangijwe na Kumar n'abandi. muri 2019, itanga amajwi nta gahoro gahoro-by-sample ikoreshwa na WaveNet. Imashini itanga amashanyarazi ni ihuriro ryimyanya ndangagitsina yerekana urugero rwa mel-spectrogramu (mubisanzwe imirongo 80 yumurongo) kugeza ku gipimo cyerekana amajwi, hamwe nibisigara bisigaye bifashisha imyanzuro yagutse kugirango bagure umurima wakira. Agashya k'ingenzi kwari uguhugura hamwe n'ivangura ryinshi rikorera ku munzani utandukanye w'amajwi (umwimerere wambere wongeyeho verisiyo yamanutse), buri wese akareba Windows yuzuye. Igihombo gihuye nikigereranyo kigereranya ibikorwa bivangura hagati yijwi ryukuri nimpimbano, bigahindura imyitozo ya GAN. Icyitegererezo ni gito kubijyanye na neural-majwi kandi ikora byihuse kuruta igihe nyacyo ndetse no kuri CPU, bigatuma iba ingirakamaro kubishyizwemo no ku gikoresho inyandiko-ku-mvugo.

Ubushishozi

MelGAN ivangura ryinshi ikoresha imiyoboro itatu isa ireba amajwi yuzuye, igice, na kimwe cya kane, buri cyiciro cyo gufata kumurongo utandukanye. Icy'ingenzi, MelGAN yishingikiriza ku gihombo gihuye (intera ya L1 hagati yikarita yerekana ivangura ryerekana amajwi nyayo yakozwe n’amajwi) aho kuba igihombo cyerekana kwiyubaka, gishishikariza generator guhuza imibare nyayo y’amajwi.

Kumenya MelGAN Vocoder Yibyara

MelGAN nijwi ryuzuye rya GAN rishingiye kumajwi rihindura mel-spectrogramu muburyo bwamajwi mbisi mumajwi imwe yihuta. Byari bifite akamaro kuko byagaragaye ko bifite ireme ryiza, bitavugwaho rumwe imvugo ishobora gukora inshuro magana byihuse kuruta igihe nyacyo kuri GPU. MelGAN Generative Vocoder yicaye mumajwi-AI ikora ihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata MelGAN Generative Vocoder nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha MelGAN Generative Vocoder ifata ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza ha MelGAN Vocoder

MelGAN yabibye umuryango wabatoye GAN. Abasimbuye, HiFi-GAN na UnivNet, bakomeje uburyo bwihuse butari ubwikorezi ariko bongeraho ivangura ryibihe byinshi kandi bikemura byinshi kugirango bisukure cyane. Ubwubatsi butuye ku bikoresho no gutambutsa TTS aho ubukererwe nubunini bwikitegererezo bifite akamaro, kandi ibitekerezo byayo bivangura bikomeje kugira ingaruka kuri codec ya neural na sisitemu yo kubyara imiziki aho imyitozo yo guhangana iteza imbere ireme ryimyumvire.

Gushyira mu bikorwa Isi

Ku gikoresho cyanditse-ku-mvugo mu bafasha ba mobile aho ijwi rito, ryihuta ryirinda ingendo zuzenguruka

Ijwi-nyaryo ryo guhindura imiyoboro ihindura imvugo ya mel-spectrogramu mumajwi yagenewe

Imikino na animasiyo ibikoresho bihuza ibiganiro byimiterere biva kuri spekrogramu yakozwe hamwe nubukererwe buke

Ibyingenzi byubushakashatsi kumajwi GAN, aho MelGAN yibiranga-bihomba byongeye gukoreshwa mumuziki no kubyara amajwi

Uburyo bwo Gushyira mu bikorwa

MelGAN Vocoder Yibyara mubikorwa

Ku gikoresho cyanditse-ku-mvugo mu bafasha ba mobile aho ijwi rito, ryihuta ryirinda ingendo zuzenguruka.

Ku gikoresho cyanditse-ku-mvugo mu bafasha bagendanwa aho ijwi rito, ryihuta ryirinda ingendo zuzenguruka Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamuka kwabantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

MelGAN Vocoder Yibyara mubikorwa

Ijwi-nyaryo ryo guhindura imiyoboro ihindura imvugo ya mel-spectrogramu mumajwi yagenewe.

Imiyoboro nyayo ihinduranya amajwi ihindura mel-spectrogramu yumuvugizi mumajwi yagenewe Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

MelGAN Vocoder Yibyara mubikorwa

Imikino na animasiyo ibikoresho bihuza ibiganiro byimiterere biva kuri spekrogramu yakozwe hamwe nubukererwe buke.

Ibikoresho byimikino na animasiyo bihuza ibiganiro byimiterere bivuye kuri spekrogramu yakozwe hamwe nubukererwe buke Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

MelGAN Vocoder Yibyara mubikorwa

Ibyingenzi byubushakashatsi kumajwi GAN, aho MelGAN yibiranga-bihomba byongeye gukoreshwa mumuziki no kubyara amajwi.

Ibyingenzi byubushakashatsi kuri GAN ya majwi, aho igihombo cya MelGAN gihuye nacyo cyongeye gukoreshwa mumuziki hamwe nijwi ryerekana amajwi Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi