Ubuyobozi bwa Audio AI

WaveGlow Flow-ishingiye kuri Vocoder

WaveGlow numuyoboro ushingiye kumajwi uva muri NVIDIA uhuza imiterere yimvugo ivuye muri mel-spectrogrammes mumurongo umwe nta kwikorera.

Incamake

WaveGlow numuyoboro ushingiye kumajwi uva muri NVIDIA uhuza imiterere yimvugo ivuye muri mel-spectrogrammes mumurongo umwe nta kwikorera. Nibyiza kuko itanga amajwi yo murwego rwohejuru byihuse kuruta igihe nyacyo ukoresheje igihombo cyoroshye gusa.

WaveGlow Flow-ishingiye kuri Vocoder yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

WaveGlow, yasohowe na Prenger, Valle, na Catanzaro muri NVIDIA muri 2018, ihuza ibitekerezo bya Glow na WaveNet kugirango yubake amajwi yihuta kandi yoroshye guhugura. Bitandukanye naba GAN bavuza amajwi, nibisanzwe bitemba: yiga gushushanya bidasubirwaho hagati yikwirakwizwa ryoroheje rya Gaussiya hamwe nijwi ryamajwi, byateganijwe kuri mel-spectrogram. Amahugurwa yerekana uburyo nyabwo bwo kumenya amakuru, bityo rero ntikeneye ivangura ryihariye, nta gusubira inyuma, ndetse no gutandukanya imiyoboro ibiri-mwarimu-umunyeshuri nkuko byavuzwe mbere na WaveNet ikenewe. Kugirango ubyare amajwi urigana urusaku rwa Gaussiya hanyuma ukore urusobe rudasubirwaho. WaveGlow itanga imvugo yubuziranenge igereranywa na WaveNet mugihe ikomatanya byihuse kuruta igihe nyacyo kuri GPU igezweho.

Ubushishozi

WaveGlow itondekanya intambwe zidashobora guhinduka, buriwese uhuza affine ihuza urwego hamwe na 1x1 idahinduka yatijwe muri Glow. Ingero zamajwi zishyizwe mubice binyuze mubikorwa byo gukanda kugirango guhuza ibice bishobora kubahindura neza. Kuberako buri ntambwe idashobora guhinduka, icyerekezo cyimbere kigereranya amahirwe yo gutozwa kandi ikarita yerekana ikarita yerekana urusaku kumajwi kugirango hafatwe umwanzuro. Umuyoboro umwe hamwe nintego imwe itari nziza-ituma imyitozo itajegajega kandi yoroshye.

Kumenya WaveGlow Flow-ishingiye kuri Vocoder

WaveGlow numuyoboro ushingiye kumajwi uva muri NVIDIA uhuza imiterere yimvugo ivuye muri mel-spectrogrammes mumurongo umwe nta kwikorera. Nibyiza kuko itanga amajwi yo murwego rwohejuru byihuse kuruta igihe nyacyo ukoresheje igihombo cyoroshye gusa. WaveGlow Flow-ishingiye kuri Vocoder yicaye mubikorwa byamajwi-AI bihindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata WaveGlow Flow-ishingiye kuri Vocoder nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha WaveGlow Flow-ishingiye kuri Vocoder ifata ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Kazoza ka WaveGlow Flow-ishingiye kuri Vocoder

WaveGlow yerekanye ko amajwi meza atemba ashobora guhangana nubwiza bwa autoregressive, bikagira ingaruka kumatwi nyuma no guhuza amajwi yerekana amajwi. Ubworoherane bwayo bumwe gusa buracyashimishije, nubwo abavuga GAN nka HiFi-GAN ubu batsinze mubunini n'umuvuduko. Urebye imbere, ibitekerezo-bitemba kandi bihuza ibitekerezo byongeye kugaruka muri TTS igezweho ikwirakwizwa na TTS, kandi imiterere ya WaveGlow-yuburyo budasubirwaho ikomeza kumenyesha ubushakashatsi kubyerekeranye-bishoboka, bigenzurwa, kandi bikora neza.

Gushyira mu bikorwa-Isi

Gufatanya na Tacotron 2 mumurongo wa NVIDIA wa TTS kugirango utange imvugo nziza ya studio

Kwihuta kwa GPU imvugo yo kuvuga, gushidikanya, hamwe nibikorwa byo gukora

Kubyara amahugurwa na demo amajwi mubushakashatsi aho amahugurwa ahamye, atakaza igihombo kimwe

Ijwi-ryukuri-rishobora gusohora amajwi muri sisitemu yimikorere ikorera kubikoresho bya NVIDIA

Uburyo bwo Gushyira mu bikorwa

WaveGlow Flow-ishingiye kuri Vocoder mubikorwa

Gufatanya na Tacotron 2 mumurongo wa NVIDIA wa TTS kugirango utange imvugo nziza ya studio.

Gufatanya na Tacotron 2 mumurongo wa NVIDIA umuyoboro wa TTS kugirango utange imvugo nziza ya sitidiyo isanzwe Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.

WaveGlow Flow-ishingiye kuri Vocoder mubikorwa

Kwihuta kwa GPU imvugo yo kuvuga, gushidikanya, hamwe nibikorwa byo gukora.

Kwihutisha imvugo ya GPU yo kuvuga, gushidikanya, hamwe no gukora ibikorwa byo gukora Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimanza, kandi agakurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

WaveGlow Flow-ishingiye kuri Vocoder mubikorwa

Kubyara amahugurwa na demo amajwi mubushakashatsi aho amahugurwa ahamye, atakaza igihombo kimwe.

Kubyara amahugurwa na demo amajwi mubushakashatsi aho amahugurwa ahamye, atakaza igihombo kimwe Amakipe akunze kubona umusaruro mwiza mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

WaveGlow Flow-ishingiye kuri Vocoder mubikorwa

Ijwi-ryukuri-rishobora gusohora amajwi muri sisitemu yimikorere ikorera kubikoresho bya NVIDIA.

Ijwi-rishobora-gusohora amajwi muri sisitemu yimikorere ikorera ku byuma bya NVIDIA Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi