Ubuyobozi bwa Audio AI

Vocoder ya DiffWave

DiffWave ni ikwirakwizwa rishingiye ku majwi asanisha amajwi mu buryo bwitondewe yerekana urusaku rudasanzwe mu muhengeri, rushingiye kuri mel-spectrogram.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza ka DiffWave Diffusion Vocoder
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

Byazanye moderi yo gukwirakwiza imvugo-yo kwizerwa cyane, guhangana na GAN na WaveNet nta mahugurwa yo guhangana.

Kwibira cyane

DiffWave, yatangijwe na Kong n'abandi. muri 2020, ikoresha icyerekezo cyerekana ikwirakwizwa ryicyitegererezo kumajwi mbisi. Mugihe cy'amahugurwa byongera buhoro buhoro urusaku rwa Gaussiya kumurongo usukuye hejuru yintambwe nyinshi, hanyuma wiga umuyoboro wo guhanura no gukuraho urwo rusaku kuri buri ntambwe. Mugihe cyibisekuru bitangirira ku rusaku rwiza kandi bigakora inzira ihindagurika, itondekanye kuri mel-spectrogram, kugirango igarure imvugo isukuye. Uruti rw'umugongo ni umuyoboro udasanzwe, wagutse-uhuza ibitekerezo bisa na WaveNet ariko ugahanura urusaku aho kuba ingero. DiffWave ihuza amajwi akomeye mu bwiza kandi irakomeye, ndetse itanga imvugo yumvikana itagabanijwe hamwe nibisubizo bihamye kubavuga. Igicuruzwa nyamukuru cyihuta ni umuvuduko: naive sampling ikenera intambwe ibihumbi kugeza ku bihumbi, nubwo gahunda yihuse igabanya ibi kugeza kuri bitandatu.

Gushyira mu bikorwa Isi

Kwizerwa cyane neural text-to-imvugo inyuma birangira birinda imyitozo ya GAN idahindagurika

Imvugo itagabanijwe kubyara amakuru yo kongera amakuru nubushakashatsi bwamajwi

Speaker-robust ijwi synthesis aho icyitegererezo kimwe gikora amajwi menshi buri gihe

Ikizamini cyihuse-cyitegererezo cyo gukwirakwiza ubushakashatsi, ukoresheje ingengabihe ngufi y'amajwi kumajwi-nyayo

Kazoza ka DiffWave Diffusion Vocoder

DiffWave yatangije amajwi ya diffuzione hamwe nabasimbuye byihuse nka PriorGrad na FastDiff igabanya intambwe zibarwa. Umwanya urimo guhuriza hamwe kubuhanga no guhora-bigezweho bigamije gutoranya intambwe imwe yo gukwirakwiza, kuziba icyuho cyihuta hamwe nijwi rya GAN mugihe gikomeza imyitozo ihamye kandi ikomeye. Tegereza ibitekerezo byo gukwirakwiza gukwirakwira cyane muri muzika, codecs ya neural, hamwe na majwi yisi yose aho uburyo bwo gukwirakwiza ibintu bifite akamaro.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Kugera no kugera. Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.
  • Igiciro na bije. Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.
  • Umuvuduko n'igipimo. Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Witondere

  • Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.
  • Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.
  • Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Intambwe ikurikira

  1. Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.
  2. Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.
  3. Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.
  4. Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Fata ikibazo cya DiffWave Diffusion Vocoder

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

Vocoder ya DiffWave Niki?

DiffWave ni ikwirakwizwa rishingiye ku majwi asanisha amajwi mu buryo bwitondewe yerekana urusaku rudasanzwe mu muhengeri, rushingiye kuri mel-spectrogram. Byazanye moderi yo gukwirakwiza imvugo yizerwa cyane, irwanya GAN na WaveNet nta mahugurwa yo guhangana.

Nigute DiffWave itanga amajwi mugihe cyo gufata umwanzuro?

DiffWave itangirira ku rusaku rwa Gaussiya kandi ikora inzira yo gukwirakwiza, ikagaragaza inshuro nyinshi mugihe itunganijwe kuri mel-spectrogram, kugirango itange umurongo.

Niki umuyoboro wa DiffWave wiga guhanura mugihe cy'amahugurwa?

DiffWave itoza umuyoboro wo guhanura urusaku rwa Gaussiya rwongewe ku ntambwe yatoranijwe yo gukwirakwiza, ukoresheje igihombo kiremereye L2.

Ni ubuhe butumwa bukomeye bwa DiffWave ugereranije n'abavuga GAN?

Naive diffusion sampling ikenera intambwe nyinshi zinyuranye; nubwo gahunda yihuse ifasha, inzira itera nigiciro nyamukuru cyigiciro.

Ni izihe nyungu DiffWave ifite kurusha abavuga GAN mumahugurwa?

Moderi ya Diffusion yatojwe hamwe nintego ihamye yo gusubira inyuma, ikuraho ihungabana imyitozo ya GAN ishobora guhangana.

Ni ubuhe bwubatsi umuyoboro wa DiffWave urusaku-ruhanura rusa?

DiffWave ikoresha umugongo utari autoregressive wumugongo wagutse wagutse usa na WaveNet, ariko irahanura urusaku aho gukoresha amajwi.