Ubuyobozi bwa Audio AI

Ibisobanuro byo Kumenyekanisha Imvugo

SpecAugment nuburyo bworoshye ariko bukomeye bwo kongera amakuru uburyo bwo guhisha no guhinduranya spekrogramu yimvugo kugirango moderi yo kumenyekana irusheho gukomera.

Incamake

SpecAugment nuburyo bworoshye ariko bukomeye bwo kongera amakuru uburyo bwo guhisha no guhinduranya spekrogramu yimvugo kugirango moderi yo kumenyekana irusheho gukomera. Yazamuye ukuri ku bipimo nta majwi mashya cyangwa amajwi yahindutse.

SpecAugment for Speech Recognition yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

SpecAugment, yatangijwe na Google Ubwonko (Parike et al.) Muri 2019, byongera amahugurwa yo kumenyekanisha imvugo uhindura log-mel spectrogramme aho kuba umurongo wibanze. Ikoresha ibikorwa bitatu: igihe cyo gufata umwanya, kirambuye gato cyangwa kigabanya amajwi mugihe cyerekezo; guhisha inshuro, zeru zitsinda imirongo yimiyoboro yumurongo; na masking igihe, ikuraho umwanya wintambwe. Muguhatira icyitegererezo kumenya imvugo niyo mugihe uduce twa spekrogramu twihishe, SpecAugment ikora nkibisanzwe kandi ikabuza gukabya. Byari bihendutse kandi byiza, bifasha moderi yuburyo bwa LAS kugera icyo gihe igipimo cyamagambo yamagambo yibeshya kuri LibriSpeech na Switchboard, kandi iracyari ikintu cyambere muburyo bwa ASR butoza.

Ubushishozi

SpecAugment ikora kuri 2D spekrogramu nkaho ari ishusho. Guhisha inshuro nyinshi bikuraho umurongo uteganijwe wa mel-frequency; igihe cyo gukuramo gikuraho ikintu kidasanzwe cyama kadamu; igihe cyo guhinduranya gihindura ingingo yatoranijwe mugihe cyigihe ukoresheje interpolation. Masike nyinshi zirashobora gukoreshwa kumvugo. Kuberako masike ihindura ibihe byose, icyitegererezo kibona neza itandukaniro ridashira rya buri ngero, kunoza rusange muri rusange udakusanyije amakuru mashya.

Kumenya Kwiyongera Kumenyekanisha Imvugo

SpecAugment nuburyo bworoshye ariko bukomeye bwo kongera amakuru uburyo bwo guhisha no guhinduranya spekrogramu yimvugo kugirango moderi yo kumenyekana irusheho gukomera. Yazamuye ukuri ku bipimo nta majwi mashya cyangwa amajwi yahindutse. SpecAugment for Speech Recognition yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugirango wubake byimbitse, fata SpecAugment for Speech Recognition nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha SpecAugment ya Speech Recognition ifata ubuziranenge, ubukererwe, hamwe no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza h'Icyerekezo cyo Kumenyekanisha Imvugo

SpecAugment yahindutse hafi-yisi yose muburyo bwo kumenyekanisha imvugo kandi ikwirakwira mubindi bikorwa byamajwi nko kugenzura abavuga no gutondekanya amajwi. Akazi kazoza gahuza politiki yo guhisha mu buryo bwikora cyangwa kuyihuza mugihe cy'amahugurwa, kandi igahuza masike ya spekrogramu hamwe nintego yo kwiyobora wenyine. Mugihe icyitegererezo gikura, kwiyongera bihendutse byongeramo imbaraga nta majwi yongeyeho amajwi bikomeza kuba iby'igiciro cyinshi, cyane cyane ku ndimi nkeya zifite aho amakuru ari make.

Gushyira mu bikorwa Isi

Kunoza igipimo cyamakosa kuri LibriSpeech muguhisha bande ya spekrogramu mugihe cy'amahugurwa

Guhindura impera-zanyuma za ASR nka LAS cyangwa Conformer kugirango ugabanye gukabya

Gutezimbere imibare mike yindimi-nke zindimi zitanditse amajwi mashya

Guhuza igitekerezo cyo guhishira abavuga kugenzura no kwerekana amajwi y'ibyiciro

Uburyo bwo Gushyira mu bikorwa

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Kunoza igipimo cyamakosa kuri LibriSpeech muguhisha bande ya spekrogramu mugihe cy'amahugurwa.

Kunoza igipimo cyamakosa yamagambo kuri LibriSpeech muguhisha bande ya spekrogramu mugihe cyamahugurwa Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Guhindura impera-zanyuma za ASR nka LAS cyangwa Conformer kugirango ugabanye gukabya.

Guhindura moderi ya ASR iherezo-iherezo nka LAS cyangwa Conformer kugirango igabanye Amakipe arenze urugero mubisanzwe ibona ibisubizo byiza mugihe isobanura ibipimo ngenderwaho byimbere imbere, igakomeza inzira yo kuzamura abantu kubibazo, kandi ikurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Gutezimbere imibare mike yindimi-nke zindimi zitanditse amajwi mashya.

Gutezimbere imibare mike yindimi zidafite amikoro atanditse amajwi mashya Amakipe asanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Guhuza igitekerezo cyo guhishira abavuga kugenzura no kwerekana amajwi y'ibyiciro.

Guhuza igitekerezo cyo guhishira no kugenzura abavuga no gutondekanya ibyabaye mu majwi Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi