Ubuyobozi bwa Audio AI

Ibisobanuro byo Kumenyekanisha Imvugo

SpecAugment nuburyo bworoshye ariko bukomeye bwo kongera amakuru uburyo bwo guhisha no guhinduranya spekrogramu yimvugo kugirango moderi yo kumenyekana irusheho gukomera.

Incamake

SpecAugment nuburyo bworoshye ariko bukomeye bwo kongera amakuru uburyo bwo guhisha no guhinduranya spekrogramu yimvugo kugirango moderi yo kumenyekana irusheho gukomera. Yazamuye ukuri ku bipimo nta majwi mashya cyangwa amajwi yahindutse.

SpecAugment for Speech Recognition yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

SpecAugment, yatangijwe na Google Ubwonko (Parike et al.) Muri 2019, byongera amahugurwa yo kumenyekanisha imvugo uhindura log-mel spectrogramme aho kuba umurongo wibanze. Ikoresha ibikorwa bitatu: igihe cyo gufata umwanya, kirambuye gato cyangwa kigabanya amajwi mugihe cyerekezo; guhisha inshuro, zeru zitsinda imirongo yimiyoboro yumurongo; na masking igihe, ikuraho umwanya wintambwe. Muguhatira icyitegererezo kumenya imvugo niyo mugihe uduce twa spekrogramu twihishe, SpecAugment ikora nkibisanzwe kandi ikabuza gukabya. Byari bihendutse kandi byiza, bifasha moderi yuburyo bwa LAS kugera icyo gihe igipimo cyamagambo yamagambo yibeshya kuri LibriSpeech na Switchboard, kandi iracyari ikintu cyambere muburyo bwa ASR butoza.

Ubushishozi

SpecAugment ikora kuri 2D spekrogramu nkaho ari ishusho. Guhisha inshuro nyinshi bikuraho umurongo uteganijwe wa mel-frequency; igihe cyo gukuramo gikuraho ikintu kidasanzwe cyama kadamu; igihe cyo guhinduranya gihindura ingingo yatoranijwe mugihe cyigihe ukoresheje interpolation. Masike nyinshi zirashobora gukoreshwa kumvugo. Kuberako masike ihindura ibihe byose, icyitegererezo kibona neza itandukaniro ridashira rya buri ngero, kunoza rusange muri rusange udakusanyije amakuru mashya.

Kumenya Kwiyongera Kumenyekanisha Imvugo

Kugirango wubake byimbitse, fata SpecAugment ya Speech Recognition nkicyitegererezo gikora, ntabwo ari ikintu kimwe. Sobanura ibyifuzwa, usobanure neza ibitekerezo, kandi utandukanye ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mu myitozo, amakipe akomeye akoresha SpecAugment ya Speech Recognition ifata ubuziranenge, ubukererwe, hamwe no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza h'Icyerekezo cyo Kumenyekanisha Imvugo

SpecAugment yahindutse hafi-yisi yose muburyo bwo kumenyekanisha imvugo kandi ikwirakwira mubindi bikorwa byamajwi nko kugenzura abavuga no gutondekanya amajwi. Akazi kazoza gahuza politiki yo guhisha mu buryo bwikora cyangwa kuyihuza mugihe cy'amahugurwa, kandi igahuza masike ya spekrogramu hamwe nintego yo kwiyobora wenyine. Mugihe icyitegererezo gikura, kwiyongera bihendutse byongeramo imbaraga nta majwi yongeyeho amajwi bikomeza kuba iby'igiciro cyinshi, cyane cyane ku ndimi nkeya zifite aho amakuru ari make.

Gushyira mu bikorwa Isi

Kunoza igipimo cyamakosa kuri LibriSpeech muguhisha bande ya spekrogramu mugihe cy'amahugurwa

Guhindura impera-zanyuma za ASR nka LAS cyangwa Conformer kugirango ugabanye gukabya

Gutezimbere imibare mike yindimi-nke zindimi zitanditse amajwi mashya

Guhuza igitekerezo cyo guhishira abavuga kugenzura no kwerekana amajwi y'ibyiciro

Uburyo bwo Gushyira mu bikorwa

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Kunoza igipimo cyamakosa kuri LibriSpeech muguhisha bande ya spekrogramu mugihe cy'amahugurwa.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Guhindura impera-zanyuma za ASR moderi nka LAS cyangwa Conformer kugirango ugabanye gukabya.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Gutezimbere imibare mike yindimi-nke zindimi zitanditse amajwi mashya.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Kwiyongera Kumenyekanisha Imvugo mubikorwa

Guhuza igitekerezo cyo guhishira abavuga kugenzura no kwerekana amajwi y'ibyiciro.

Amakipe akunze kubona umusaruro ushimishije mugihe asobanura ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Fata nk'irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi

Check your understanding

Test yourself: take the SpecAugment for Speech Recognition quiz

Start quiz