Ubuyobozi bwa Audio AI

Ubwubatsi bwimbitse

DeepSpeech nicyitegererezo cyo kumenyekanisha imvugo iherezo kugeza ku ndunduro yatangijwe na Baidu muri 2014 ishushanya ikarita yerekana amajwi mbisi ku buryo bwanditse ukoresheje umuyoboro w’imitsi usubiramo watojwe nigihombo cya CTC.

Incamake

DeepSpeech nicyitegererezo cyo kumenyekanisha imvugo iherezo kugeza ku ndunduro yatangijwe na Baidu muri 2014 ishushanya ikarita yerekana amajwi mbisi ku buryo bwanditse ukoresheje umuyoboro w’imitsi usubiramo watojwe nigihombo cya CTC. Yafashaga abapayiniya kuva mu miyoboro igoye, yakozwe n'intoki ASR yerekeza kuri sisitemu yize, ikoreshwa na data.

DeepSpeech Architecture yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru.

Kwibira cyane

Kumenyekanisha imvugo ya kera byashushanyije hamwe moderi zitandukanye za acoustique, inkoranyamagambo, hamwe nururimi rwindimi hamwe nibice byahujwe n'intoki. DeepSpeech yasimbuye ibyinshi muribyo numuyoboro umwe wimyitozo yatojwe kurangiza. Ubwubatsi bwayo bufata spekrogramu cyangwa MFCC ibiranga hejuru yama majwi magufi kandi ikabigaburira binyuze mubice byinshi byahujwe byuzuye, ibyerekezo byisubiramo byombi bifata imiterere kuva kera ndetse nigihe kizaza, hamwe nibisohoka bitanga amahirwe yo gukwirakwiza inyuguti kuri buri ntambwe. Byibanze, ikoresha Connectionist Temporal Classification (CTC), ituma umuyoboro wiga guhuza amajwi n'inyandiko udakeneye ibirango-urwego. Nyuma Mozilla yasohoye ibyamamare bifungura-isoko (hamwe na verisiyo nshya ukoresheje LSTM ishingiye, igishushanyo mbonera), bituma inzira igerwaho cyane.

Ubushishozi

Urufunguzo rufasha ni igihombo cya CTC. Imvugo ninyandiko ntabwo bihujwe kumurongo-kumurongo, CTC rero itangiza ikimenyetso 'cyambaye ubusa' hamwe nigiteranyo hejuru yuburyo bwose bushoboka bushobora gusenyuka kubigenewe. Ibi bireka icyitegererezo gisohora inyuguti mugihe cyintambwe hanyuma ukamenya aho amajwi ikarita yinyuguti byikora. Ibyerekezo bibiri RNN itanga buri guhanura kugera kumurongo wa acoustic, kandi imvugo n-garama yo hanze ikunze kongerwaho mugihe cya decode kugirango tunonosore imyandikire nijambo.

Kumenya Ubwubatsi Bwimbitse

DeepSpeech nicyitegererezo cyo kumenyekanisha imvugo iherezo kugeza ku ndunduro yatangijwe na Baidu muri 2014 ishushanya ikarita yerekana amajwi mbisi ku buryo bwanditse ukoresheje umuyoboro w’imitsi usubiramo watojwe nigihombo cya CTC. Yafashaga abapayiniya kuva mu miyoboro igoye, yakozwe n'intoki ASR yerekeza kuri sisitemu yize, ikoreshwa na data. DeepSpeech Architecture yicaye mumajwi-AI akazi gahindura imvugo, umuziki, nijwi ryitumanaho, kugerwaho, no gukora itangazamakuru. Kugira ngo wubake byimbitse, fata ubwubatsi bwa DeepSpeech nk'icyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.

Mubimenyerezo, amakipe akomeye akoresha DeepSpeech Architecture yubaka ubuziranenge, ubukererwe, no kwemererwa nkibice byingenzi byingamba zo kohereza. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mugihe kimwe, gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.

Ingaruka z'Ingamba

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi.

Itezimbere kugerwaho binyuze mu kwandukura, kuvuga, no guhuza amajwi. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto.

Amatsinda yibitangazamakuru arashobora kohereza amajwi yihuse hamwe na bije nto. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini.

Sisitemu ireba abakiriya irashobora gutunganya imikoranire ivugwa murwego runini. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.

Ejo hazaza h'ubwubatsi bwimbitse

DeepSpeech ubwayo yasimbuwe ahanini nubwitonzi- hamwe na transformateur ishingiye ku bwubatsi (Conformer, Whisper, wav2vec 2.0) ifata imiterere ndende no kwiyobora ku majwi atanditse. Ariko ibitekerezo byayo byingenzi, amahugurwa arangira-arangije na decode ya CTC, akomeza kuba urufatiro kandi aracyagaragara muri sisitemu ya kijyambere. Umurage ni igitekerezo: byerekanaga ko icyitegererezo kimwe cyize gishobora guhangana n'imiyoboro ikozwe cyane, bigatanga inzira kuri moderi nini, indimi nyinshi, yiyobora wenyine.

Gushyira mu bikorwa Isi

Offline, kumurongo wibikoresho byamajwi kumenyekanisha porogaramu yibanga ukoresheje Mozilla ifunguye DeepSpeech

Gukora inyandiko-mvugo ya podcasts cyangwa ibiganiro udashingiye kuri serivise

Kwigisha ishingiro ryigihombo cya ASR na CTC mu masomo yo kwiga imashini za kaminuza

Kubaka amajwi yihariye ya IoT cyangwa ibikoresho byashizwemo aho bikenewe byoroshye, byoroshye kumenyekana

Uburyo bwo Gushyira mu bikorwa

Ububiko bwimbitse bwimbitse mubikorwa

Offline, kumurongo wibikoresho byamajwi kumenyekanisha porogaramu yibanga ukoresheje Mozilla ifunguye DeepSpeech.

Offline, kumurongo wibikoresho byamajwi kumenyekanisha porogaramu yibanga ukoresheje amakipe ya Mozilla yafunguye ya DeepSpeech Amakipe asanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.

Ububiko bwimbitse bwimbitse mubikorwa

Gukora inyandiko-mvugo ya podcasts cyangwa ibiganiro udashingiye kuri serivise.

Gukora inyandiko-mvugo ya podcasts cyangwa inyigisho udashingiye kuri serivise igicu Amakipe akunze kubona umusaruro mwiza mugihe asobanura ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.

Ububiko bwimbitse bwimbitse mubikorwa

Kwigisha ishingiro ryigihombo cya ASR na CTC mu masomo yo kwiga imashini za kaminuza.

Kwigisha ishingiro ryigihombo cya ASR na CTC mumasomo yo kwiga imashini za kaminuza Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Ububiko bwimbitse bwimbitse mubikorwa

Kubaka amajwi yihariye ya IoT cyangwa ibikoresho byashizwemo aho bikenewe byoroshye, byoroshye kumenyekana.

Kubaka amajwi yihariye ya IoT cyangwa ibikoresho byashizwemo aho hakenewe kumenyekana byoroshye, byoroshye kumenyekana Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe.

Ingaruka & Kurinda

!

Gukoresha nabi amajwi no kwigira ibyago byiyongera mugihe uruhushya rubuze.

!

Ukuri kurashobora kugabanuka hejuru yimvugo, imvugo, cyangwa urusaku rwibidukikije.

!

Amajwi yubukorikori arashobora kwibeshya kumvugo yukuri nta kirango gisobanutse.

Igishushanyo mbonera

1

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha.

Shaka uruhushya rusobanutse rwo gufata amajwi, gukoroniza, no gukoresha. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

2

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere.

Ikizamini cyiza mubiganiro bitandukanye hamwe nuburyo bwimbere. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

3

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo.

Sobanura igihe umuntu agomba gusuzuma cyangwa kwemeza ibisubizo. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

4

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa.

Andika amajwi yubukorikori kandi ugumane inyandiko zerekana kubazwa. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.

Komeza Ubushakashatsi