Overview
DeepSpeech imhando yekuziva yekutaura-yekupedzisira-kusvika-kumagumo yakaunzwa naBaidu muna 2014 iyo inoburitsa maredhiyo manyoro akananga kumavara achishandisa inodzokororwa neural network yakadzidziswa nekurasikirwa kweCTC. Yakabatsira kupayona kusimuka kubva kune yakaoma, yakagadzirwa nemaoko ASR mapaipi kuenda kune yakadzidza, inofambiswa nedata.
DeepSpeech Architecture inogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzirwa kwenhau.
Deep Dive
Matauriro echinyakare akabatanidza maacoustic modhi akaparadzana, maduramazwi emutauro, uye mhando dzemitauro dzine zvikamu zvakarongwa nemaoko. DeepSpeech yakatsiva yakawanda yeiyo neine imwe neural network yakadzidziswa kupera kusvika kumagumo. Mavakirwo ayo anotora spectrogram kana MFCC maficha pamusoro pemafuremu mapfupi odhiyo uye anoadyisa kuburikidza akati wandei akanyatsobatanidzwa akaturikidzana, bidirectional inodzokororwa layer inobata mamiriro kubva zvakapfuura uye ramangwana, uye inobuda layer inoburitsa mukana wekugovera pamusoro pemavara panguva yega yega nhanho. Zvine hutsinye, inoshandisa Connectionist Temporal Classification (CTC), iyo inoita kuti network idzidze kurongeka pakati peodhiyo uye zvinyorwa pasina kuda mavara-chikamu. Mozilla yakazoburitsa yakakurumbira yakavhurika-sosi kuita (ine shanduro nyowani uchishandisa LSTM-yakavakirwa, inoyerera dhizaini), ichiita kuti nzira yacho iwanikwe zvakanyanya.
Technical Insight
Iyo kiyi inogonesa ndeye CTC kurasikirwa. Hurukuro nemavara hazvina kurongeka-ne-frame, saka CTC inosuma chiratidzo 'chisina chinhu' uye summary pamusoro pezvese zvinogoneka kurongeka zvinopunzika kune chakananga chinyorwa. Izvi zvinoita kuti modhi ibudise mavara pane imwe nguva nhanho uye kudzidza painonzwika mepu kune mavara otomatiki. A bidirectional RNN inopa fungidziro yega yega kuwana kune yakatenderedza acoustic mamiriro, uye yekunze n-giramu yemutauro modhi inowanzowedzerwa panguva yedecode kuvandudza zviperengo uye sarudzo yemazwi.
Mastering DeepSpeech Architecture
DeepSpeech imhando yekuziva yekutaura-yekupedzisira-kusvika-kumagumo yakaunzwa naBaidu muna 2014 iyo inoburitsa maredhiyo manyoro akananga kumavara achishandisa inodzokororwa neural network yakadzidziswa nekurasikirwa kweCTC. Yakabatsira kupayona kusimuka kubva kune yakaoma, yakagadzirwa nemaoko ASR mapaipi kuenda kune yakadzidza, inofambiswa nedata. DeepSpeech Architecture inogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzirwa kwenhau. Kuti uvake kunzwisisa kwakadzama, tora DeepSpeech Architecture semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodiwa, jekesa fungidziro, uye patsanura izvo zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa DeepSpeech Architecture zvinobata mhando, latency, uye mvumo sezvikamu zvakakosha zvakaenzana zvehurongwa hwekuendesa. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Panguva imwecheteyo, kusashandiswa kweIzwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Offline, pa-mudziyo izwi rekuraira kucherechedzwa kwekuvanzika-yakatarisana maapplication uchishandisa Mozilla yakavhurika DeepSpeech.
Kugadzira zvinyorwa zvinyorwa zvepodcasts kana hurukuro pasina kuvimba nesevhisi yegore
Kudzidzisa izvo zvakakosha zvekupedzisira-kusvika-kumagumo ASR uye CTC kurasikirwa mumayunivhesiti-yekudzidza makosi.
Kuvaka tsika yezwi inopindirana yeIoT kana yakamisikidzwa michina panodiwa kuremerwa, inoyerera inoziva
Maitiro Ekuita
DeepSpeech Architecture mukuita
Offline, pane-mudziyo izwi rekuraira kucherechedzwa kwekuvanzika-yakatarisana maapplication uchishandisa Mozilla yakavhurika DeepSpeech.
Offline, pa-mudziyo izwi rekuraira kucherechedzwa kwekuvanzika-yakatarisana maapplication uchishandisa Mozilla yakavhurika DeepSpeech Teams kazhinji inowana mhedzisiro iri nani kana ichinge yatsanangudza mhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
DeepSpeech Architecture mukuita
Kugadzira zvinyorwa zvinyorwa zvepodcasts kana hurukuro pasina kuvimba nesevhisi yegore.
Kugadzira zvinyorwa zvinyorwa zvepodcasts kana hurukuro pasina kuvimba nesevhisi yegore Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura mhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
DeepSpeech Architecture mukuita
Kudzidzisa izvo zvakakosha zvekupedzisira-kusvika-kumagumo ASR uye CTC kurasikirwa mumayunivhesiti-yekudzidza makosi.
Kudzidzisa izvo zvakakosha zvekupedzisira-kusvika-kumagumo ASR uye CTC kurasikirwa mumayunivhesiti-yekudzidza makosi Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
DeepSpeech Architecture mukuita
Kuvaka tsika yezwi inopindirana yeIoT kana yakamisikidzwa michina panodiwa kuremerwa, inoyerera inoziva.
Kuvaka tsika yezwi inopindirana yeIoT kana midziyo yakamisikidzwa panodiwa huremu, inobatika inoziva Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Kusashandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.
Implementation Roadmap
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.