Overview
SpecAugment inzira yakapfava asi ine simba yekuwedzera data iyo inovhara uye inotenderedza spectrogram yekutaura kuita kuti mamodheru ekuzivikanwa awedzere kusimba. Iyo yakawedzera huchokwadi pamabhenji pasina chero nyowani odhiyo kana modhi shanduko.
SpecAugment yeKuzivikanwa Kwekutaura inogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzirwa kwenhau.
Deep Dive
SpecAugment, yakaunzwa na Google Brain (Park et al.) muna 2019, inowedzera kudzidziswa kwekutaura nekugadzirisa iyo log-mel spectrogram zvakananga kwete iyo mbishi waveform. Inoshandisa mashandiro matatu: nguva warping, iyo inotambanudza zvishoma kana kumanikidza odhiyo pamwe neakisi yenguva; frequency masking, iyo inobvisa mabhendi e frequency chiteshi; uye nguva masking, iyo inovhara kunze spans dzenguva nhanho. Nekumanikidza iyo modhi kuziva kutaura kunyangwe chunks ye spectrogram yakavanzwa, SpecAugment inoita seyakajairwa uye inodzivirira kuwandisa. Yakanga yakachipa zvinoshamisa uye inoshanda, ichibatsira LAS-maitiro mamodheru kusvika panguva iyoyo-ye-ye-iyo-ye-ye-ye-ye-ye-ye-yekukanganisa mazwi mareti paLibriSpeech uye Switchboard, uye inoramba iri chinhu chakasarudzika mumapaipi emazuva ano ekudzidzisa ASR.
Technical Insight
SpecAugment inoshanda pa 2D spectrogram sekunge mufananidzo. Frequency masking inobvisa chivharo chisina kujairika che mel-frequency chiteshi; nguva masking inobvisa chivharo chisina kujairika chenguva zhinji mafuremu; nguva yekuchinja inoshandura nzvimbo yakasarudzwa ichitevedza axis yenguva uchishandisa kududzira. Masks akawanda anogona kuiswa pakutaura. Nekuti masiki anochinja epoch yega yega, modhi yacho inonyatsoona misiyano isingaperi yemuenzaniso wega wega, kuvandudza hunyanzvi pasina kuunganidza data idzva.
Mastering SpecAugment yeKuzivikanwa Kwekutaura
SpecAugment inzira yakapfava asi ine simba yekuwedzera data iyo inovhara uye inotenderedza spectrogram yekutaura kuita kuti mamodheru ekuzivikanwa awedzere kusimba. Iyo yakawedzera huchokwadi pamabhenji pasina chero nyowani odhiyo kana modhi shanduko. SpecAugment yeKuzivikanwa Kwekutaura inogara muodhiyo-AI workflows inoshandura kutaura, mimhanzi, uye ruzha rwekutaurirana, kuwanikwa, uye kugadzirwa kwenhau. Kuti uvake kunzwisisa kwakadzama, bata SpecAugment yeKuzivikanwa Kwekutaura semuenzaniso wekushandisa, kwete chinhu chimwe chete: tsanangura zvinodikanwa, kujekesa fungidziro, uye patsanura zvinogona kuitwa nehurongwa hwakavimbika kubva kune zvichiri kuda kutonga kwenyanzvi.
Mukuita, zvikwata zvakasimba zvinoshandisa SpecAugment for Speech Recognition zvinobata mhando, latency, uye mvumo sezvikamu zvakakosha zvakaenzana zvehurongwa hwekuendesa. Ivo vanonyora zvakajeka maitiro ebudiriro, bvunzo vachipokana ne data rechokwadi uye mafambiro ebasa, uye iterate zvichibva pane zvakacherechedzwa maitiro ekutadza kwete kuhwina-nguva imwe chete yebhenji. Apa ndipo apo kunzwisisa kwe theoretical kunoshanduka kuve kugona kwakasimba pane chigadzirwa, mutemo, uye mashandiro.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Panguva imwecheteyo, kusashandiswa kweIzwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo. Nzira yakatsiga ndeyekubatanidza kukurumidza kuyedza nekutonga: mhanyisa vatyairi vendege, tora humbowo, buritsa matanda esarudzo, uye urambe uchivandudza chengetedzo semaitiro emuenzaniso, zvinotarisirwa nemushandisi, uye zvinodikanwa zvekutonga.
Strategic Impact
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza.
Inonatsiridza kusvikika kuburikidza nekunyora, kurondedzera, uye mazwi ekubatanidza. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki.
Zvikwata zveMedia zvinogona kutumira odhiyo yakakwenenzverwa nekukurumidza nemabhajeti madiki. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru.
Masisitimu anotarisana nevatengi anogona kugadzirisa kutaurirana kwekutaura pamwero mukuru. Mukutumirwa kwemhando yepamusoro, izvi zvinoshandurirwa kuita mitemo inoyerwa yekushanda, miganhu yevaridzi, uye tsika dzekudzokorora dzinodzokororwa kuitira kuti zvikwata zvikwire kuvimba pane kukwidza kusajeka.
Real-World Implementation
Kuvandudza chiyero chekukanganisa kwemazwi paLibriSpeech nekumisa mabhendi e spectrogram panguva yekudzidziswa
Kudzoreredza kumagumo-kusvika-kumagumo ASR modhi seLAS kana Conformer kuderedza kuwandisa
Kuwedzera mashoma maseti emitauro-zvishoma pasina kurekodha mutsva
Kuchinjira iyo masking zano kune simbisa yemukurukuri uye odhiyo chiitiko chiitiko
Maitiro Ekuita
SpecAugment Yekuzivikanwa Kwekutaura mukuita
Kuvandudza chiyero chekukanganisa kwemazwi paLibriSpeech nekumisa mabhendi e spectrogram panguva yekudzidziswa.
Kuvandudza chiyero chekukanganisa kwemazwi paLibriSpeech nekuvharisa mabhendi e spectrogram panguva yekudzidziswa Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
SpecAugment Yekuzivikanwa Kwekutaura mukuita
Kudzoreredza kumagumo-kusvika-kumagumo ASR modhi seLAS kana Conformer kuderedza kuwandisa.
Kudzokorodza ekupedzisira-kusvika-kumagumo ASR modhi seLAS kana Conformer kudzikisa kuwandisa maTimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi emupendero, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
SpecAugment Yekuzivikanwa Kwekutaura mukuita
Kuwedzera mashoma maseti emitauro-zvishoma pasina kurekodha mutsva.
Kuwedzera mashoma madhaseti emitauro yakaderera-zvishandiso pasina kurekodha Matimu matsva ekuteerera anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa nemitengo yekukanganisa nekufamba kwenguva.
SpecAugment Yekuzivikanwa Kwekutaura mukuita
Kuchinjira iyo masking zano kune simbisa yemukurukuri uye odhiyo chiitiko chiitiko.
Kuchinjira iyo yekuvharisa pfungwa yekusimbisa mutauri uye odhiyo chiitiko kupatsanura Matimu anowanzo kuwana mhedzisiro iri nani kana achinge atsanangura emhando yepamusoro kumberi, chengetedza nzira yekukwira kwevanhu yemakesi ekumucheto, uye kuteedzera zvese zvakawanikwa zvechigadzirwa uye mutengo wekukanganisa nekufamba kwenguva.
Njodzi & Guardrails
Kusashandisa izwi zvisizvo uye njodzi dzekuedzesera dzinowedzera kana chibvumirano chisipo.
Kururama kunogona kudonha mumitauro, mataurirwo, kana nharaunda dzine ruzha.
Synthetic audio inogona kukanganisa kutaura kwechokwadi isina mavara akajeka.
Implementation Roadmap
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare.
Wana mvumo yakajeka yekutora inzwi, kugadzira, uye kushandisa zvakare. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure.
Yedza mhando pavatauri vakasiyana uye mamiriro ekumashure. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda.
Tsanangura apo munhu anofanira kuongorora kana kubvumidza zvabuda. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira.
Label synthetic odhiyo uye chengetedza marekodhi ekuzvidavirira. Bata nhanho yega yega segedhi rehumbowo: kana maitiro asina kusangana, imbomira kuburitsa, vhara gaka, uye wobva wawedzera kushandiswa.