Wav2Letter ASR
Wav2Letter sistem la buy xàmmee kàddu yi bawoo ci Facebook IA, muy jëfandikoo reso neuronal yu konvolusioŋ rek, du am luñu koy baamtu.
Résumé
It mattered as a fast, simple alternative that proved CNNs alone could transcribe speech competitively.
Plongeur bu xóot
Facebook AI Research moo ko dugal ci atum 2016, Wav2Letter génne na ci anam yu bari yu ñuy baamtu ak yu lalu ci HMM ndax dafa wéeru ci reso neuronal convolutionnel ngir mëna xayma audio bi ci araf yi (araf yi), moo tax ñu tuddee ko. Bi ñu koy njëkka tàggat, dafa am AutoSegCriterion (ASG) buy ñàkk, muy anam wu gëna yomba wuutale ñàkk CTC bi gëna bari, bi daaneel màndarga bu amul dara, ba noppi modele arafu jaar-jaar yi ci saasi. Ñu ngi ko bind ci C++ ci backend Flashlight/ArrayFire, ñu defaree ko ngir gaawaay ci CPU ak GPU yépp. Version yi ci topp, Wav2Letter++ ak xeetu convolution bi mat sëkk, dañu leen yokk ba ci ay done yu bari, ñu am njuumte yu bari ci Librispeech. Design bimu am ci convolution rekk moo tax mu mëna parallélisé bu baax te neexa def inference buñu ko méngale ak decodeur RNN yu toppalante.
Gis-gis xarala
Wav2Letter dafay jël ay convolution temporale 1D ci kaw man-mani akustik yi, ak layer bu nekk di yaatal barab biy jot, suko defee ay piye yu xóot yi di jàpp contexte bu yàgg te duñu dellu. Ndax convolution yi dañuy def jéego yépp ci paralel, tàggat ak inference dañu gaaw. ASG perte bi njëkk mingi nuru CTC waaye dindi token bu amul dara ba noppi yokk poñ yu leer ci araf-ci-araf, defar benn xeetu toppalante bu mat sëkk buy méngale audio bu am guddaay bu mën soppiku ak génnug araf te amul etiketu kaadar bu nekk.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu Wav2Letter ASR
Liggéeyukaay bu jub bu Wav2Letter mingi dundu ci Flashlight, bibliotek buy jàng masin C++ bu Facebook, ba noppi yëgal wav2vec model yiy saytu seen bopp yu ëpp doole leegi. Njàngale mu gëna yaatu mooy convolution ak architecture paralel mën nañu méngoo ak recurrence, ñu koy dugal ci ASR bu sukkandiko ci transformateur. Xaarandil ni sistem yi ci kanam dina ñu wéy di leble li Wav2Letter fësal ci gasoduk end-to-end bu baax, paralel, di wuutale bu baax, ci noonu lañuy tàmbalee tàggat seen bopp ngir làkk yu néew doole yi.
Doxal ci àdduna dëgg
Transkripsioŋ ci jamono dëgg, fu latency bu néew, inference paralel moo gëna am solo ay poñ yu néew ci njub
Xamme kàddu yiñ tënk ci aparey bi wala ci CPU bi mënul jënd dekodeer yu diis yuy baamtu
Gëstu buy méngale ASR ak RNN ak sistem transformatër ci Librispeech
Dafay nekk fondasioŋ ingenieur ngir bibliotek Torsh bu Facebook ak model wav2vec yu ci topp
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Wav2Letter Convolutional ASR quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Reseau neuronal konvolusionel
Laaj yi ñuy faral di laaj
What is Wav2Letter Convolutional ASR?
Wav2Letter sistem la buy xàmmee kàddu yi bawoo ci Facebook IA, muy jëfandikoo reso neuronal yu konvolusioŋ rek, du am luñu koy baamtu. Dafa am solo ni ap pexe bu gaaw te yomb buy firndeel ni CNNs kese ñoo mëna bind kàddu yi ci anam wu xarañ.
Ban reso neuronal la Wav2Letter di wéeru?
Wav2Letter ñungi ko xamee ci jëfandikoo reso neuronal convolutionnel rek, moytu baamtu lëmm.
Ban mbootaay moo njëkka defar Wav2Letter?
Gëstu IA bu Facebook moo dugal Wav2Letter ci 2016 ginaaw ga mu dem ba nekk bibliotek Torsh.
Luy 'arafu' bi ci Wav2Letter?
Wav2Letter dafay xayma jëmmu onde audio bi ci ay araf yu toppalante (araf yi), muy nuru njeexte-ba-jeexal.
Lan mooy wuutale ñàkka am AutoSegCriterion (ASG) ak ñàkka am CTC bi gëna bari?
ASG dafay daaneel token bu amul dara bu CTC, lu moy loolu mu yokk poñ yu leer ci diggante araf yi, fekk mën nañu ko wuutale bu baax.
Lan mooy njariñ li gëna am solo ci jëmmal Wav2Letter ci jëmmal rek?
RNN yi wuute nañu ak RNN yi, convolution yi mën nañu leen xayma ci paralel ci diir bi, loolu mooy tax sistem bi gaaw te baax.