UMHLAHLANDLELA WE-AI womsindo

I-Wav2Letter Convolutional ASR

I-Wav2Letter iwuhlelo lokuqaphela inkulumo kusukela ekupheleni ukuya ekupheleni oluvela ku-Facebook AI olusebenzise kuphela amanethiwekhi e-convolutional neural, akukho ukuphindeka.

2 amaminithi ukufundaIgcine ukubuyekezwa

Uhlolojikelele

It mattered as a fast, simple alternative that proved CNNs alone could transcribe speech competitively.

I-Deep Dive

Yethulwe yi-Facebook AI Research ngo-2016, i-Wav2Letter yaphuma ezindleleni ezihamba phambili eziphindelelayo nezisekelwe ku-HMM ngokuthembela ngokuphelele kumanethiwekhi e-convolutional neural ukuze kumephu umsindo ngokuqondile kubalingiswa (izinhlamvu), yingakho igama. Ekuqaleni iqeqeshwe ngokulahlekelwa ngokwezifiso kwe-AutoSegCriterion (ASG), enye indlela elula yokulahlekelwa okuvame kakhulu kwe-CTC elahle uphawu olungenalutho kanye nokuguqulwa kohlamvu oluyimodeli ngokuqondile. Ibhalwe ngo-C++ kusetshenziswa i-Flashlight/ArrayFire backend, yakhelwe isivinini kukho kokubili i-CPU ne-GPU. Izinguqulo zakamuva, i-Wav2Letter++ kanye nokwahluka okuguqulwa ngokugcwele, kukalwe kumasethi edatha amakhulu futhi kwafinyelelwa kumazinga amaphutha wamagama aqhudelanayo ku-Librispeech. Idizayini yayo ye-convolution kuphela iyenze yafana kakhulu futhi yasebenziseka kalula uma iqhathaniswa namadekhoda e-RNN alandelanayo.

I-Technical Insight

I-Wav2Letter inqwabelanisa i-1D temporal convolutions ngaphezu kwezici ze-acoustic, isendlalelo ngasinye esinweba inkambu yokwamukela ukuze izitaki ezijulile zithwebule umongo omude ngaphandle kokuphinda. Ngoba ama-convolutions acubungula zonke izinyathelo zesikhathi ngokuhambisana, ukuqeqeshwa kanye nencazelo kuyashesha. Ukulahlekelwa kwe-ASG yasekuqaleni kufana ne-CTC kodwa kususa ithokheni engenalutho futhi kwengeze amaphuzu okuguqulwa kohlamvu kuya ohlamvu olusobala, okukhiqiza umbandela wokulandelana ohlukaniseka ngokugcwele oqondanisa ubude obuguquguqukayo bokuphuma kohlamvu ngaphandle kwamalebula ozimele ngamunye.

I-Strategic Impact

Finyelela futhi ufinyelele

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Izindleko kanye nesabelomali

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Isivinini nesikali

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Ikusasa le-Wav2Letter Convolutional ASR

Uhlu lozalo oluqondile lwe-Wav2Letter luhlala ku-Flashlight, umtapo wolwazi womshini wokufunda we-C++ we-Facebook, futhi lwazisa amamodeli azigadile we-wav2vec abusayo manje. Isifundo esibanzi, sokuthi i-convolution kanye nezakhiwo ezihambisanayo zingafanelana nokuphindaphinda, kufakwa ngqo ku-ASR esekelwe ku-transformer. Lindela amasistimu esikhathi esizayo ukuthi aqhubeke nokuboleka ukugcizelela kwe-Wav2Letter kumapayipi asebenza kahle, ahambisanayo, ahlukaniseka ngokugcwele ngenkathi ungqimba ekuziqeqesheni kwangaphambilini ozigadile ngezilimi ezisetshenziswa kancane.

Ukuqaliswa Komhlaba Wangempela

Okulotshiweyo kwesikhathi sangempela lapho ukubambezeleka okuphansi, ukuqonda okuhambisanayo kubaluleke kakhulu kunamaphuzu ambalwa okunemba

Ukubonwa kwenkulumo okukudivayisi noma eboshwe yi-CPU engakwazi ukukhokhela amadekhoda asindayo avelayo

Ucwaningo oluyisisekelo oluqhathanisa i-ASR ye-convolutional ngokumelene ne-RNN kanye nezinhlelo ze-transformer ku-Librispeech

Isebenza njengesisekelo sobunjiniyela selabhulali ye-Flashlight ye-Facebook kanye namamodeli akamuva we-wav2vec

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Qhubeka Uhlole

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Wav2Letter Convolutional ASR quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Qala imibuzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Umhlahlandlela olandelayo

I-Convolutional Neural Networks

Imibuzo evame ukubuzwa

What is Wav2Letter Convolutional ASR?

I-Wav2Letter iwuhlelo lokuqaphela inkulumo kusukela ekupheleni ukuya ekupheleni oluvela ku-Facebook AI olusebenzise kuphela amanethiwekhi e-convolutional neural, akukho ukuphindeka. Bekubalulekile njengendlela esheshayo, elula efakazele ukuthi ama-CNN ewodwa angabhala inkulumo ngokuncintisana.

Iyiphi i-neural network architecture i-Wav2Letter ethembele kuyo kuphela?

I-Wav2Letter iphawuleka ngokusebenzisa amanethiwekhi e-convolutional neural kuphela, igwema ukuphindeka ngokuphelele.

Iyiphi inhlangano eyasungula i-Wav2Letter?

I-Wav2Letter yethulwa ngabakwa-Facebook AI Research ngo-2016 futhi kamuva yavela kumtapo wezincwadi we-Flashlight.

Isho ukuthini 'incwadi' eku-Wav2Letter?

I-Wav2Letter ibhala i-waveform yomsindo ngokuqondile ngokulandelana kwezinhlamvu (izinhlamvu), indlela yokuphela ukuya ekupheleni.

Ingabe ukulahlekelwa kwasekuqaleni kwe-AutoSegCriterion (ASG) kuhluke kanjani ekulahlekelweni okuvamile kwe-CTC?

I-ASG yehlisa ithokheni engenalutho ye-CTC futhi esikhundleni salokho yengeza amaphuzu acacile oshintsho phakathi kwezinhlamvu kuyilapho ehlala ehlukaniseka ngokugcwele.

Iyiphi inzuzo ewusizo ebalulekile yomklamo we-Wav2Letter-convolution-only?

Ngokungafani nama-RNN alandelanayo, ama-convolutions angenziwa ngekhompyutha ngokuhambisana ngesikhathi, okwenza uhlelo lusheshe futhi lusebenze kahle.