Wav2Vec 2.0
Wav2Vec 2.0 mooy Meta modelu wax bu IA di saytu boppam, di jàng misaali audio yu am doole ci enregistrement yu ñor te amul etiket.
Résumé
It matters because it slashed the amount of transcribed audio needed to build accurate speech recognizers, unlocking ASR for low-resource languages.
Plongeur bu xóot
Facebook moo ko dugal (Meta) AI ci 2020, Wav2Vec 2.0 xeex na jafe-jafe bu mag ci xàmmee kàddu: audio buñ etikete bariwul te seer, waaye audio bu ñor barina lool. Royuwaay bi dafay njëkka tàggat sa bopp ci ay junni waxtu ci wax ju amul etiketu, ci jàng ni ñuy feesee wàll yiñ maskeer ci siñaal bi, tabax xam-xam bu am solo ci biir fonetik. Ginaaw loolu kese lañu koy méngale ak ay done yuñ bind. Li siiw, ak 10 simili audio yuñ etikete ak tàggat bu yaatu, yegg na ci njuumte yu bari yuñ mëna jëfandikoo ci benchmark LibriSpeech. Reset bii dafa demokratise ASR, may transkripsioŋ bu jaar yoon ci làkk yi ak dialect yi amul corpus yu mag yuñ bind.
Gis-gis xarala
Wav2Vec 2.0 dafay dundal forme onde bu ñor bi jaaraleko ci encodeur CNN bu bari couche, ginaaw ga mu maske span yi vecteur yu nëbbu yi ciy génn. Transformer dafay jàng contexte maskeer bi te dafa wara xàmmee représentation quantifiée bu dëggu bi ci segment bu nekk ci maskeer yi ci benn ensemble distracteur, jëfandikoo perte contraste. Codebook buñu jàng dafay xaaj audio biy wéy ci benn ensemble buy wax bu am àpp, loolu dafay jox liggéey bu wuute bi ay mébet yuñ mëna wax luy waaja am.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu Wav2Vec 2.0
Wav2Vec 2.0 moo jur famiy bu mat sëkk ci xeetu kàddu yuñ mëna saytu seen bopp ak XLS-R bu bari làkk, buy wax 128 làkk. Xeetu liggéey bi dafay jëm ci encodeur yu universel yuy toxal ci xàmmee, tekki, gis yëg-yëg, ak liggéeyi waxkat ci benn base buñ tàggat bu njëkk. Xaarandil ngëneel yu wéy ci làkk yi nekk ci jafe-jafe jeex ak yu néew doole yi, boole ci boole man-mani audio yu ñuy saytu seen bopp ci sistem yu bari yuy boole xalaat ci wax, bind ak yeneen siñaal.
Doxal ci àdduna dëgg
Tabax ab xàmmeekatu kàddu ngir làkk yu néew doole yi ak ay simili audio yuñ bind
Taggat bu njëkk enkodeer audio universel ginaaw ga ñu defar ko ngir transkripsioŋ woote telefon
Dindi màndarga kàddu ngir yëg-yëg wala sistem yiy xàmmee waxkat bi
Dafay dooleel xeetu XLS-R bu bari làkk, di bind ci 100+ làkk
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Wav2Vec 2.0 quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Vokoder neuronal
Laaj yi ñuy faral di laaj
What is Wav2Vec 2.0?
Wav2Vec 2.0 mooy Meta xeetu kàddu bu IA di saytu boppam, di jàng misaali audio yu am doole ci enregistrement yu ñor te amul etiket. Dafa am solo ndax dafa wàññi limu audio biñ soxla ngir mëna xàmmee kàddu yu jaar yoon, ubbi ASR ci làkk yu néew doole yi.
Ban jafe-jafe bu mag ci xàmmee kàddu lañu defar ngir saafara Wav2Vec 2.0?
Wav2Vec 2.0 wàññi na dependence ci audio transcription bu seer ndax dafay njëkka tàggat kàddu yu bari te amul etiket.
Ban xeetu mébetu jàng la Wav2Vec 2.0 di jëfandikoo ci diiru tàggat-yaram bi?
Dafay maske span vecteur audio yu nëbbu yi ba noppi jëfandikoo perte contraste ngir tànn unité quantifié bu dëggu bi ci distracteur yi.
Ban lëf mooy njëkka defar jëmmu onde bu ñor ci Wav2Vec 2.0?
Benn pilu diisaay convolutionnel dafay kode forme onde bu ñor bi ci vecteur yu nëbbu yi laata ñuy maskeer ak Transformateur bi.
Ban audio bu néew la Wav2Vec 2.0 soxla ngir mëna jëfandikoo bu baax ci LibriSpeech?
Ak tàggat-yaram bu yaatu boole ci 10 simili ci done yuñ etikete, amna njuumte yu bari ci kàddu yu yéeme, di wane njariñu etiket bi.
Lan mooy wareefu téere kode biñ jàng ci Wav2Vec 2.0?
Téere kode bi dafay xayma limu représentation yu wéy yi ci benn ensemble bu am àpp ci ay unité yu wuute, di joxe ay target ngir objectif contrastif bi.