GUIDE IA Audio

Jumtukaayu xàmmee kàddu Kaldi

Kaldi jumtukaay la bu amul fayda, open-source moo nekkoon platform gëstu bi gëna am solo ngir tabax sistem yuy xàmmee kàddu.

2 simili jàngDañu mujjee yeesal

Résumé

It matters because for nearly a decade it was the go-to foundation for academic and industrial ASR work.

Plongeur bu xóot

Kaldi, mi génn ci 2011 te Daniel Povey moo ko jiite, ñu bind ko ci C++ ak rëset yuñ boole ci script bash ak Perl. Tabax na ci kaw gasoduc ASR bu yàgg bi: génne ci màndarga akustik (MFCCs wala filtrebanks), model son fonem ak Model Mixture Gaussian wala, ci ganaw, reso neuronal yu xóot, ba noppi boole model akustik, lexicon waxin, ak model làkk ci benn graphe buñ mëna seetee. Tanneefam ci xaralaam mooy jëfandikoo ay transducer yu am pondération (WFSTs) yu bawoo ci bibliothèque OpenFST ngir boole bépp balluwaayi xam-xam ci benn graphe decodage. Kaldi dafa yónnee ay 'rëset' ngir ay done yuñ miin lu ci melni Switchboard, Librispeech, ak Wall Street Journal, loolu tax gëstukat yi mëna génne ay resultaa yu bees. Nekk na royuwaay bi ñuy jëfandikoo ngir méngale sistem yu bees yi.

Gis-gis xarala

Li gëna am solo ci Kaldi mooy boole ñeenti WFST ci benn graf bu tuddu HCLG: H dafay xayma neural-net wala GMM ci telefon yi aju ci contexte, C dafay jëfandikoo contexte fonetik (triphones), L mooy waxin lexicon biy xayma telefon yi ci baat yi, G mooy modelu làkk wi. Yokkateg transducer yooyu ak gëna mëna jëfandikoo resultaa bi dafay defar benn graphe bu decoder bi di seet ak algorithm Viterbi buñ dagg ci limyéer, mu soppi kadre audio yi ci anam wu gëna woyof ci toppalante baat yi.

njeextalu pexe

Dugg ak yegg

Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.

Njëgg ak budget

Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.

Gaawaay ak yaatuwaay

Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.

Ëlëgu jumtukaayu xàmmee kàddu Kaldi

Xeetu HMM-DNN hybrid bu Kaldi, dañu ko wecci bu baax ci xeetu neuronal yu mujj ba ci njeexte, yuy méngale audio bi ak bind bi. Projet bi Daniel Povey topp, k2 (ak ecosystem Icefall ak Lhotse), dafay xalaat xalaati WFST yu Kaldi ci PyTorch ak ay otomat yu am àpp yuñ mëna wuutale. Xaarandil ni Kaldi ci boppam dina des royuwaayu taarix ak jumtukaayu jàngale, ci noonu la ay mbokkam ci konseptioŋ boole dekodage buñ yamale bu yàgg ak xeetu akustik yu bees yu lalu ci transformatër ak yu ñuy saytu seen bopp.

Doxal ci àdduna dëgg

Laboratoire yu mag yi dañuy génne Librispeech ak Switchboard ngir gëna dëggal gëstub model akustik bu bees

Tabax sistemu komandu baat ngir làkk yu néew doole wala yu néew doole yi jëfandikoo rëset yu Kaldi

Forse audio ak transcription ngir linguistic, defar ay done, ak waxtu sous-titre

Seetug baat bu teel ak backends diktaasioŋ ci liggéeyukaay yi balaa xeetu end-to-end di màgg

Risk yi ak balustrade yi

Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.

Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.

Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.

Roadmap ngir samp gi

1

Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.

2

Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.

3

Mandargal kañ la nit wara xoolaat wala nangu ay génne.

4

Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.

Weyal di banneexu

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Kaldi Speech Recognition Toolkit quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tambalil quiz

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Gis bi ci topp

Xamme kàddu yu am tuuti

Laaj yi ñuy faral di laaj

What is Kaldi Speech Recognition Toolkit?

Kaldi jumtukaay la bu amul fayda, open-source moo nekkoon platform gëstu bi gëna am solo ngir tabax sistem yuy xàmmee kàddu. Dafa am solo ndax lu tollu ci fukki at ci ginaaw la nekkoon fundaasioŋ bi ñuy jaar ngir liggéey ASR ci daara yu kawe yi ak ci usine yi.

Ban làkku prograam lañu bind core Kaldi?

Kaldi core bi dañu ko bind ci C++ ngir mëna liggéey, ak script bash ak Perl yuy orkestre tàggat ak dekodaasu rëset yi.

Ban jumtukaayu math la Kaldi di jëfandikoo ngir boole model akustik bi, lexicon bi, ak modelu làkk wi ci benn graphe decodage?

Kaldi dafay boole WFST yi ci bibliotek OpenFST ci benn graf HCLG bu dekodeer bi di seet.

Kan mooy ki njëkka sos ak jiite projet Kaldi bi?

Daniel Povey moo jiite defar Kaldi, ñu njëkka génne ko ci 2011, ci ganaw ga mu tàmbali projet k2 bi ci topp.

Ci gasoduk Kaldi bu yàgg bi, lan lañu njëkka jëfandikoo ngir modele GMM yi (Modèlu njaxasu Gaussian)?

GMMs yi dañu wane ni akustik bi di doxee ci fonem yi balaa reso neuronal yu xóot yi di leen wecci ci sistem hybrid yi.

Lan mooy turu ecosystem bu bees bi lalu ci PyTorch ci Kaldi?

k2, ak Icefall ak Lhotse, dañuy indiwaat xalaati Kaldi ci anam wu mëna wuutale, xaritoo ak PyTorch.