Xeetu jamonoy lëkkaloo
Connectionist Temporal Classification (CTC) ab fonction perte la ak ab pexem dekode buy may reso neuronal yi ñu soppi ab audio bu gudd ci bind te kenn du def loxo ngir méngale son bu nekk ak araf bu nekk.
Résumé
It made end-to-end speech recognition practical by solving the brutal alignment problem.
Plongeur bu xóot
Kaddu yi dañu jaxasoo: baat 'nanga def' mën na dem ba 40 kadre audio, te kenn mënul wax ban kadre mooy 'h' bi. CTC, bi Alex Graves dugal ci 2006, dafay moytu lii. Reseau bi dafay genne ay probabilite ci kaw araf yi (ak benn jeton 'blank') ngir kadre bu nekk. CTC dafay màndargaal njubluwaay bu baax ni bépp yoon kaadar-ci-kadre buy wàcci ci mbind miñ bëgga topp ginaaw ñaari sàrt: boole araf yu bari, ba noppi efaase barab yu amul dara. Ndax yoon yu bari dañuy méngoo ak benn mbind, CTC dafay boole probabilite yi ci ñoom ñépp ci jëfandikoo algorithm buy prograam dinaamik (algorithm biy jëm kanam-ci ginaaw) ba noppi di tàggat reso bi ngir mëna yokk limu mëna am. Token bu amul dara mooy pexe bu am xel biy may model bi mu wax 'amul lenn lu bees fii' ba noppi tàqale baamtu yu dëggu yi melni double-L ci 'nanga def'.
Gis-gis xarala
Li gëna am solo ci CTC mooy moom boppam ci anam wu am sart: buñu sukkandikoo ci audio bi, génnekaayu kadre bu nekk dañu koy seetlu moom boppam, amul benn modelu làkk buñ lakk ci. Loolu dafay tax summasioŋ bi jëm kanam-ci ginaaw nekk lu yomb waaye loolu dafay tekki ni CTC dafay génne ay génne yu gëna am doole (li gëna bari ci blank, ak ay spikes ci modelu ak màndarga yu ñaw). Seetug beam ak LM buñ boole, ñu koy faral di woowe dekodaasu prefix-beam, dafay gëna baaxal njubte gi ci dekodaasu argmax bu bëgg lu bari.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu Xaajale Temporal Koneksionist
CTC mingi wéy di nekk fasu liggéey, rawatina ci wàllu streaming ak latency bu néew, te ñu ngi koy gëna jëfandikoo ngir ñàkkaale ci wetu bàyyi xel wala mébetu transducer ci xeetu hybrid 'CTC / bàyyi xel'. Xaarandi CTC mu wéy di nekk bànxaasu dekodeer bu gaaw te yomb ci biir sistemu wax yu gëna mag, ak nekk motëru njubluwaay ci ginaaw jumtukaayi njubluwaay yu forse yuy timestamp kàddu yi. Encoder yiy saytu seen bopp yu melni wav2vec 2.0 dañu leen di faral di defar bu baax ak boppu CTC.
Doxal ci àdduna dëgg
Reglage bu baax wav2vec 2.0 ak boppu CTC ngir tabax xeetu kàddu-ci-bind bu ubbeeku ci làkk wu néew doole
Defar ay timbre yu tollu ci baat ak fonem ngir ay sous-titre ak karaoke jaaraleko ci CTC
Sous-titre ci aparey bi modelu CTC buy dawal di bind ak latency bu néew
Xamme bind ak loxo, fu CTC di jàng benn liiñ bu cursif te du njëkka xaaj araf yi
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Connectionist Temporal Classification quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Xeetu music
Laaj yi ñuy faral di laaj
What is Connectionist Temporal Classification?
Connectionist Temporal Classification (CTC) ab fonction perte la ak ab pexem dekode buy may reso neuronal yi ñu soppi ab audio bu gudd ci bind te kenn du def loxo ngir méngale son bu nekk ak araf bu nekk. Dafa def xàmmee kàddu ci njeexte ba ci njeexte ndax saafara jafe-jafe jubluwaay bu metti bi.
Ban jafe-jafe bu mag lañu tëral ngir saafara CTC ngir xàmmee kàddu yi?
CTC dafay may reso bi mu tàggat ci (audio, bind) ñaar te kenn duko wax ban kadre moo méngoo ak ban araf, loolu mooy saafara jafe-jafe alignment bi.
Lan lañuy jëfandikoo token 'blank' bi ci CTC?
Jeton bu amul dara dafay may model bi mu génne 'dara lu bees' ci benn kaadar, te, ci anam wu ñaaw, dafay tàqale baamtu yu dëggu yi melni ñaari-L ci 'nanga def' ak baamtu yu daanu.
naka la CTC di xaymaa perte bi ci transkripsioŋ biñ bëgga am?
CTC dafay jëfandikoo algorithm buy prograam dinaamik ci kanam ak ci ginaaw ngir boole probabilite yi ci bepp yoon buy méngoo ak mébet bi ginaaw ñu boole baamtu yi ak efaase ay bërëb yu amul dara.
Lan mooy ñaari sàrt yi CTC di jëfandikoo ngir soppi yoonu kaadar ci bind bu mujj?
Benn yoon bu ñor ci kaadar bu nekk dañu koy dekode ci boole ñaari araf yu dendoo ba noppi dindi bépp token bu amul dara.
Ban xalaat bu yomb la CTC standard def ci ay génnam?
CTC dafay xalaat moomel sa bopp bu nekk ci kaadar bi, loolu mooy tax summasioŋ bi yomb waaye loolu dafay tekki ni amul benn xeetu làkk buñ tabax ci biir.