Xamme kàddu yu am tuuti
Whisper mooy sistemu xàmmee kàddu ci saa si bu OpenAI, muy soppi audio bi def ko bind ci lu ëpp 90 làkk.
Résumé
It matters because it brought near-human transcription quality to everyone for free, working robustly on accents, background noise, and technical jargon.
Plongeur bu xóot
OpenAI moo ko genne ci weeru septembre 2022, Whisper xeetu enkodeer-dekodeer la bu sukkandiko ci Transformatër, ñu tàggat ko ci 680,000 waxtuy làkk yu bari, audio yu bari liggéey yuñ jëlee ci web bi. Whisper wuute na ak sistem yu njëkk ya daan soxla done yu sell, am etiketu, Whisper mingi jàngee ci enregistrement yu baaxul yi ci àdduna, moo tax mu mëna dékku ak accents, bruit ak crosstalk. Benn model mooy yonnee transkripsioŋ bi, tekki làkk wi ci Àngle, ràññee làkk wi ak joxe waxtu. Dafay yobbu ci tolluwaayu 'tu ndaw' (parametre 39M) ba 'magg' (1.55B), may jëfandikukat yi ñu jënd ak jaay gaawaay ngir gëna jubal. Ndax diisaay yi dañu leen jox lisaas ci MIT, Whisper moo nekkoon yax giñ jagleel ñiy bind podcast yu bari, jumtukaayi kapsioŋ, ak aplikaasioŋu baat daanaka ci benn guddi.
Gis-gis xarala
Whisper dafay xaaj audio bi 30 seconde, mu soppi bu nekk ci spectrogram log-Mel (80 chaine de fréquence), ba noppi yóbbu ko ci encodeur Transformer. Decodeur bi dafay wax luy waaja am ci token yi ci anam wu autoregressivement, diko teg ci ay token yu yam yuy leeral liggéey bi (trancrire vs. traduire), làkk wi, ak ndax dafay génne timestamps. Bii multitask token-conditioning mooy trik bu am xel bi: benn ensemble poids dafay def liggéey yu bari lepp di aju ci token yu gaaw yiñ joxe ci ndoortelu decodage bi.
njeextalu pexe
Dugg ak yegg
Dafay gëna yombal jëfandikoo gi jaaraleko ci transkripsioŋ, nettali ak interfaasu baat.
Njëgg ak budget
Ekipu mejaa yi mën nañu yónnee audio bu leer ci anam wu gëna gaaw te seen xaalis gëna néew.
Gaawaay ak yaatuwaay
Sistem yiy jàkkarloo ak kiliyaan bi mën nañu def waxtaan ci anam wu gëna yaatu.
Ëlëgu xàmmee kàddu yu baat
Whisper moo jur ay derivatif yu gëna gaaw yu melni Whisper.cpp, whisper yu gëna gaaw, ak yeneen yuñ distiye yuy daw ci saa si ci telefon yi ak ordinatër portable yi. Xaarandil streaming bu gëna seere (latency bu woyof), diarization bu gëna baax ci waxkat yi boole ci, ak performance bu gëna am doole ci làkk yu néew doole yi. Lu IA audio bi ci aparey bi di magg, ay xeetu Whisper yu woyof yi dinañu am doole ci kapsiyoŋ yi, notu ndaje yi, ak jumtukaayi jëfandikoo gi lëmm ci biti, baña gaawa jeexal kumpa ci noonu lañuy méngoo ak njubte gi ci niir yi.
Doxal ci àdduna dëgg
Defar ci boppam ay mbind yuñ mëna seetee ak ay mbind ngir podcast yi ak wideo YouTube
Dafay doxal aplikaasioŋu notu ndaje yiy génne ay resumé ci Zoom wala Teams audio
Tekki janoo ci làkku jàmbur ci làkku angale ngir taskati xibaar
Tabax jumtukaayi jëfandikoo gi ñuy doxalee ci baat ak dikte ngir jëfandikukat yi mënu bind
Risk yi ak balustrade yi
Jëfandikoo baat ci anam wu jaarul yoon ak niru ak nit dafay gëna yokk sudee nanguwul.
Jaar-jaar mën na wàññeeku ci aksan yi, dialect yi wala barab yu bari xumbaay.
Audio synthetik mën nañu ko jaawale ak wax ju dëggu sudee amul etiket bu leer.
Roadmap ngir samp gi
Wutal ndigal bu leer ngir jàpp baat bi, klone ko ak jëfandikoowaat ko.
Saytu kalite ci kàddukat yu bari ak anam yu bari ci ginaaw.
Mandargal kañ la nit wara xoolaat wala nangu ay génne.
Etiketu audio synthetik te nga denc dokimaa ci fimu bawoo ngir mëna lim.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Whisper Speech Recognition quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Xamme yëg-yëg ci kàddu
Laaj yi ñuy faral di laaj
What is Whisper Speech Recognition?
Whisper mooy sistemu xàmmee kàddu ci saa si bu OpenAI, muy soppi audio bi def ko bind ci lu ëpp 90 làkk. Dafa am solo ndax dafa indi kalite transkripsioŋ bu jege nit ci ku nekk te doo fay, di liggéey bu baax ci aksan yi, bruit bi ci ginaaw, ak jargon teknik.
Lu tollu ci ñaata waxtu ci audio lañu tàggatee Whisper?
Whisper dañu ko tàggat ci lu tollu ci 680,000 waxtu ci làkk yu bari, audio yu bari liggéey yuñ dajale ci web bi, di done yu bari te wuute lool.
Lan mooy diggante bi Whisper di xayma ci audio bu ñor bi balaa encoder bi?
Whisper dafay soppi bépp paccu audio bu 30 sikon ci spectrogram log-Mel bu am 80 chaine, bi encodeur Transformateur bi di doxalee.
Naka la benn xeetu Whisper di defee liggéey yu bari lu ci melni transkripsioŋ ak tekki làkk?
Whisper dafay am ay token yuñ jagleel ci ndoortelu decodage bi koy wax làkk wi, liggéey bi, ak ndax dafa wara génne timestamps.
Ban arsitektir neuronal la Whisper di jëfandikoo?
Whisper enkodeer-dekodeer la: enkodeer bi dafay jàng spectrogram bi, dekodeer bi dafay defar ay token bind ci anam wuy dellu ginaaw.
Lan moo waral ñu jàpp ni Whisper moo gëna am doole buñu ko méngale ak sistem ASR yu njëkk ya?
Tàggat ci audio yu bari te wuute, ci àdduna dëgg (aksan, bruit, crosstalk) moo jox Whisper doole ju génn ci boyet bi te amul tuning ci domen bu nekk.