UMHLAHLANDLELA WE-AI womsindo

Ukuqashelwa Kwenkulumo Ehlebayo

I-Whisper isistimu ye-_AIU_PROTECTED_10__ ye-open-source-open-source yokuqaphela inkulumo eshintsha umsindo ube umbhalo ezilimini ezingama-90+.

2 amaminithi ukufundaIgcine ukubuyekezwa

Uhlolojikelele

It matters because it brought near-human transcription quality to everyone for free, working robustly on accents, background noise, and technical jargon.

I-Deep Dive

Ikhishwe ngu-OpenAI ngo-September 2022, i-Whisper iyimodeli yesikhiphi khodi esisekelwe ku-Transformer eqeqeshwe amahora angu-680,000 omsindo wezilimi eziningi, wemisebenzi eminingi osulwe kuwebhu. Ngokungafani namasistimu angaphambili ayedinga idatha ehlanzekile, enelebula, i-Whisper ifunde ekurekhodweni okungcolile komhlaba wangempela, okuyenza ikwazi ukumelana nokuphimisela, umsindo, kanye ne-crosstalk. Imodeli eyodwa iphatha ukuloba, ukuhumushela kusiNgisi, ukuhlonza ulimi, nokugxiviza isikhathi. Ithunyelwa ngosayizi ukusuka 'kokuncane' (39M amapharamitha) kuya 'okukhulu' (1.55B), okuvumela abasebenzisi ukuthi bahwebe ngesivinini ukuze kube nokunemba. Ngenxa yokuthi izisindo zinelayisensi evulekile ngaphansi kwe-MIT, i-Whisper yaba umgogodla ozenzakalelayo wababhali be-podcast abaningi, amathuluzi wamagama-ncazo, nezinhlelo zokusebenza zezwi cishe ngobusuku obubodwa.

I-Technical Insight

I-Whisper ihlukanisa umsindo ube izingcezu zamasekhondi angu-30, iguqule ngalinye libe i-spectrogram ye-log-Mel (amashaneli angama-80), futhi iwuphakele kusishumeki seTransformer. Idekhoda ibe isibikezela amathokheni ombhalo ngokuzenzakalelayo, eqondiswa amathokheni akhethekile acacisa umsebenzi (loba uma uqhathanisa nokuhumusha), ulimi, kanye nokuthi kufanele kukhishwe izitembu zesikhathi yini. Lokhu kulungiswa kwethokheni yemisebenzi eminingi kuyisu elihlakaniphile: isethi eyodwa yezisindo yenza imisebenzi eminingi kuye ngamathokheni asheshayo ahlinzekwe ekuqaleni kokukhipha amakhodi.

I-Strategic Impact

Finyelela futhi ufinyelele

Ithuthukisa ukufinyeleleka ngokuloba, ukulandisa, nezixhumi ezibonakalayo zezwi.

Izindleko kanye nesabelomali

Amaqembu emidiya angathumela umsindo opholishiwe ngokushesha ngamabhajethi amancane.

Isivinini nesikali

Amasistimu abhekene nekhasimende angacubungula ukusebenzelana okukhulunyiwe ngesilinganiso esikhulu.

Ikusasa Lokuqashelwa Kwenkulumo Ehlebayo

I-Whisper ivuse igagasi lokuphuma kokunye okusheshayo njenge-Whisper.cpp, izinguqulo ezihlebayo ezisheshayo, nezixutshiwe ezisebenza ngesikhathi sangempela kumafoni namakhompyutha aphathekayo. Lindela ukusakaza okuqinile (ukubambezeleka okuphansi) okuhlukile, ukudayela kwesipikha okungcono okumataniswe eduze kwakho, nokusebenza okuqinile ezilimini zezinsizakusebenza eziphansi. Njengoba i-AI yomsindo ekudivayisi ikhula, amamodeli esitayela se-Whisper angasindi azonikeza amazwibela abukhoma, amanothi omhlangano, namathuluzi okufinyeleleka angaxhunyiwe ku-inthanethi ngokuphelele, alondoloze ubumfihlo kuyilapho efanisa ukunemba kwebanga lamafu.

Ukuqaliswa Komhlaba Wangempela

Ukukhiqiza ngokuzenzakalela okulotshiweyo okuseshekayo namagama-ncazo ama-podcast namavidiyo we-YouTube

Inika amandla izinhlelo zokusebenza zamanothi omhlangano abukhoma ezikhiqiza izifinyezo ezivela kumsindo we-Zoom noma weThimba

Ukuhumusha izingxoxo zolimi lwangaphandle ngokuqondile embhalweni wesiNgisi wezintatheli

Ukwakha amathuluzi okufinyelela alawulwa ngezwi kanye nokubizela abasebenzisi abangakwazi ukuthayipha

Izingozi & Guardrails

Ukusetshenziswa kabi kwezwi kanye nezingozi zokuzenza ongeyena ziyanda uma imvume ingekho.

Ukunemba kungase kwehle kuzo zonke izinhlobo zokuphimisela, izilimi zesigodi, noma izindawo ezinomsindo.

Umsindo wokwenziwa ungenziwa iphutha njengenkulumo eyiqiniso ngaphandle kokulebula okucacile.

Ukuqalisa Umhlahlandlela

1

Thola imvume esobala yokuthwebula izwi, ukuhlanganisa, nokusebenzisa kabusha.

2

Ikhwalithi yokuhlola kuzo zonke izipikha nezimo zangemuva.

3

Chaza ukuthi kunini lapho umuntu kufanele abuyekeze noma agunyaze okuphumayo.

4

Lebula umsindo wokwenziwa futhi ugcine amarekhodi atholakalayo ukuze aziphendulele.

Qhubeka Uhlole

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Whisper Speech Recognition quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Qala imibuzo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Umhlahlandlela olandelayo

Ukuqashelwa Kwemizwa Yenkulumo

Imibuzo evame ukubuzwa

What is Whisper Speech Recognition?

I-Whisper isistimu ye-_AIU_PROTECTED_10__ ye-open-source-open-source yokuqaphela inkulumo eshintsha umsindo ube umbhalo ezilimini ezingama-90+. Ibalulekile ngoba ilethe ikhwalithi yokuloba ecishe ifane neyomuntu kuwo wonke umuntu mahhala, isebenza ngamandla ngamaphimisela, umsindo ongemuva, nejagoni yobuchwepheshe.

Cishe zingaki amahora omsindo i-Whisper aqeqeshwe ngawo?

U-Whisper waqeqeshwa cishe amahora angu-680,000 omsindo wezilimi eziningi, wemisebenzi eminingi oqoqwe kuwebhu, isethi yedatha enkulu ngokungavamile nehlukahlukene.

Isiphi isethulo esimaphakathi i-Whisper esibala kusukela kumsindo ongahluziwe ngaphambi kwesishumeki?

I-Whisper iguqula isiqeshana ngasinye somsindo esingamasekhondi angu-30 sibe i-spectrogram ye-log-Mel engu-80, ecutshungulwa isifaki khodi se-Transformer.

Imodeli ye-Whisper eyodwa yenza kanjani imisebenzi eminingi efana nokulotshwa nokuhumusha?

Hleba izimo kumathokheni akhethekile ekuqaleni kokukhipha amakhodi akutshela ulimi, umsebenzi, nokuthi zikhiphe izitembu zesikhathi yini.

Iyiphi i-neural architecture iyonke esetshenziswa u-Whisper?

I-Whisper iyi-Transformer-encoder-decoder: isifaki khodi sifunda i-spectrogram futhi isiqophi khodi sikhiqiza amathokheni ombhalo ngokuzenzakalelayo.

Kungani i-Whisper ibhekwa njengeqinile uma iqhathaniswa nezinhlelo ze-ASR zangaphambilini?

Ukuqeqeshwa ngenani elikhulu lomsindo ohlukahlukene, womhlaba wangempela (izimpiko, umsindo, inkulumo-mpikiswano) kunikeze i-Whisper ukuqina okuqinile ngaphandle kwebhokisi ngaphandle kokushuna kwesizinda ngasinye.