UMHLAHLANDLELA WOKUSEBENZA

I-AI ku-Real-time Caption for the Deaf

I-AI iguqula inkulumo ebukhoma ibe umbhalo osesikrinini ngesekhondi, inikeze abantu abayizithulu nabangezwa kahle ukufinyelela ngokushesha ezingxoxweni, ezifundweni, nasemihlanganweni.

Uhlolojikelele

I-AI iguqula inkulumo ebukhoma ibe umbhalo osesikrinini ngesekhondi, inikeze abantu abayizithulu nabangezwa kahle ukufinyelela ngokushesha ezingxoxweni, ezifundweni, nasemihlanganweni. Lokhu kubalulekile ngoba i-stenographer yabantu ayitholakali futhi iyabiza, ishiya iningi lenkulumo yansuku zonke ingenamagama-ncazo.

I-AI Ekuqoshweni Kwesikhathi Sangempela Kwezithulu igxile ekusetshenzisweni okungokoqobo: ukuguqula ikhono lemodeli libe ukuhamba komsebenzi okuthembekile kwansuku zonke okuletha inani elilinganisekayo.

I-Deep Dive

I-automatic speech recognition (ASR) iguqule amagama-ncazo asuka kusevisi ayisipesheli, ebizayo awenza isici noma ubani angasivula. I-Live Transcribe ka-Google namagama-ncazo abukhoma e-Android, amazwibela abukhoma e-Apple, i-Otter.ai, namagama-ncazo okuthi Zoom/Teams aloba inkulumo ngokushesha, ngokuvamile ekudivayisi. Amasistimu esimanje akhelwe phezu kwamamodeli afana ne-Whisper handle accents, umsindo ongemuva, nezipikha eziningi ezingcono kakhulu kunezakudala. Umphakathi wezithulu uhlukanisa phakathi kwalokhu kanye ne-CART (Communication Access Real-time Translation) ehlinzekwa ngamagama-ncazo abantu, abasazuza ukunemba okuphezulu nokusingatha kangcono i-crosstalk, jargon, namagama afanelekile. Amagama-ncazo e-AI manje aselungile ngokwanele kuzilungiselelo ezivamile neziningi zobungcweti, kodwa izinga eligolide lezomthetho, zezokwelapha, nezimo zemfundo lihlala lingamazwibela ahlelelwe umuntu noma ahlelwe ngumuntu ngoba amaphutha lapho anemiphumela yangempela.

I-Technical Insight

Amaphayiphi e-ASR aguqula umsindo ube umbhalo ngokwenza imephu amaza omsindo abe amafonimu namagama, ngokuya ngokuya kusetshenziswa amanethiwekhi e-neural asuka ekupheleni aye ekupheleni (njengama-transformer) abikezela amagama ngokuqondile emsindweni. Amazwibela wesikhathi sangempela asakaza ingxenye yemiphumela futhi ayibuyekeze njengoba kungena umongo owengeziwe—okwenza amagama-ncazo ngezinye izikhathi 'abhale kabusha' igama ngemva kwesikhashana. Ukubambezeleka, ukudayela kwesipikha (ukulebula ukuthi ubani utheni), kanye nokubikezela kwezimpawu zokuloba yizinkinga zobunjiniyela obuqinile; ukunemba kukalwa nge-Word Error Rate (WER).

Ukufundisa I-AI Ekuqophelweni Kwangempela Kwabantu Abangezwa

I-AI iguqula inkulumo ebukhoma ibe umbhalo osesikrinini ngesekhondi, inikeze abantu abayizithulu nabangezwa kahle ukufinyelela ngokushesha ezingxoxweni, ezifundweni, nasemihlanganweni. Lokhu kubalulekile ngoba i-stenographer yabantu ayitholakali futhi iyabiza, ishiya iningi lenkulumo yansuku zonke ingenamagama-ncazo. I-AI Ekuqoshweni Kwesikhathi Sangempela Kwezithulu igxile ekusetshenzisweni okungokoqobo: ukuguqula ikhono lemodeli libe ukuhamba komsebenzi okuthembekile kwansuku zonke okuletha inani elilinganisekayo. Ukuze wakhe ukuqonda okujulile, phatha i-AI kokuthi I-Real-time Captioning for the Deaf njengemodeli yokusebenza, hhayi isici esisodwa: chaza imiphumela efiselekayo, ucacise ukucabanga, futhi uhlukanise lokho isistimu engakwenza ngokwethembeka kulokho okusadinga ukwahlulela kochwepheshe.

Empeleni, amaqembu aqinile asebenzisa i-AI Ekuqoshweni Kwesikhathi Sangempela Kwezithulu agxila emiphumeleni yokugeleza komsebenzi, hhayi amademo angamamodeli, futhi achaza izindawo zokuhlola abantu kusenesikhathi. Babhala imibandela yempumelelo ecacile, ukuhlola okuqhathaniswa nedatha engokoqobo nokugeleza komsebenzi, futhi baphindaphinde ngokusekelwe kumaphethini okuhluleka aqashiwe esikhundleni sokuwina kwebhentshimakhi yesikhathi esisodwa. Yilapho ukuqonda kwethiyori kuguquka kube amandla ahlala njalo kuwo wonke umkhiqizo, inqubomgomo, kanye nokusebenza.

Idizayini yezinga lohlelo lokusebenza inquma ukuthi i-AI iyathuthukisa yini imiphumela yangempela. Ngesikhathi esifanayo, Ukuzenzakalela inqubo ephukile kungakhulisa izinkinga ezikhona. Indlela eqine kakhulu iwukuhlanganisa isivinini sokuhlola nesiyalo sokuphatha: qhuba abashayeli bezindiza, bamba ubufakazi, ushicilele amalogi ezinqumo, futhi ubuyekeze izivikelo ngokuqhubekayo njengoba imodeli yokuziphatha, okulindelwe ngabasebenzisi, kanye nezimfuneko zokulawula zishintsha.

I-Strategic Impact

Idizayini yezinga lohlelo lokusebenza inquma ukuthi i-AI iyathuthukisa yini imiphumela yangempela.

Idizayini yezinga lohlelo lokusebenza inquma ukuthi i-AI iyathuthukisa yini imiphumela yangempela. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ukuhlanganiswa okuhle kokuhamba komsebenzi kudala izinzuzo zokukhiqiza abasebenzisi abangazethemba.

Ukuhlanganiswa okuhle kokuhamba komsebenzi kudala izinzuzo zokukhiqiza abasebenzisi abangazethemba. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Amacala okusetshenziswa ahlelwe kahle anciphisa ukukhathala okushintshile kanye nengozi yokuqaliswa.

Amacala okusetshenziswa ahlelwe kahle anciphisa ukukhathala okushintshile kanye nengozi yokuqaliswa. Ekusetshenzisweni kwekhwalithi ephezulu, lokhu kuhunyushwa emithethweni yokusebenza elinganisekayo, imingcele yobunikazi, nemikhuba yokubuyekeza ephindelelayo ukuze amaqembu akwazi ukukala ukuzethemba esikhundleni sokukala ukungaqondakali.

Ikusasa le-AI Ekubhalweni Kwangempela Kwezithulu

Lindela amagama-ncazo ukuze asuke esikrinini sefoni aye ezingilazini ze-AR ezibonisa umbhalo eduze nesipikha, okunciphisa isidingo sokubheka eceleni. Ukulebula kwesipika, ukuqina komsindo, nokuhumusha bukhoma kuzo zonke izilimi kuzoqhubeka kuthuthuka, futhi ukuhumusha okuvela olimini lwezandla kuhlose ukunikeza inkulumo njengezithombe noma ukuhumusha ukusayina kubuyele embhalweni. Igebe eliqhubekayo liwukulingana kokunemba ne-CART yomuntu kuzilungiselelo zenani eliphezulu—ukuyivala, kanye nokuvikela ubumfihlo lapho umsindo ucutshungulwa emafini, kuyizinselele eziyinhloko.

Ukuqaliswa Komhlaba Wangempela

Ivula Okushuthwe Bukhoma kwe-Android ukuze ufunde noma yimuphi umsindo noma ividiyo edlala ocingweni, noma ungaxhunyiwe ku-inthanethi.

Ukusebenzisa amagama-ncazo e-Otter.ai noma ye-Zoom ukuze umsebenzi oyisithulu alandele umhlangano womsebenzi obukhoma ngesikhathi sangempela.

Umfundi osebenzisa i-Live Transcribe kuthebhulethi ukufunda isifundo sikaprofesa njengoba sikhulunywa.

Ukubhala amazwibela ocingweni noma ingxoxo yomuntu mathupha endaweni yokudlela enomsindo ngohlelo lokusebenza lwe-smartphone.

Amaphethini Okusebenzisa

I-AI ku-Real-Time Caption for the Deaf in practice

Ivula Okushuthwe Bukhoma kwe-Android ukuze ufunde noma yimuphi umsindo noma ividiyo edlala ocingweni, noma ungaxhunyiwe ku-inthanethi.

Ukuvula Okushuthwe Bukhoma kwe-Android ukuze ufunde noma yimuphi umsindo noma ividiyo edlala ocingweni, ngisho namaThimba angaxhunyiwe ku-inthanethi ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-AI ku-Real-Time Caption for the Deaf in practice

Ukusebenzisa amagama-ncazo e-Otter.ai noma ye-Zoom ukuze umsebenzi oyisithulu alandele umhlangano womsebenzi obukhoma ngesikhathi sangempela.

Ukusebenzisa amagama-ncazo e-Otter.ai noma ye-Zoom ukuze umsebenzi oyisithulu alandele umhlangano womsebenzi obukhoma ngesikhathi sangempela Amaqembu ngokuvamile athola imiphumela engcono lapho echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka kwabantu yamacala abucayi, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-AI ku-Real-Time Caption for the Deaf in practice

Umfundi osebenzisa i-Live Transcribe kuthebhulethi ukufunda isifundo sikaprofesa njengoba sikhulunywa.

Umfundi osebenzisa i-Live Transcribe kuthebhulethi ukuze afunde isifundo sikaprofesa njengoba sikhulunywa Amathimba ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yabantu yamakesi asemaphethelweni, futhi elandelela kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

I-AI ku-Real-Time Caption for the Deaf in practice

Ukubhala amazwibela ocingweni noma ingxoxo yomuntu mathupha endaweni yokudlela enomsindo ngohlelo lokusebenza lwe-smartphone.

Ukusho amazwibela ocingweni noma ingxoxo yomuntu mathupha endaweni yokudlela enomsindo ngohlelo lokusebenza lwe-smartphone Amaqembu ngokuvamile athola imiphumela engcono uma echaza ikhwalithi ephezulu ngaphambili, egcina indlela yokukhuphuka yomuntu yamakesi asemaphethelweni, futhi alandelele kokubili izinzuzo zokukhiqiza nezindleko zamaphutha ngokuhamba kwesikhathi.

Izingozi & Guardrails

!

Ukuzenzakalela inqubo ephukile kungakhulisa izinkinga ezikhona.

!

Amaqembu angase azenze ngokuzenzakalelayo futhi asuse ukwahlulela komuntu okudingekayo.

!

Ikhwalithi ingakhukhuleka uma okuphumayo kungahlolwa ngokuqhubekayo.

Ukuqalisa Umhlahlandlela

1

Imephu yokuhamba komsebenzi kwamanje futhi uhlonze isinyathelo sokungqubuzana okuphezulu kakhulu.

Imephu yokuhamba komsebenzi kwamanje futhi uhlonze isinyathelo sokungqubuzana okuphezulu kakhulu. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

2

Chaza izindawo zokuhlola abantu ngaphambi kokuzenzakalela okugcwele.

Chaza izindawo zokuhlola abantu ngaphambi kokuzenzakalela okugcwele. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

3

Qeqesha abasebenzisi ngokwaziswa, izindlela zokukhuphuka, namazinga ekhwalithi.

Qeqesha abasebenzisi ngokwaziswa, izindlela zokukhuphuka, namazinga ekhwalithi. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

4

Landelela imiphumela yezinga lomsebenzi ukuze uqinisekise inani eliqhubekayo.

Landelela imiphumela yezinga lomsebenzi ukuze uqinisekise inani eliqhubekayo. Phatha isinyathelo ngasinye njengesango lobufakazi: uma imibandela ingafinyelelwa, misa ukukhishwa, vala igebe, bese unweba ukusetshenziswa.

Qhubeka Uhlole