IA ci tekki làkku màndarga
Tekki làkku màndarga IA dafay jëfandikoo gis-gis ordinatër ak jàngu masin ngir soppi làkki màndarga yu melni ASL ci bind wala wax, yenn saa muy soppiku.
Résumé
It matters because it can open everyday communication between Deaf and hearing people without a human interpreter present.
Plongeur bu xóot
Làkku màndarga yu melni Làkku màndarga bu Amerique (ASL) ak Làkku màndarga bu Grande Bretagne (BSL) làkk yu mat sëkk lañu yu am seen nàfar, duñu làkku màndarga yuñ wax ci Àngle. Sistemu tekki làkku IA dafay jàpp jëmmu loxo yi, yëngu yi, barab yi, jubluwaayu loxo yi, ak màrker yu dul loxo yu melni yëkkati bët yi ak jëmmu gémmiñ yiy soppi luñuy tekki. Kamera yi wala kaptër yu xóotaayu yi dañuy dugal wideo ci modelu xayma pose (dafay faral di nekk MediaPipe Holistic) yuy génne poñ yu am solo yi, modelu toppalante bi daal di koy méngale ak gloss wala frase. Jafe-jafe yi gëna tar mooy siñe bu wéy te amul ay pexe yu leer ci baat yi, dialect yu gox yi, classifier yiy wane mbir yi ci barab, ak ñàkkum done yu bari yuñ bind. Demo yu bari dañuy yam ci màndarga yu wuute, duñu waxtaan bu neex.
Gis-gis xarala
Benn pipeline bu ñuy jëfandikoo dafay njëkka def estimaasioŋ ngir soppi kadre bu nekk ci 2D wala 3D keypoints ngir loxo, kanam, ak yaram, sànni pixel yu ñor ngir privacy ak gaawaay. Benn model temporel bu melni transformateur wala RNN, ñu koy faral di tàggat ci Classification Temporal Connectionist (CTC), dafay méngale poñ yu am solo yi ak etiketu glos yi te soxlawul ay tegtal kaadar par kaadar. Ñaareelu pacc bi mooy soppi gloss yi ci làkk wi ñuy wax ci làkk wiñ wax.
njeextalu pexe
Tabax tànneef
Ni ñuy jëmmale aplikaasioŋ bi mooy wane ndax IA dafay gëna baaxal njariñ yi.
Ekip ak def liggéey
Integraasioŋ bu baax ci def liggéey dafay jur njariñu liggéey bu jëfandikukat yi mëna wóolu.
Risk ak kaaraange
Jëfandikoo bu jaar yoon dina wàññi coono coppite ak risku samp gi.
Ëlëgu IA ci Tekki làkku màndarga
Gaawaay a ngi aju ci ay done yu gëna mag, yuñ tabax ci askan wi lu melni How2Sign ak boole ci ay màrker yu dul manuel yu sistem yi fi nekk di faral di ñàkk. Xaarandil lëkkaloo bu gëna dëgër ak avatar yiy siñewaat, xeetu aparey yi ngir nëbbëtu, ak ay benchmark yuñ yamale. Gëstukat yi dañuy gëna fësal co-design ak askanu tëx yi suko defee jumtukaay yi di jàppale te baña wecci tekkikatu nit ñi, rawatina ci barab yu am solo yu melni medsin ak yoon fu njuumte yi di jur njeexital yu dëggu.
Doxal ci àdduna dëgg
Aplikaasioŋu tablet bu nekk ci dalal nit ñi ci hopitaal bi, di xàmmee laaj yi malaad bu tëx bi siñe, ba noppi di wane mbind yi liggéeykat yi bind
Siñe avatar yiy joxe yëgle ci gaaraasu saxaar wala aéroport ci wideo ASL wala BSL
Jumtukaayi njàngale yuy may jàngat yi ci saasi ñu xam ndax seen jëmmu loxo ak seeni yëngu méngoo nañu ak màndarga biñ bëgga
Prototype yu am sous-titre ci jamono dëgg, yuy tekki siñekat bi ci woote wideo ci sous-titre yu làkk wiñ wax
Risk yi ak balustrade yi
Otomatise procédure bu yàqu mën na yokk jafe-jafe yi fi nekk.
Ekip yi mën nañu otomatise lu ëpp ba noppi dindi àtteb nit ñi.
Kalite mën na wàññeeku sudee duñu wéy di jàngat li ñuy génne.
Roadmap ngir samp gi
Defal kàrt ni liggéey bi di doxee leegi nga ràññee jéego bi gëna am jafe-jafe.
Mandargal barabu saytu nit balaa otomatisasioŋ bu mat sëkk.
Taggat jëfandikukat yi ci ay laaj, yooni eskalaasioŋ ak seeni sàrti kalite.
Toppal njariñu niveau liggéey bi ngir firndeel valeur buy wéy.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the AI in Sign Language Translation quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
IA ci Decifrement làkk yu yàgg
Laaj yi ñuy faral di laaj
What is AI in Sign Language Translation?
Tekki làkku màndarga IA dafay jëfandikoo gis-gis ordinatër ak jàngu masin ngir soppi làkki màndarga yu melni ASL ci bind wala wax, yenn saa muy soppiku. Dafa am solo ndax mën na ubbi jokkoo bis bu nekk ci diggante tëx yi ak ñiy dégg te amul kenn ku leen di tekki.
Lan moo waral tekki làkku màndarga moo gëna tar méngale ay yëngu ak kàddu Àngle?
Làkk yu melni ASL dañu am grammaire bu wuute, structure spatial, ak ni ñuy toppatoo baat yi, kon tekki làkk dafay laaj modelu làkk bu dëggu, te baña seet geste-to-word.
Luy 'marker yudul loxo' ci làkku màndarga?
Yékkati bët, tiim bopp, ak jëmmu gémmiñ mën nañu soppi wax ci laaj wala soppi lu muy tekki, kon IA dafa wara topp kanam gi, baña topp loxo yi kese.
Lan mooy xayma pose ci pipeline tekkig màndarga?
Xayma pose dafay dindi coordonnée keypoint ci kaadar bu nekk, loolu mooy tax model bi liggéey ak done yu ndaw ci barabu pixel yu ñor yi.
Lan moo waral siñe bu wéy lu jafe la ci IA?
Ci siñe bu neex, siñaal yi dañuy booloo te amul benn àpp bu leer, tax segmentation ak alignment jafe, moo tax ñuy jëfandikoo pexe yu melni CTC.
Lan moo waral eksper yu bari di digal ñu bokk defar jumtukaay yii ak askanu tëx yi?
Li askanu tëx yi di def dafay moytu sistem yu jaarul yoon wala yu amul benn yëg-yëg ci cosaan ak aada, ba noppi denc jumtukaay yi ñuy jàppale, duñu wuutu tekkikatu nit ñi.