Byagenze bite
. Muri Gboard, umukoresha arashobora gusinya aho basanzwe bandika, harimo mugihe ushakisha kurubuga cyangwa gutegura ubutumwa cyangwa inyandiko. Muri Live Transcript, ikigenewe gukoreshwa ni ugusinya igisubizo mugihe cyo kuganira utasubiye mucyongereza cyanditse.
Isohora riragaragara kuko rihuza icyitegererezo cyubushakashatsi hejuru yinjiza buri munsi aho kwerekana ibisobanuro byururimi rwamarenga gusa nka laboratoire. . Inkomoko isobanura ASL-kugeza-Icyongereza nkicyerekezo cyambere gishyigikiwe. Ntabwo bivuze ko ibiranga bihinduranya hagati yindimi zose z amarenga, ihindura inyandiko isinywa, cyangwa igasimbuza umusemuzi wabigize umwuga murwego rwo hejuru.
Google avuga ko SL2T yatojwe amasaha arenga 100.000 yamakuru akoreshwa mu ndimi zirenga 50, hafi kimwe cya kane cyayo makuru muri ASL. Iri tsinda rivuga ko imyitozo ihuriweho mu ndimi, imvugo, ndetse n’ubumenyi bufasha icyitegererezo kwiga imiterere ihuriweho aho gufata buri rurimi nkurutonde rwibimenyetso rwihariye. Ihitamo ryigishushanyo rifite akamaro kuko indimi z amarenga nindimi karemano yigenga hamwe nimbonezamvugo zabo hamwe namagambo. Bagaragaza kandi ibisobanuro binyuze mumaboko icyarimwe, ukuboko, umubiri, umutwe, hamwe no kugenda mumaso, bigatuma umurimo uhuza imyumvire igaragara hamwe nubusobanuro aho guhuza ibimenyetso byoroshye.
Igishushanyo mbonera cyibanga nacyo kiri mubisabwa ibicuruzwa. Google DeepMind avuga ko ku gikoresho cyerekana ibikoresho bya MediaPipe Holistic yerekana ibimenyetso byerekana ibimenyetso, kandi ko serivisi y’ubuhinduzi yakira imirongo ya geometrike aho kugaburira kamera mbisi. Isosiyete ivuga ko amashusho y'umwimerere ashobora guhita ajugunywa ako kanya. SL2T isobanura ibimenyetso byerekana urutonde muburyo bwanditse aho kubanza guhindura umukono muburyo bugaragara. Ibyo birashobora kugabanya isoko imwe yamagambo nimbogamizi, ariko itangazo rusange ntiritanga ubugenzuzi bwigenga bwo kugumana, guterefona, gukemura ibibazo, cyangwa buri kintu cyose cyashyizwe mubikorwa kurwego rwibikoresho.
Ku mikorere yatangajwe, Google DeepMind avuga ko SL2T yageze kuri zero-shoti ya 70 BLEURT ku kizamini cya FLEURS-ASL sd, isobanura ko kiri hejuru kuruta amanota yatangajwe mbere. Uru ruganda ruvuga kandi ko rwakoraga mu gutinda gutinda, kudasinya-kwinjiza-salusiyo, gusinyisha ibumoso, no gusinyisha ukuboko kumwe iyo ukundi gufashe terefone. Ingero zayo zerekana amakosa asigaye mubimenyetso bidasanzwe, gutunga urutoki byihuse, ibyubaka byubaka, kwerekana ibyiciro, hamwe nigihe gishingiye kumiterere. Irekurwa rero rihuza ibipimo ngenderwaho bikomeye hamwe no kuburira mu buryo bweruye ko ibipimo ngenderwaho bitameze nkibiganiro byizewe.
Ibisobanuro birambuye: Google DeepMind's SL2T announcement ↗
Impamvu ari ngombwa
Ihinduka rifatika ni ukubaza niba AI ishobora kumenya clip yerekana ururimi rw'amarenga ukabaza niba gusinya bishobora guhinduka uburyo bwakoreshwa muburyo bwo gukoresha terefone. Kubatumva kandi bigoye-kumva-abakoresha, agaciro k'igikoresho kagenwa niba ikora ku muvuduko wo kuganira, yubaha imiterere y'ururimi, ikemura itandukaniro nyaryo, kandi igaha abantu kugenzura ibyo basangiye. Icyitegererezo kigaragara imbere muri Gboard na Live Transcribe ituma ibyo bibazo bigaragara kubakoresha bisanzwe aho kubashakashatsi gusa.
Inkunga y'ururimi rw'amarenga ifite umutwaro utandukanye wo kuganirwaho. Ururimi ruvugwa rwerekana ahanini ikarita yerekana amajwi yatanzwe mugihe cyanditse, mugihe sisitemu yururimi rwamarenga igomba gusobanura urujya n'uruza, umwanya, isura yo mumaso, nuburyo bw'ikibonezamvugo icyarimwe. Inkomoko y'ibanze ishimangira ko indimi z'amarenga atari Icyongereza kigaragara ku ntoki. Iri tandukanyirizo ni ingenzi kubishushanyo mbonera: sisitemu irashobora kugaragara neza mugihe ikibuze ikimenyetso kitari intoki, ahantu hagaragara, gutondekanya, cyangwa guhinduka mubihe bitwara ibisobanuro byinteruro.
Umuyoboro wibanze utanga icyerekezo cyibanga cyibikoresho bya kamera. Niba gusa umubiri-ingingo uhuza ibikoresho, serivise ntigomba kwakira videwo yumwimerere kubisabwa byose. Ibyo birashobora kugabanya sensibilité yamakuru yoherejwe hejuru, cyane cyane iyo gusinya bibaye murugo, kukazi, cyangwa ibiganiro rusange. Ntabwo ari garanti yuzuye. Guhuza ibikorwa birashobora gusobanura umuntu nimyitwarire yabo, kandi abayikoresha bakeneye amakuru asobanutse kubyerekeye ibiti, guhuza konti, kunoza imiterere, kugumana, nibibaho mugihe igikoresho kidashobora gutunganya ibyinjira mugace.
Ingero zibicuruzwa nazo zerekana impamvu akamaro gashingiye kumutwe urenze umubare wukuri. Kwiyandikisha gushakisha, guhimba ubutumwa, cyangwa gusaba Gemini kurangiza umurimo bishobora gukuraho intambwe zanditse. Gushyira umukono mubisubizo muri Live Transcript birashobora gutuma habaho guhanahana amakuru menshi. Ariko ibyoroshye bimwe bizamura ikiguzi cyikosa niba izina, guhakana, umubare, cyangwa amabwiriza adahinduwe kandi uyikoresha ntabimenye mbere yo kohereza. Ibipimo byiza rero biragaragara, byahinduwe bisohoka nuburyo bwihuse bwo gukosora cyangwa gusubiramo interuro, ntabwo ari ugutekereza ko gutondeka inyandiko bihita bikosorwa.
Iri tangazo riva mu nyubako y’isosiyete no kohereza icyitegererezo, bityo igipimo cyacyo hamwe n’ibigereranyo byagereranijwe bigomba gusomwa nkibisabwa aho kuba ibyemezo byigenga. Google DeepMind itanga imipaka yingirakamaro kandi ivuga ko yashyizeho komite ngishwanama y’ururimi rw’amarenga AI hamwe n’imiryango itumva n’inzobere mu bijyanye n’ibibazo, hiyongereyeho raporo ihuriweho n’isohoka. Iyo gahunda yo kwitabira ni ikimenyetso gifatika, ariko ntikirabwira rubanda uburyo imikorere itandukana nabasinyiye, imvugo, itara, inguni ya kamera, umuvuduko wo gusinya, cyangwa ibiganiro byerekanwa muburyo buteganijwe gutangira.
Uburyo bukoreshwa: Uburyo bukora
Shakisha ikoranabuhanga ryihishe inyuma yiri terambere.
crm_get_transaction(id='4092').Why is sign language translation harder than simply matching gestures to English words?
Ibyo kureba
Ibimenyetso bikurikira bigomba kwerekana niba SL2T ikomeza kuba ingirakamaro hanze yingero zagenzuwe mumwanya wo gutangiza. Reba igikoresho gifatika, ibitekerezo byabaturage, kugarura amakosa, inyandiko zerekeye ubuzima bwite, hamwe no kwipimisha byigenga kubasinya n'indimi z'amarenga. Isohora nintambwe yibicuruzwa byingenzi, ariko ntabwo ari gihamya ko guhindura ururimi rwamarenga bigeze kubisobanuro byabantu cyangwa gutondeka ururimi.
Ubwa mbere, reba ibikoresho nindimi byakira inkunga, nigihe. . Ihinduramiterere rifite akamaro rigomba kwerekana kuboneka mukarere, imiterere ya kamera ishyigikiwe, imvugo nururimi, ibisabwa gutunganya ibikoresho, kandi niba imyitwarire imwe yibanga ifite ibisekuruza byuma. Ibisobanuro birambuye bizerekana niba gusohora ari ikintu cyingirakamaro cyane cyo kugerwaho cyangwa kwerekana ifoto ifatanye kumurongo umwe wa terefone.
Icya kabiri, shakisha isuzuma ripima itumanaho nyaryo aho kuba igipimo gifatika gusa. Raporo yingirakamaro yatandukanya ijambo nibisobanuro amakosa kubasinya, imvugo, ubuhanga, ukuboko, gukoresha ukuboko kumwe, umuvuduko, kumurika, gushushanya, hamwe ninyuma yimbere. Igomba gushiramo ubukererwe, kudasinya ibyiza byibinyoma, gukosora, kugabanuka, nigihe gikenewe cyo gukira ikosa. Amanota ya FLEURS-ASL ni ingingo ifatika yo gutangiriraho, ariko ingero z'isoko ubwazo zerekana impamvu ibimenyetso bidasanzwe, gutunga urutoki, gushyira mu byiciro, hamwe n'ibihe bishingiye ku bihe bikeneye kwitabwaho bitandukanye.
Icya gatatu, reba imipaka y’ibanga n’umutekano nkuko ibiranga bihuza nibindi bicuruzwa Google. Umukono-ku-mwandiko ushobora gushakisha, gutegura, cyangwa gusaba Gemini kugirango ukore imirimo ukeneye kwemezwa neza mbere yigikorwa cyo hanze, cyane cyane mugihe ubusobanuro butazwi. Abakoresha bagomba kuba bashoboye kubona icyarafashwe, bakagihindura mbere yo kohereza, gusiba amateka afitanye isano, no kumva niba imirongo ihuza cyangwa inyandiko yakomotseho. Kurekurwa kumugaragaro bisobanura inzira yingenzi, ariko ntabwo ikemura ibibazo byibicuruzwa bijyanye nimpushya, gusuzuma, gutunganya ibicu, cyangwa kugenzura urwego rwamakuru.
Hanyuma, reba raporo yingaruka zihuriweho, imyororokere yigenga, n'ibitekerezo biva mumiryango yabatumva nkuko sisitemu igera kubantu benshi. Google DeepMind avuga ko komite ngishwanama izagira uruhare mu iterambere ry’iterambere kandi ko iteganya gukomeza inzira yo gusohora bikomeye. Gukurikiranwa gukomeye byatuma izo mihigo zipimwa: gutangaza imipaka ukurikije imvugo no gushiraho, kwerekana uburyo amakosa yatangajwe ahindura igishushanyo mbonera, kandi ureke abayikoresha batandukane nubufasha bwubuhinduzi bwikigereranyo nuwasimbuye umusemuzi. Kugeza ubwo ibyo bimenyetso bigeze, SL2T irasobanuka neza nkumuguzi wambere utanga ibyiringiro byoherejwe nabaguzi bafite intego, byavuzwe kumugaragaro.