AMABWIRIZA Yibanze

Amarembo Yisubiramo

Igice cya Gated Recurrent Unit (GRU) nubwoko bworoheje bwurusobe rwimitsi rusubiramo rukoresha amarembo abiri kugirango uhitemo amakuru ugomba kubika nicyo wibagirwa nkuko isoma urukurikirane.

2 min somaIbiherutse kuvugururwa

Incamake

It matters because it captures long-range patterns in text, speech, and time series almost as well as LSTMs while being faster and simpler to train.

Kwibira cyane

GRU yatangijwe na Cho na bagenzi be muri 2014, GRU yashizweho kugirango ikemure ikibazo cyo kubura-buhoro buhoro cyugarije imiyoboro isanzwe igaruka, irwanira kwibuka amakuru mugihe kinini. Bitandukanye na LSTM, ikoresha amarembo atatu hamwe na selile itandukanye, GRU ikoresha amarembo abiri gusa na leta imwe yihishe. Irembo ryo kuvugurura rigenzura umubare wibintu byabanje guhishwa kugirango bitware imbere namakuru mashya yo kongeramo. Irembo ryo gusubiramo rihitamo umubare wamakuru yashize kugirango wirengagize mugihe ubara umukandida mushya leta. Muguhuza mu buryo butaziguye leta zishaje na shyashya hamwe na interpolation yize, GRU ireka gradients zitembera hejuru ndende. Ibipimo bike bisobanura kwibuka bike, imyitozo yihuse, nibikorwa bikomeye kumibare mito.

Ubushishozi

Kuri buri ntambwe yo gusubiramo irembo r no kuvugurura irembo z bibarwa uhereye mubyinjijwe na leta yabanje kwihisha ukoresheje ibikorwa bya sigmoid, bitanga indangagaciro hagati ya 0 na 1. Igihugu cyabakandida gishyirwaho hifashishijwe reta yashizwemo na reta yashize binyuze murwego rwa tanh. Leta nshya yihishe ni interpolation y'umurongo: z inshuro za kera leta wongeyeho (1 ukuyemo z) inshuro umukandida. Iyo z igumye hafi ya 1, igice gikoporora ububiko bwacyo budahindutse, bubika gradients murwego rurerure.

Ingaruka z'Ingamba

Ibyemezo bisobanutse

Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.

Igiciro na bije

Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.

Itsinda hamwe nakazi

Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.

Ejo hazaza h'amarembo asubirwamo

Nubwo abahindura ubu biganjemo imirimo minini yindimi, GRUs ikomeza kuba iyagaciro aho ibintu byose bikurikirana bikurikirana: kumenyekanisha imvugo kubikoresho, ibyuma byifashishwa, kugenzura igihe, no gutinda kwihuta. Abashakashatsi kandi barimo gukusanya ibitekerezo byinjira muburyo bushya bwubatswe, hamwe na leta-yerekana imiterere-nka Mamba gusubiramo uburyo-bukurikiranye bwo gutunganya ibintu birebire. Tegereza GRUs gutsimbarara nkumucyo woroshye, wiringirwa muburyo butagabanije kandi bugenekereje aho ibitekerezo byuzuye bihenze cyane.

Gushyira mu bikorwa Isi

Guha imbaraga imvugo yoroheje-imenyekanisha kuri terefone na disikuru zubwenge aho kwibuka na batiri bigarukira

Guteganya igihe gito amashanyarazi akenewe cyangwa ibiciro byimigabane uhereye kumateka yamateka

Gutahura ibintu bidasanzwe mugukurikirana ibyasomwe mumashini yinganda kugirango bibungabunge

Encoding ikurikiranye muri sisitemu yo guhindura imashini ya mashini mbere yuko Transformers iba ibisanzwe

Ingaruka & Kurinda

Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.

Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.

Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.

Igishushanyo mbonera

1

Tangira nururimi rusobanutse rwibisubizo ukeneye.

2

Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.

3

Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.

4

Inyandiko aho Gatesi Yisubiramo Ifasha kandi nuburyo bworoshye bworoshye.

Komeza Ubushakashatsi

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Gated Recurrent Units quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

Tangira ikibazo

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

Ubuyobozi bukurikira

Imiyoboro ya Neural Isubiramo

Ibibazo bikunze kubazwa

What is Gated Recurrent Units?

Igice cya Gated Recurrent Unit (GRU) nubwoko bworoheje bwurusobe rwimitsi rusubiramo rukoresha amarembo abiri kugirango uhitemo amakuru ugomba kubika nicyo wibagirwa nkuko isoma urukurikirane. Nibyingenzi kuko ifata intera ndende mubyanditswe, imvugo, hamwe nurutonde hafi kimwe na LSTM mugihe byihuta kandi byoroshye guhugura.

GRU isanzwe ikoresha amarembo angahe?

GRU ikoresha amarembo abiri: irembo ryo kuvugurura hamwe nugusubiramo amarembo, munsi ya atatu ya LSTM.

Ni ikihe kibazo cy'ibanze mu miyoboro isanzwe isubirwamo GRUs yagenewe gukemura?

Irembo ryemerera gradients gutembera mugihe cyintambwe nyinshi, kugabanya ikibazo cyo kubura-buhoro buhoro bigabanya RNNs.

Niki GRU ivugurura amarembo igenzura?

Irembo ryo kuvugurura rihuza leta ishaje ihishe hamwe nabakandida bashya leta ikoresheje interpolation yize.

Nigute GRU itandukaniye muburyo na LSTM?

Bitandukanye na LSTM ya selile itandukanye hamwe namarembo atatu, GRU ihuza ibintu byose muburyo bumwe bwihishe hamwe namarembo abiri.

Nibihe bikorwa byo gukora bitanga amarembo ya GRU hagati ya 0 na 1?

Ibikorwa bya Sigmoid squash irembo risohoka muri 0-kuri-1, ikora nka swift yoroshye.