Nhungamiro yehunyanzvi

Bidirectional Recurrent Networks

A bidirectional recurrent network inoverenga nhevedzano kumberi nekumashure, saka chinomiririra chinzvimbo chega chega chinokwevera pane zvakapfuura uye nezveramangwana.

Teerera kugwaro iriAI-yakarondedzerwa · ~2 min

Pa peji ino2 min verenga
  1. Pfupiso
  2. Kudzika Kwakadzika
  3. Kuitwa muNyika yeChokwadi
  4. Ramangwana reBidirectional Recurrent Networks
  5. Kuzvishandisa
  6. Ramba Uchiongorora
  7. Mibvunzo inowanzo bvunzwa

Pfupiso

Izvi zvakakosha nekuti zvinoreva kazhinji zvinoenderana nezvinotevera, kwete zvakamboitika.

Kudzika Kwakadzika

Yakakurudzirwa naSchuster naPaliwal muna 1997, iyo bidirectional RNN inomhanyisa maviri akapatsanurwa anodzokororwa akaturikidzana pamusoro peiyo imwe chete yekuisa: imwe inobata kutevedzana kuruboshwe kuenda kurudyi, imwe kurudyi kuruboshwe. Nyika dzadzo dzakavanzwa dzinobva dzabatanidzwa, kazhinji nekubatanidza, kugadzira chinomiririra panguva yega yega nhanho inoisa iyo yakazara yakapoteredza mamiriro. Izvi zvine simba kumabasa uko kupinza kwese kunowanikwa kamwechete. Semuenzaniso, kuisa izwi rekuti bhangi senzvimbo yezvemari maringe nerwizi, modhi inobatsirwa nekuona mazwi kumativi ese. Bidirectional LSTMs uye GRUs dzakave chiyero chekuzivikanwa-chinzvimbo, chikamu-che-yekutaura tagging, uye kuzivikanwa kwekutaura. Mhedzisiro yakakosha ndeyekuti network inoda kutevedzana kwakazara isati yagadzira zvinobuda, saka haigone kushandiswa kune chaiyo-nguva, kutenderera, kana generative kuruboshwe-ku-kurudyi kufanotaura.

Kuitwa muNyika yeChokwadi

Kuzivikanwa kwechinzvimbo, uko mazwi akatenderedza mativi ese anobatsira kuronga chiratidzo semunhu, nzvimbo, kana sangano.

Chikamu-che-yekutaura tagging inobvisa mazwi akaita se 'lead' uchishandisa ese arikutangira uye anotevera mamiriro

Acoustic modelling mukuzivikanwa kwekutaura pasina Indaneti uko kutaura kwese kunowanikwa

Protein kana DNA sequence labeling mu bioinformatics, uko motifs inotsamira pane flanking masara.

Ramangwana reBidirectional Recurrent Networks

Bidirectional mamiriro anogara mune encoder azvino: BERT-maitiro Shanduko anozadzisa chinangwa chimwe chete nekutarisisa kwakavharika kwete kudzokorora, uye anofananidzira zvirinani. Bidirectional RNNs inoramba iine basa mumapaipi asina kuremerwa, odhiyo uye biosignal kugadzirisa, uye marongero ayo akazara akatevedzana ari mapfupi uye akanyorwa. Tarisira kuenderera mberi kushandiswa muhunyanzvi, latency-kushivirira encoding mabasa, nepo kutarisisa-kwakavakirwa bidirectional encoders inotonga-kukuru kunzwisisa kwemutauro.

Kuzvishandisa

Nei zvichikosha

  • Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
  • Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
  • Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.

Chenjera

  • Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
  • Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
  • Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.

Matanho anotevera

  1. Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
  2. Benchmark pasi pechokwadi mutoro uye data mamiriro.
  3. Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
  4. Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.

Ramba Uchiongorora

Tsamba yemahara

Tora iyo yemazuva ese AI pfupiso

Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.

Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.

Zviedze iwe pachako

Take the Bidirectional Recurrent Networks quiz

Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.

Tanga mibvunzo

Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo

Mibvunzo inowanzo bvunzwa

Chii chinonzi Bidirectional Recurrent Networks?

A bidirectional recurrent network inoverenga nhevedzano kumberi nekumashure, saka chinomiririra chinzvimbo chega chega chinokwevera pane zvakapfuura uye nezveramangwana. Izvi zvakakosha nekuti zvinoreva kazhinji zvinoenderana nezvinotevera, kwete zvakamboitika.

What does a bidirectional RNN do with an input sequence?

The guide describes two recurrent passes over the same input in opposite directions.

Why can context from both directions help label a word such as “bank”?

The guide gives contextual disambiguation as a benefit of bidirectional representations.

How are the two directional hidden states commonly combined at a position?

The guide says the directional states are typically concatenated before output.

Why can a bidirectional RNN be unsuitable for streaming generation?

The guide notes the full input must be available before outputs using future context can be produced.

What is one advantage of offline sequence labeling with bidirectionality?

Both passes provide context before and after the current position.