Model yu toppalante ci toppalante
Modèle sequence-à-sequence dafay méngale benn sequence ak beneen bu mëna wuute ci guddaay, lu melni tekki benn frase wala tënk benn këyit.
Résumé
They introduced the encoder-decoder design and the attention mechanism that paved the way for the Transformer.
Plongeur bu xóot
Modèle sequence-to-sequence (seq2seq) amna ñaari pàcc: encoder buy jàng sequence biy dugal ba noppi di kompresse li muy tekki, ak decodeur biy defar sequence biy génn benn token benn yoon. Liggéeyu 2014 bu am solo bi Sutskever, Vinyals, ak Le jëfandikoo LSTM yuñ dajale ngir tekki masin. Amna benn ñakk kattan bu feeñ: boole ab frase lëmm ci benn vecteur bu am guddaay bu takku, dafay ñàkk ay leeral ci ay dugal yu gudd. Ci atum 2015 Bahdanau dugal na bàyyi xel, bàyyi decoder bi xoolaat ci bépp stade encoder ba noppi bàyyi xelam ci yi gëna am solo ci baat bu nekk ci génne. Loolu dindi na jafe-jafe yi ba noppi gëna yombal tekki làkk bi. Xalaat bi dafay yamale bépp liggéeyu bind buy dugal ba genn, te dafa inspiré architecture bu Transformer biy bàyyi xel ci boppam ci 2017.
Gis-gis xarala
Encoder bi dafay defar ay stade yu nëbbu; decodeur bi dafay defar ay sorti ci anam wu autorégresif, lépp di aju ci sorti yi njëkka am ak ci encodeur bi. Attention dafay xayma limu pondéree ci stade encodeur yi ci jëfandikoo poñ yiñ am ci alignment, kon jéego bu nekk ci decodage dafay rëdd vecteur contexte buñ personaaliseer. Loolu dafay dindi guddaayu génne gi ci benn vecteur bottleneck ba noppi joxe yoon wu yomb diggante position input ak output, te loolu mën nañu ko tekki itam ni ban baat moo dawal baat buñ tekki bu nekk.
njeextalu pexe
Gaawaay ak yaatuwaay
Liggéeyukaay yi ci làkk yi mën nañu gëna gaaw te duñu yàq deggoo gi.
Dugg ak yegg
Dafay yaatal jëfandikoo gi ci làkk yi ak ci anam yi ñuy jokkoo.
dogal yu gëna leer
Ekip yi mën nañu gëna yàgg ci àtte ci jamono ji otomatisation di liggéey ci baamtu.
Ëlëgu xeetu toppalante ci toppalante
seq2seq bu bees bi dafa ëppee doole ci xeetu encoder-decoder Transformer yu melni T5 ak BART, yuy kaadre daanaka bépp liggéeyu NLP ni bind-ci-bind. RNN-based seq2seq dafa bari taarix, waaye motif encoder-decoder dafay gëna am solo ci tekki, tënk, ak xàmmee kàddu. Xaarandil màgg gu wéy ci sistem seq2seq yu bari làkk ak anam yu bari, boole ci njariñu dekodeer yu amul autoregresif ak distiye yuy génne ay génn yu gëna gaaw te baña yàq kalite bi.
Doxal ci àdduna dëgg
Sistemu tekki làkku masin buy tekki frase Àngle ci français wala japonais.
Résumé abstrak biy bind article yu gudd yi ci resumé yu gàtt.
Xamme kàddu dafay méngale forme onde audio ak transkripsioŋ bind.
Chatbot ak sistemu waxtaan yuy méngale kàddu jëfandikukat bi ak tontu buñ defar.
Risk yi ak balustrade yi
Lépp lu jaarul yoon mën na dugg ci rapoor yi, jàppale ci liggéey bi, wala ci njariñu gëstu bi.
Sensibilite bu gaaw mën na jur njariñ yu wuute ci laajte yu noonu mel.
Done yu am solo mën nañu feeñ sudee seytu jëfandikoo gi néew doole.
Roadmap ngir samp gi
Mandargal formaa génne gi, melokaan bi, ak standard kalite yi laata ngay dugal ko.
Tontu yu am solo ak balluwaay yu wóor saa yu dëggu bi di am solo.
Fexeel am barabu xool nit ñi ngir am njariñ yu am solo.
Toppal anami gacce yi ak di faral di tàggataat ay laaj wala def-liggéey.
Weyal di banneexu
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Sequence-to-Sequence Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Gis bi ci topp
Jàngalekat biy forse ci model yu toppalante
Laaj yi ñuy faral di laaj
What is Sequence-to-Sequence Models?
Modèle sequence-à-sequence dafay méngale benn sequence ak beneen bu mëna wuute ci guddaay, lu melni tekki benn frase wala tënk benn këyit. Ñu dugal jëmmal encoder-decoder ak jumtukaayu bàyyi xel bi ubbi yoonu Transformer bi.
Lan mooy ñaari mbir yi gëna am solo ci xeetu toppalante ci toppalante?
Encoder bi dafay jàng liñ dugal ba noppi kompresse ko, decoder bi mooy defar liñuy génne.
Ban jafe-jafe bu mag la jumtukaayu bàyyi xel bi saafara ci xeetu seq2seq yi?
Fexeel ba dekodeer bi mëna jëfandikoo bépp etaa enkodeer ludul yéem ci benn vecteur buñ komprime, defar performance frase yu gudd yi.
Ban architecture la xeetu tekki seq2seq 2014 bi njëkk jëfandikoo?
Sutskewer ak ñeneen. jëfandikoo reso LSTM yuñ dajale ngir encoder ak decoder.
naka la ko bàyyi xel di tabaxee ci jéego bu nekk ci dekodaas bi?
Foofu dafay jox poids ci etaa encoder yi suko defee jéego bu nekk ci genn gi dafay xoole ci position input yi gëna am solo.
Lan moo waral génnug seq2seq mëna wuute ci guddaay ak duggal?
Dekodeer bi dafay defar ci boppam te mën na taxaw ci jeton biy jeexal toppalante bi, loolu mooy tax génne gi am guddaay bu mën soppiku.