Ụdị usoro-na-usoro
Ụdị usoro-na-usoro na-esetịpụ otu usoro gaa na nke ọzọ nke nwere ike ịdị ogologo, dị ka ịtụgharị asụsụ ahịrịokwu ma ọ bụ ichikota akwụkwọ.
Nchịkọta
They introduced the encoder-decoder design and the attention mechanism that paved the way for the Transformer.
Ime miri emi
Ụdị usoro-na-usoro (seq2seq) nwere akụkụ abụọ: ihe ngbanwe nke na-agụ usoro ntinye wee chịkọta ihe ọ pụtara, na ihe ngbanwe nke na-ewepụta usoro mmepụta otu token n'otu oge. Ọrụ 2014 ama ama nke Sutskever, Vinyals, na Le jiri LSTM ekpokọtara maka ntụgharị igwe. Adịghị ike pụtara: ichikota ahịrịokwu dum n'ime otu vector nwere ogologo ogologo furu efu ozi na ntinye ogologo. Na 2015 Bahdanau webatara nlebara anya, na-ahapụ onye nrụpụta ahụ ileghachi anya azụ na steeti encoder niile wee lekwasị anya na ndị kachasị mkpa maka okwu mmepụta ọ bụla. Nke a doziri ihe mgbanaka ahụ wee kwalite ntụgharị asụsụ n'ụzọ dị egwu. Echiche a na-agbakọta na ọrụ ederede ntinye-na-mpụta ọ bụla ma kpalie ya ozugbo maka nleba anya onwe onye nke Transformer na 2017.
Nghọta nka nka
Ihe ngbanwe ahụ na-emepụta usoro nke steeti zoro ezo; decoder na-ewepụta mpụta na-akpaghị aka, dabara na nsonaazụ gara aga yana ọnọdụ ngbanwe. Nlebara anya na-agbakọ nchikota nchikota nke steeti ngbanwe site na iji akara nhazi, yabụ usoro ngbanwe ọ bụla na-adọta vector gburugburu omenala. Nke a na-ewepụ ogologo mmepụta site na otu vector ọkpọ ọkpọ ma na-enye ngbanwe dị nro n'etiti ntinye na ọnọdụ mmepụta, nke nwekwara ike ịkọwa dị ka okwu isi mmalite mere ka okwu ọ bụla atụgharịrị.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke ụdị usoro-na-usoro
Seq2seq ọgbara ọhụrụ bụ ụdị mgbanwe mgbanwe mgbanwe dị ka T5 na BART na-achịkwa ihe fọrọ nke nta ka ọ bụrụ ọrụ NLP ọ bụla dị ka ederede-na-ederede. Seq2seq dabere na RNN bụ akụkọ ihe mere eme, mana usoro ngbanwe koodu na-eme nke ọma na ntụgharị asụsụ, nchịkọta, na njirimara okwu. Na-atụ anya uto na-aga n'ihu na sistemu seq2seq ọtụtụ asụsụ na multimodal, gbakwunyere uru arụmọrụ sitere na decoders na-abụghị autoregressive na distilled nke na-ewepụta ngwa ngwa ma na-echekwa ịdịmma.
Mmejuputa n'ezie n'ụwa
Sistemụ ntụgharị igwe na-atụgharị ahịrịokwu bekee ka ọ bụrụ French ma ọ bụ Japanese.
Nchịkọta ederede adịghị adị nke na-edegharị ogologo akụkọ ka ọ bụrụ nchịkọta dị mkpirikpi.
Nchọpụta okwu na-edobe usoro ebili mmiri odiyo gaa na ederede ederede.
Sistemụ nkata na mkparịta ụka na-akọwapụta okwu onye ọrụ na nzaghachi ewepụtara.
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Sequence-to-Sequence Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Mmanye onye nkuzi n'ụdị usoro
Ajụjụ a na-ajụkarị
What is Sequence-to-Sequence Models?
Ụdị usoro-na-usoro na-esetịpụ otu usoro gaa na nke ọzọ nke nwere ike ịdị ogologo, dị ka ịtụgharị asụsụ ahịrịokwu ma ọ bụ ichikota akwụkwọ. Ha webatara imewe-encoder-decoder na usoro nlebara anya nke mebere ụzọ maka Transformer.
Kedu ihe bụ isi akụkụ abụọ nke ihe nlere anya usoro-na-usoro?
Ihe ngbanwe na-agụ ma na-akpakọ ntinye, na ihe ngbanwe na-ewepụta usoro mmepụta.
Kedu nsogbu bụ isi nke usoro nlebara anya doziri na ụdị seq2seq?
Nlebara anya mee ka onye ngbanwe ahụ nweta steeti ngbanwe niile kama ịdabere na otu vector abịakọrọ, na-edozi arụmọrụ ogologo ahịrịokwu.
Kedu ihe owuwu ka ejiri ụdị ntụgharị asụsụ seq2seq izizi 2014 jiri?
Sutskever et al. ejiri netwọọdụ LSTM ekpokọtara ọnụ maka ihe ngbanwe na ihe ngbanwe.
Kedu ka nlebara anya si ewulite ọnọdụ maka usoro ngbanwe ọ bụla?
Nlebara anya na-ekenye ihe ọ̀tụ̀tụ̀ dị arọ iji denye steeti ka usoro mmepụta ọ bụla lekwasịrị anya na ọnọdụ ntinye kacha mkpa.
Kedu ihe kpatara nsonaazụ seq2seq nwere ike ịdị iche n'ogologo na ntinye?
The decoder na-emepụta autoregressively na nwere ike kwụsị na njedebe nke usoro akara, na-enye ohere mgbanwe ogologo mmepụta.