InayofuataMwongozo unaofuata
Kulazimisha Walimu katika Miundo ya Mfuatano
Kiufundi
Lugha AI MWONGOZO
Sequence-to-sequence (seq2seq) models encode an input sequence and generate an output sequence, which may have a different length.
Sikiliza mwongozo huuInaonyeshwa na AI · ~1 min
Attention provides access to source context during decoding.
Early neural machine-translation systems encoded a source sentence into a fixed vector, which constrained long inputs. Bahdanau attention lets a decoder compute context from source hidden states at each step. The Transformer replaces recurrence with attention layers, while sequence-to-sequence variants retain encoder and decoder components. Output length is determined during generation rather than copied from input length.
An encoder can represent a source sentence for translation.
A decoder generates target tokens until an end condition is reached.
Cross-attention uses encoder outputs as keys and values for decoder queries.
Transformer encoder-decoder models such as T5 and BART apply this structure to text tasks.
Choose encoder-decoder or decoder-only architectures based on the task, data and serving constraints. Evaluate input-length behavior, output quality and decoding cost. The cited papers establish particular model designs and benchmarks, not universal superiority of one architecture.
Jarida halali
Hadithi tatu za AI zilizothibitishwa kila asubuhi ya wiki, zimetengenezwa kwa Kiingereza rahisi. Bila malipo daima, hakuna matangazo.
Barua pepe moja kila siku ya wiki. Jiondoe kwa bonyeza moja. Hatutauza au kushiriki anwani yako.
Jijaribu mwenyewe
Maoni ya haraka juu ya kila jibu, na cheti kinachoweza kushirikishwa na kitambulisho kinachoweza kuthibitishwa baada ya kupita kozi.
Changia elimu ya AI bila malipo. AI Understanding ni 501(c)(3) isiyo na faida — hakuna matangazo, hakuna kizuizi cha malipo, daima. Toa mchango
Sequence-to-sequence (seq2seq) models encode an input sequence and generate an output sequence, which may have a different length. Attention provides access to source context during decoding.
Kisimbaji husoma na kubana ingizo, na avkodare hutoa mfuatano wa kutoa.
Tahadhari iruhusu programu ya kusimbua ifikie hali zote za kusimba badala ya kutegemea vekta moja iliyobanwa, kurekebisha utendaji wa sentensi ndefu.
Sutskever et al. imetumia mitandao ya kawaida ya LSTM iliyopangwa kwa rafu kwa kisimbaji na avkodare.
Makini hupeana uzani kwa majimbo ya usimbaji ili kila hatua ya kutoa inalenga nafasi zinazofaa zaidi za ingizo.
Kisimbuaji huzalisha kiotomatiki na kinaweza kusimama katika tokeni ya mwisho wa mfuatano, ikiruhusu urefu wa matokeo unaobadilika.
Endelea kujifunza
Miongozo zaidi imechaguliwa kwa mada hii
InayofuataMwongozo unaofuata
Kulazimisha Walimu katika Miundo ya Mfuatano
Kiufundi