Xiga xigaHagaha xiga
Cross-Encoders vs Bi-Encoders
Luuqadda AI
Luqadda AI HAGAHA
Encoder-Decoder Architectures
Encoder-decoder architectures map an input sequence to an output sequence that may differ in length.
Dhageyso hagahanAI-waa laga sheekeeyay · ~1 min
Boggaan1 daqiiqo akhri
Dulmar
The encoder builds source representations, and the decoder generates target elements conditioned on those representations.
quusid qoto dheer
Early seq2seq models used recurrent encoders and decoders. Bahdanau attention addressed the fixed-vector bottleneck by computing a source context for each decoder step. The Transformer replaces recurrence with self-attention and cross-attention. BART pretrains a denoising encoder-decoder, while T5 casts many language tasks as text-to-text. These papers evaluate specific models and tasks; the architecture alone does not guarantee quality.
Dhaqangelinta Adduunka-dhabta ah
A neural translation encoder represents a source sentence while a decoder generates a translated sentence.
Bahdanau attention lets each decoder step focus on different encoder states.
The Transformer uses encoder-decoder attention and masked decoder self-attention.
BART and T5 use encoder-decoder architectures for denoising or text-to-text tasks.
Mustaqbalka Encoder-Decoder Architectures
Choose an encoder-decoder when a task naturally maps one sequence to another, and compare it with alternatives on the target data and latency. Track input-length behavior and output quality. The cited work does not establish that this architecture is best for every language task.
Ku dhaqangelinta
Maxay muhiim u tahay
- Xawaaraha iyo miisaanka. Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
- Helitaanka iyo gaarsiinta. Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
- Go'aamo cad. Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Iska ilaali
- Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
- Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
- Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Tallaabooyinka xiga
- Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
- Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
- Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
- Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Warqad bilaash ah
Hel warbixinta maalinlaha ah ee AI
Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.
Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.
Is tijaabi
Take the Encoder-Decoder Architectures quiz
Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.
Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq
Su'aalaha soo noqnoqda
What is Encoder-Decoder Architectures?
Encoder-decoder architectures map an input sequence to an output sequence that may differ in length. The encoder builds source representations, and the decoder generates target elements conditioned on those representations.
Waa maxay shaqada ugu weyn ee cod-bixiyeha ku jira moodeel-decoder-gaabiyaha?
Codeeyuhu waxa uu cunaa dhammaan isku xigxiga soo gelista oo waxa uu soo saaraa vectors-ku-salaysan oo qabsanaya macnihiisa, kaas oo uu adeegsaduhu isticmaalo.
Muxuu cod-bixiyeyaashu u adeegsadaan is-fiirsashada (sababta) waji-xidhan?
Maaskaradu waxay hubisaa in boos kasta oo wax soo saar ahi uu tago boosas hore, isagoo ilaalinaya nidaamka jiilka autoregressive ee bidix-ilaa-midig.
Farsamaynkee ayaa isku xira furaha iyo matalaada codeeyaha?
Feejignaanta-is-dhaafsiga ah waxay u oggolaanaysaa lakab kasta oo dekodeeruhu inuu weydiiyo codeeyaha gobolladiisa qarsoon, isagoo ku xiraya fahamka gelinta iyo jiilka soo-saarka.
Midkee ka mid ah moodooyinkan waa encoder-decoder (isku xigxiga-ilaa-taxan) qaab dhismeedka?
T5 (iyo BART) waa moodooyin-kodeeye-kooxeed caadi ah oo u qaabeeya hawlo qoraal-u-qoraal ah. BERT waa encoder-kaliya GPT-3-na waa cod-dejiyaha-kaliya.
Waa maxay sababta nashqadeeyaha-decoder-ku uu ugu habboon yahay tarjumaada dabiiciga ah?
Turjumaadda waxay hal taxane u samaysaa mid kale, markaa akhrinta isha oo dhan (encoder) iyo abuurista bartilmaameed cusub (decoder) ayaa si fiican ugu habboon.
Sii wad waxbarashada
Tilmaamaha la xidhiidha
Tilmaamayaal badan ayaa loo doortay mawduucan