Encoder-Decoder Ubwubatsi
Encoder-decoder yubatswe igabanya icyitegererezo mo ibice bibiri: kimwe gisoma kandi kigabanya ibyinjijwe muburyo bukungahaye bwimbere, hamwe nibisohoka biva muri yo.
Incamake
This design powers translation, summarization, and any task where the input and output are different sequences.
Kwibira cyane
Moderi ya encoder-decoder itunganya ikibazo mubyiciro bibiri. Kodegisi isoma ibyinjijwe byose (vuga, interuro yicyongereza) ikabihindura murwego rwibice bifata ibisobanuro. Decoder noneho itanga ibisohoka bikurikiranye (vuga, igifaransa) ikimenyetso kimwe icyarimwe, ukareba inyuma ibyasohotse mbere ndetse no kuri kodegisi. Umwimerere wa 2017 Transformer yari encoder-decoder yubatswe kugirango ihindurwe. Moderi nka T5 na BART koresha iyi shusho hanyuma ukore buri gikorwa nkumwandiko-wanditse, inyandiko-hanze. Gutandukana birakomeye kuko encoder irashobora kubona ibyinjijwe icyarimwe (imiterere ya byerekezo), mugihe decoder itanga ibumoso-iburyo. Ibi bituma igishushanyo gisanzwe gikwiranye nibibazo bikurikiranye aho ibisohoka uburebure nibirimo bitandukanye nibyinjijwe.
Ubushishozi
Kodegisi ikoresha ibyerekezo byombi-kwiyitaho, bityo buri kimenyetso cyinjiza cyitabira ikindi kimenyetso icyarimwe. Decoder ni autoregressive kandi ikoresha mask yo kwiyitaho, bivuze ko buri mwanya ushobora kubona imyanya yambere kugirango ubungabunge ibisekuruza. Kubahuza ni ukwambukiranya ibitekerezo: decoder ibice bibaza kodegisi ya nyuma ihishe. Uku gutandukana kureka kodegisi yubaka byuzuye, byigenga-byigenga byunvikana mugihe decoder yiyemeje ikimenyetso kimwe icyarimwe.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Kazoza ka Encoder-Decoder Ubwubatsi
Moderi ya decoder gusa nka GPT ubu yiganje muri rusange-intego yo kuganira kuko umunzani umwe wapimye gusa kandi ukora imirimo myinshi ukoresheje ibibazo. Ariko encoder-decoder ibishushanyo bikomeza aho gusobanukirwa ibyinjira nibisohoka bitandukanijwe mubyukuri: kumenyekanisha imvugo (Whisper), incamake yinyandiko, hamwe na sisitemu ya multimodal ihuza icyerekezo kodegisi hamwe na decoder. Tegereza ibyubatswe bivangavanga inguzanyo ya kodegisi yunvikana kugirango igarure kandi ihindure mugihe ukomeza decoder ihinduka, cyane cyane nka moderi ihuza inyandiko, amajwi, n'amashusho.
Gushyira mu bikorwa Isi
Google Sobanura na DeepL ukoreshe encoder-decoder Transformers gushushanya interuro mururimi rumwe kurundi.
__AIU_PROTECTED_10 __ 'Whisper ikubiyemo amajwi yerekana amajwi kandi ikayandika mu nyandiko yanditswe cyangwa yahinduwe.
T5 na BART imbaraga abstract abstract incamake, ihuza ingingo ndende muri make.
Sisitemu yanditseho amashusho ahuza iyerekwa hamwe na decoder yinyandiko kugirango asobanure amafoto mumagambo.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Encoder-Decoder Architectures quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Umusaraba-Encoders vs Bi-Encoders
Ibibazo bikunze kubazwa
What is Encoder-Decoder Architectures?
Encoder-decoder yubatswe igabanya icyitegererezo mo ibice bibiri: kimwe gisoma kandi kigabanya ibyinjijwe muburyo bukungahaye bwimbere, hamwe nibisohoka biva muri yo. Igishushanyo cyububasha bwo guhindura, incamake, nigikorwa icyo aricyo cyose aho ibyinjira nibisohoka bitandukanye.
Nuwuhe murimo wingenzi wa encoder muburyo bwa encoder-decoder?
Kodegisi ikoresha ibyinjijwe byose hanyuma ikabyara ibice bifata ibisobanuro byayo, iyo decoder ikoresha.
Kuki decoder ikoresha maskike (impamvu) yo kwiyitaho?
Masking ituma buri gisohoka gisohoka gusa kumwanya wambere, ukarinda ibumoso-iburyo-autoregressive generation order.
Ni ubuhe buryo buhuza decoder na kodegisi ihagarariwe?
Kwambukiranya kureka buri decoder igahuza ikibazo kodegisi ihishe, ihuza gusobanukirwa ibyinjira mubisohoka.
Nubuhe muri ubu buryo bwububiko bwa kodegisi-decoder (ikurikirana-ikurikiranye)?
T5 (na BART) ni moderi ya encoder-decoder yerekana imiterere nkibikorwa-by-inyandiko. BERT ni kodegisi gusa kandi GPT-3 ni decoder-yonyine.
Ni ukubera iki gushushanya kodegisi-decoder isanzwe ikwiye guhindurwa?
Ubuhinduzi bwerekana ikarita imwe ikurikiranye, bityo gusoma isoko yose (encoder) no kubyara intego nshya (decoder) bihuye neza.