Urutonde-Kuri-Urutonde
Icyitegererezo gikurikiranye cyerekana ikarita ikurikiranye kurindi ishobora kuba itandukanye, nko guhindura interuro cyangwa kuvuga muri make inyandiko.
Incamake
They introduced the encoder-decoder design and the attention mechanism that paved the way for the Transformer.
Kwibira cyane
Urutonde rukurikirana (seq2seq) icyitegererezo gifite ibice bibiri: kodegisi isoma ibyinjijwe bikurikirana kandi igahuza ibisobanuro byayo, hamwe na decoder itanga ibisohoka bikurikirana ikimenyetso kimwe icyarimwe. Igikorwa cyibanze cya 2014 cyakozwe na Sutskever, Vinyals, na Le bakoresheje LSTM zegeranye kugirango bahindure imashini. Intege nke yagaragaye: gutondekanya interuro yose mumurongo umwe uhamye wuburebure bwatakaye amakuru kumurongo muremure. Muri 2015 Bahdanau yerekanye ibitekerezo, areka decoder isubiza amaso inyuma kuri kodegisi zose kandi yibanda kubyingenzi kuri buri jambo risohoka. Ibi byakemuye icyuho kandi byahinduwe neza mubisobanuro. Igitekerezo gisanzwe mubikorwa byose byinjira-bisohoka byanditse kandi byashishikarije byimazeyo Transformer yuzuye-kwiyitaho ubwubatsi muri 2017.
Ubushishozi
Kodegisi itanga urukurikirane rwibintu byihishe; decoder itanga ibisubizo byikora, byateganijwe kubisubizo byabanjirije hamwe na kodegisi. Icyitonderwa kibara umubare uremereye wa kodegisi ukoresheje amanota yo guhuza, bityo buri ntambwe yo gushushanya ishushanya imiterere yihariye. Ibi bisohora uburebure buva kumurongo umwe kandi butanga guhuza byoroshye hagati yinjiza nibisohoka, ibyo nabyo birasobanurwa nkamagambo yinkomoko yatwaye buri jambo ryahinduwe.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Igihe kizaza cyurukurikirane-Kuri-Urutonde rwicyitegererezo
Seq2seq igezweho yiganjemo Transformer encoder-decoder yerekana nka T5 na BART, ikora hafi ya buri gikorwa cya NLP nkumwandiko-ku-mwandiko. RNN ishingiye kuri seq2seq ahanini ni amateka, ariko uburyo bwa encoder-decoder butera imbere mubusemuzi, incamake, no kumenya imvugo. Witege ko uzakomeza kwiyongera muri sisitemu yindimi nyinshi na multimodal seq2seq, hiyongereyeho inyungu ziva muri decodeur idashingiye kuri autoregressive na disile isohora umusaruro vuba mugihe ubungabunga ubuziranenge.
Gushyira mu bikorwa Isi
Sisitemu yo guhindura imashini ihindura interuro yicyongereza mu gifaransa cyangwa Ikiyapani.
Incamake yinyandiko yerekana incamake yandika ingingo ndende muri make.
Kumenyekanisha imvugo ushushanya amajwi yerekana amajwi akurikirana inyandiko.
Chatbot hamwe na sisitemu yo kuganira ishushanya imvugo yumukoresha kubisubizo byatanzwe.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Sequence-to-Sequence Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Guhatira abarimu muburyo bukurikiranye
Ibibazo bikunze kubazwa
What is Sequence-to-Sequence Models?
Urutonde-rukurikiranye rwerekana ikarita ikurikiranye kurindi yuburebure butandukanye, nko guhindura interuro cyangwa kuvuga muri make inyandiko. Bashyizeho igishushanyo mbonera cya decoder hamwe nuburyo bwo kwitondera bwahaye inzira Transformer.
Nibihe bintu bibiri byingenzi bigize urutonde rwikurikiranya?
Kodegisi isoma kandi ikomatanya ibyinjijwe, kandi decoder itanga ibisohoka bikurikiranye.
Ni ikihe kibazo cyingenzi uburyo bwo kwitondera bwakemuye muburyo bwa seq2seq?
Icyitonderwa reka decoder igere kuri kodegisi zose aho kwishingikiriza kumurongo umwe ugabanijwe, gukosora interuro ndende.
Ni ubuhe bwubatsi bw'umwimerere wa seq2seq yo mu mwaka wa 2014 yakoresheje?
Sutskever n'abandi. yakoresheje urutonde rwa LSTM rusubiramo imiyoboro ya encoder na decoder.
Nigute kwitondera kubaka imiterere kuri buri ntambwe ya decoding?
Icyitonderwa gitanga uburemere kuri kodegisi ya leta kuburyo buri gisohoka intambwe yibanda kumyanya yinjiza cyane.
Kuki ibisubizo bya seq2seq bishobora gutandukana muburebure ninjiza?
Decoder itanga autoregressive kandi irashobora guhagarara kumpera-yikurikiranya yikimenyetso, ikemerera impinduka zisohoka muburebure.