Kwambukiranya
Kwambukiranya ibitekerezo ni uburyo butuma urukurikirane rureba urundi: decoder itanga inyandiko irashobora kwitabira kodegisi yerekana ibyinjijwe.
Incamake
It is how models connect what they are producing to what they read, powering translation, captioning, and modern multimodal systems.
Kwibira cyane
Kwiyitaho kureka ibimenyetso muburyo bumwe bikurikirana; kwambukiranya kureka urukurikirane rukurura amakuru kuva murindi. Muri decoder ya Transformer, buri gisekuru cyintambwe ikora ibibazo bivuye mubice byasohotse igice, mugihe urufunguzo nagaciro biva mubisubizo bya kodegisi. Icyitegererezo kigereranya uburyo buri kintu cyinjiza kijyanye nibisohoka byasohotse kandi bigakurura muburyo buremereye bwo kwinjiza amakuru. Ibi nibyo bituma decoder yubusobanuro yibanda kumagambo meza yinkomoko nkuko yandika buri jambo rigamije. Hanze yinyandiko, kwambukiranya ibitekerezo ni kole muburyo bwa modimodal: decoder yinyandiko irashobora kwitabira ibiranga amashusho, cyangwa amajwi yerekana amajwi ashobora guhuza amajwi namagambo yanditswe. Igihe cyose imigezi ibiri itandukanye yamakuru igomba guhuzwa, guhuza ibitekerezo mubisanzwe ni tissue ihuza.
Ubushishozi
Muburyo bwa tekinike, kwambukiranya ibitekerezo byongeye gukoresha urugero rudasanzwe rwibicuruzwa nkibintu byo kwiyitaho, hamwe no kugoreka: ibibazo biva kumurongo umwe (decoder) naho urufunguzo / indangagaciro biva mubindi (encoder). Iharura uburemere bwibintu nka softmax hejuru yikibazo-urufunguzo rusa, hanyuma igasubiza uburemere bwagaciro. Kuberako ibibazo nurufunguzo bituruka ahantu hatandukanye, ibyiciro byombi birashobora gutandukana muburebure, muburyo, cyangwa ururimi rwose.
Ingaruka z'Ingamba
Umuvuduko n'igipimo
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Kugera no kugera
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Ibyemezo bisobanutse
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Igihe kizaza cyo Kwambukiranya
Kwambukiranya ibitekerezo bigenda byiyongera muburyo busanzwe bwo kudoda hamwe. Icyerekezo-cyururimi rwicyitegererezo kiragikoresha kugirango inyandiko ishobore kwihagararaho mukarere ka shusho; gukwirakwiza amashusho atanga amashanyarazi kugirango akoreshe pigiseli ku nyandiko isaba. Ubushakashatsi burimo gusunika muburyo bunoze bwo guhuza ibitekerezo (umurongo utandukanijwe kandi gake) kugirango ukore inyandiko ndende, amashusho aremereye cyane, na videwo. Nka sisitemu ya AI ihuza ibyumviro byinshi, tegereza ibice byuzuzanya bikora nkumuhuza rusange uhuza inyandiko, amajwi, iyerekwa, hamwe namakuru yubatswe.
Gushyira mu bikorwa Isi
Mubuhinduzi bwimashini ya neural, decoder yambukiranya amagambo yinkomoko kugirango uhitemo ibisobanuro bikwiye kuri buri jambo risohoka.
Diffusion ihamye ikoresha kwambukiranya imiterere kugirango buri gice cyashizweho mukarere kanditse.
Icyerekezo-cyururimi rwicyitegererezo nka Flamingo reka reka ibimenyetso byambukiranya-shusho kubiranga amashusho kubibazo bisubizwa.
Imvugo-y-inyandiko-decoders yambukiranya-yambukiranya amajwi yerekana amajwi kugirango ahuze amajwi namagambo yandukuwe.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Cross-Attention quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Byihuse-Kuri-Byihuta Kwambukiranya-Kwitonda
Ibibazo bikunze kubazwa
What is Cross-Attention?
Kwambukiranya ibitekerezo ni uburyo butuma urukurikirane rureba urundi: decoder itanga inyandiko irashobora kwitabira kodegisi yerekana ibyinjijwe. Nuburyo moderi ihuza ibyo itanga kubyo basoma, imbaraga zo guhindura, ibisobanuro, hamwe na sisitemu ya multimodal igezweho.
Ni irihe tandukaniro nyamukuru riri hagati yo kwiyitaho no guhuza ibitekerezo?
Kwambukiranya ibitekerezo bikurura ibibazo bivuye kumurongo umwe (urugero, decoder) nurufunguzo nagaciro biva mubindi bitandukanye (urugero, kodegisi), kureka byombi bigakorana.
Muri Transoder-encoder-decoder, ibibazo byo guhuza ibitekerezo bituruka he?
Decoder ikora ibibazo bivuye mubisohoka byakozwe igice, hanyuma ikoresha encoder ibisohoka nkurufunguzo nagaciro kugirango bikurure amakuru yinjiza.
Ni ukubera iki ibyiciro bibiri muburyo bwo guhuza ibitekerezo bishobora kugira uburebure butandukanye?
Kubera ko ibibazo bituruka kumurongo umwe nurufunguzo / indangagaciro ziva mubindi, urutonde rwigenga kandi rushobora gutandukana muburebure, ururimi, cyangwa muburyo.
Nigute Diffusion Stable ikoresha guhuza ibitekerezo?
Kwambukiranya kureka buri gice cyigishusho cyakozwe cyitabira inyandiko yihuta, gishingiye kumashusho mumagambo.
Ni ubuhe buryo bw'imibare bwambukiranya ibitekerezo hamwe no kwiyitaho?
Byombi ukoreshe akadomo kamwe kerekana ibicuruzwa: amanota asa hagati yibibazo nurufunguzo, softmax, hanyuma igiteranyo kiremereye cyagaciro.