Xiga xigaHagaha xiga
Tafatirka Feejignaanta Isku-tallaabta ee degdega ah-si-degdegga ah
Muuqaal AI
Luqadda AI HAGAHA
Fiiro gaar ah
Cross-attention lets queries from one representation attend to keys and values from another representation.
Dhageyso hagahanAI-waa laga sheekeeyay · ~2 min
Boggaan2 daqiiqo akhri
Dulmar
It is used to connect source and target sequences or different modalities.
quusid qoto dheer
Cross-attention lets queries from one representation attend to keys and values from another. The Transformer uses this in encoder-decoder layers; latent diffusion uses it for text-conditioned generation. Flamingo uses gated cross-attention layers to connect visual features to a language model and is designed to ingest arbitrarily interleaved visual and textual inputs, including images or video. These are architecture-specific examples, not a universal multimodal design. In Flamingo, cross-attention blocks are gated by a tanh-transformed learned scalar initialized to zero; this is an architecture-specific control and not a claim about how often cross-attention is used across multimodal systems.
Dhaqangelinta Adduunka-dhabta ah
In an encoder-decoder Transformer, decoder queries attend to encoder outputs.
Latent diffusion models use cross-attention to condition image latents on text embeddings.
Flamingo inserts cross-attention layers so a language model can use visual features.
Different sequence lengths are possible because queries and key-value context need not have matching lengths.
Mustaqbalka Feejignaanta Isdhaafsiga
When inspecting a multimodal model, identify which stream supplies queries and which supplies keys and values. Evaluate alignment and failure cases across the relevant modalities. The cited papers do not establish one universal cross-attention design.
Ku dhaqangelinta
Maxay muhiim u tahay
- Xawaaraha iyo miisaanka. Socodka shaqada luqaddu si dhakhso leh ayay u socon kartaa iyada oo aan la hurayn joogteynta.
- Helitaanka iyo gaarsiinta. Waxay balaadhisaa gelitaanka luqadaha iyo qaababka isgaarsiinta.
- Go'aamo cad. Kooxuhu waxay waqti badan ku qaadan karaan xukunka halka otomaatiggu uu qabanayo ku celcelinta.
Iska ilaali
- Xaqiiqooyinka dhalanteed waxay si deggan u geli karaan warbixinnada, taageerada socodka, ama natiijooyinka cilmi-baarista.
- Dareenka degdega ahi wuxuu abuuri karaa natiijooyin aan iswaafaqayn codsiyada la midka ah.
- Xogta qoraalka xasaasiga ah ayaa laga yaabaa in la kashifo haddii kontaroolada gelitaanka ay daciif yihiin.
Tallaabooyinka xiga
- Qeex qaabka wax soo saarka, codka, iyo heerarka tayada ka hor inta aan la baahin.
- Jawaabaha salka ku haya ilo lagu kalsoon yahay mar kasta oo saxnidu ay muhiim tahay.
- Hayso isbaarada dib u eegista bini aadamka ee wax soo saarka sare.
- Lasoco qaababka guuldarada oo dib u leyli dardargelinta ama socodka shaqada si joogto ah.
Sii wad Sahaminta
Warqad bilaash ah
Hel warbixinta maalinlaha ah ee AI
Saddex sheeko oo la xaqiijiyay oo AI ah maalin kasta oo shaqo ah, oo lagu qoray Ingiriis fudud. Bilaash had iyo jeer, aan xayaysiis lahayn.
Hal iimayl maalin kasta oo shaqo ah. Ka bax hal gujin. Marna ma iibinno ama ma wadaagno ciwaankaaga.
Is tijaabi
Take the Cross-Attention quiz
Fikrad degdeg ah oo ku saabsan jawaab kasta, iyo shahaado la wadaajin karo oo leh aqoonsi la xaqiijin karo markaad ka gudubto koorso.
Taageer waxbarashada AI bilaashka ah. AI Understanding waa 501(c)(3) aan faa'iido doon ahayn — xayaysiis la'aan, albaab lacag ah ma jiro, had iyo jeer. Samee deeq
Su'aalaha soo noqnoqda
Waa maxay Feejignaan-dhaaf?
Cross-attention lets queries from one representation attend to keys and values from another representation. It is used to connect source and target sequences or different modalities.
Waa maxay farqiga ugu muhiimsan ee u dhexeeya is-fiirinta iyo is-fiirinta?
Fiiro gaar ah waxay ka soo jiidataa weydiimaha hal taxane (tusaale, furaha) iyo furayaasha iyo qiyamka mid ka duwan (tusaale, codeeyaha), taas oo u oggolaanaysa in labadoodu is dhexgalaan.
Beddelka-dekodeeriyaha, halkee ayay ka yimaadaan weydiimaha feejignaanta?
Codeeyaha wuxuu ka sameeyaa weydiimaha wax-soo-saarkiisa qayb ahaan la soo saaray, dabadeed wuxuu adeegsadaa soo-saarka codeer sida furayaasha iyo qiyamka si uu u soo jiido macluumaadka gelinta ee habboon.
Waa maxay sababta labada tixood ee isku-tallaabta ah ay u yeelan karaan dherer ama qaabab kala duwan?
Maadaama su'aaluhu ay ka soo jeedaan hal il iyo furayaal/qiyam ka yimid mid kale, tixdu waa kuwo madaxbannaan oo waxay ku kala duwanaan karaan dhererka, luqadda, ama qaabka.
Sidee buu Stable Diffusion u adeegsadaa feejignaanta?
Feejignaanta-is-daawaynta waxay u oggolaanaysaa qayb kasta oo ka mid ah sawirka la soo saaray inay soo xaadiraan qoraalka degdegga ah, iyaga oo dhulka dhigaya muuqaallada ereyada.
Waa maxay hawlgalka xisaabeed ee isdhaafsiga la wadaago is-fiirsashada?
Labaduba waxay isticmaalaan feejignaan isku mid ah dhibcaha dhibcaha: dhibcaha isku midka ah ee u dhexeeya weydiimaha iyo furayaasha, softmax, ka dibna wadarta qiimaha.
Sii wad waxbarashada
Tilmaamaha la xidhiidha
Tilmaamayaal badan ayaa loo doortay mawduucan