Cross-Ntị
Nleba anya n'ofe bụ usoro na-eme ka otu usoro lebakwuo anya n'ọzọ: onye na-emepụta ederede nwere ike ịga na nnochite anya ihe ntinye koodu.
Nchịkọta
It is how models connect what they are producing to what they read, powering translation, captioning, and modern multimodal systems.
Ime miri emi
Nlebara anya onwe onye na-eme ka akara ngosi n'ime otu usoro metụtara ibe ya; Nleba anya n'ofe na-eme ka usoro dị n'usoro wepụta ozi site na nke dị iche. N'ime ihe ngbanwe ihe ntụgharị, usoro nzọụkwụ ọ bụla na-etolite ajụjụ site na mmepụta nke ewepụtara, ebe igodo na ụkpụrụ na-abịa site na ntinye koodu. Ihe nlereanya ahụ na-agbakọ ka ihe ntinye ọ bụla si daba na ọnọdụ mmepụta ugbu a ma dọta na ngwakọta ozi ntinye dị arọ. Nke a bụ ihe na-eme ka onye ngbanwe ntụgharị mee ka ọ lekwasị anya na mkpụrụokwu isi mmalite dị mma ka ọ na-ede okwu ebumnuche ọ bụla. Na agafe ederede, nlebara anya n'ofe bụ gluu dị n'ụdị multimodal: ihe ngbanwe ederede nwere ike ịga na njirimara patch oyiyi, ma ọ bụ ụdị ọdịyo nwere ike ịhazi ụda na okwu edere. Mgbe ọ bụla ọ dị mkpa ijikọ iyi abụọ dị iche iche nke ozi, nlebara anya na-abụkarị anụ ahụ njikọ.
Nghọta nka nka
N'usoro, nlebara anya nlebara anya na-eji otu usoro ntụpọ ntụpọ dị ka nlebara anya onwe onye, nwere otu ntụgharị: ajụjụ na-abịa site n'otu usoro (ihe ngbanwe) na igodo/ụkpụrụ sitere na nke ọzọ (nkode). Ọ na-agbakọ nha nlebara anya dị ka softmax n'elu myirịta nke igodo ajụjụ, wee weghachi nchikota ụkpụrụ dị arọ. N'ihi na ajụjụ na igodo sitere na ebe dị iche iche, usoro abụọ a nwere ike ịdị iche n'ogologo, ụdị, ma ọ bụ asụsụ kpamkpam.
Mmetụta atụmatụ
Ọsọ na ọnụ ọgụgụ
Usoro ọrụ asụsụ nwere ike ịga ngwa ngwa n'achụghị nkwụsi ike.
Nweta na iru
Ọ na-agbasawanye ohere n'ofe asụsụ na ụdị nzikọrịta ozi.
Mkpebi doro anya
Ndị otu nwere ike itinyekwu oge na ikpe ebe akpaaka na-ejikwa nkwughachi.
Ọdịnihu nke Cross-ntị
Nleba anya n'ofe na-abawanye na ọkọlọtọ ọkọlọtọ maka usoro ịdụkọta ọnụ. Ụdị asụsụ ọhụụ na-eji ya mee ka ederede nwee ike ịdaba na mpaghara oyiyi; ndị na-emepụta onyonyo mgbasa ozi na-eji ya mee ka pikselụ dị na mkpali ederede. Nnyocha na-akwalite nleba anya nleba anya nke ọma karị (linear na variants dị iche iche) iji jikwaa akwụkwọ ogologo, ihe onyonyo dị elu, na vidiyo. Ka sistemụ AI na-ejikọtakwu uche, na-atụ anya ka nlebara anya nlebara anya ga-arụ ọrụ dị ka njikọ zuru ụwa ọnụ na-ahazi ederede, ụda, ọhụụ, na data ahaziri ahazi.
Mmejuputa n'ezie n'ụwa
Na ntụgharị igwe akwara, onye ngbanwe na-aga n'ihu iji nweta okwu iji họrọ ntụgharị ziri ezi maka mkpụrụokwu ọ bụla.
Stable Diffusion na-eji nlebara anya ga-edobe mpaghara onyonyo ọ bụla ewepụtara na ngwa ngwa ederede.
Ụdị asụsụ ọhụụ dị ka Flamingo na-ahapụ akara ederede gafere na njirimara onyonyo maka ịza ajụjụ anya.
Ndị na-achọpụta okwu na ederede na-aga n'ihu na fremu ọdịyo agbakwunyere iji kwado ụda na okwu ndị a na-edegharị.
Ihe ize ndụ & okporo ụzọ nche
Eziokwu ndị e chepụtara echepụta nwere ike jiri nwayọ tinye akụkọ, nkwado nkwado, ma ọ bụ nsonaazụ nyocha.
Mmetụta ngwa ngwa nwere ike ịmepụta nsonaazụ na-ekwekọghị ekwekọ n'ofe arịrịọ ndị yiri ya.
Enwere ike ikpughe data ederede nwere mmetụta ma ọ bụrụ na njikwa ohere adịghị ike.
Map mmejuputa
Kọwaa usoro mmepụta, ụda, na ụkpụrụ ịdịmma tupu ibugharị.
Weghachite nzaghachi site na isi mmalite ntụkwasị obi mgbe ọ bụla izi ezi dị mkpa.
Debe ebe nleba anya mmadụ maka mpụta dị elu.
Sochie ụkpụrụ ọdịda ma na-azụghachi mkpali ma ọ bụ usoro ọrụ mgbe niile.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Cross-Attention quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Ndezigharị nlebara anya gafere ngwa ngwa
Ajụjụ a na-ajụkarị
What is Cross-Attention?
Nleba anya n'ofe bụ usoro na-eme ka otu usoro lebakwuo anya n'ọzọ: onye na-emepụta ederede nwere ike ịga na nnochite anya ihe ntinye koodu. Ọ bụ ka ụdịdị si ejikọta ihe ha na-emepụta na ihe ha na-agụ, na-eme ka ntụgharị asụsụ dị ike, edemede isiokwu, na usoro multimodal ọgbara ọhụrụ.
Kedu ihe bụ isi ihe dị iche n'etiti nlebara anya onwe onye na nlebara anya?
Nleba anya n'ofe na-adọta ajụjụ site na otu usoro (dịka ọmụmaatụ, decoder) yana igodo na ụkpụrụ sitere na nke dị iche (dịka ọmụmaatụ, koodu ntinye), na-ahapụ ka ha abụọ na-emekọrịta ihe.
N'ime ihe ngbanwe mgbanwe koodu, kedu ebe ajuju maka nlebara anya obe si abịa?
Ihe ngbanwe ahụ na-etolite ajụjụ site na mmepụta akụkụ ya ewepụtara, wee na-eji ntinye koodu dị ka igodo na ụkpụrụ iji dọpụta ozi ntinye dị mkpa.
Kedu ihe kpatara usoro abụọ ahụ na nlebara anya ga-esi nwee ogologo ma ọ bụ ụdị dị iche iche?
Ebe ọ bụ na ajụjụ si n'otu ebe na igodo/ụkpụrụ sitere na nke ọzọ, usoro ndị a nwere onwe ha ma nwee ike ịdị iche n'ogologo, asụsụ, ma ọ bụ ụdị.
Kedu ka Stable Diffusion si eji nlebara anya gafee?
Nleba anya n'ofe na-eme ka akụkụ nke ọ bụla nke onyonyo emepụtara gaa na ngwa ngwa ederede, na-agbadata ihe onyonyo n'okwu ndị ahụ.
Kedu ọrụ mgbakọ na mwepụ ka nlebara anya na-ekere òkè na nlebara anya onwe onye?
Ha abụọ na-eji otu nleba anya ngwaahịa ntụpọ: myirịta dị n'etiti ajụjụ na igodo, softmax, wee nchikota ụkpụrụ dị arọ.