Tsare-tsare Hankali
Tsare-tsare ita ce hanyar da ke barin jeri ɗaya ya kalli wani: mai ƙirƙira rubutu na iya zuwa wakilcin maɓalli na shigarwar.
Dubawa
It is how models connect what they are producing to what they read, powering translation, captioning, and modern multimodal systems.
Zurfafa nutsewa
Hankalin kai yana ba da alamun da ke cikin jeri ɗaya alaƙa da juna; Hankalin giciye yana ba da damar jeri ya zana bayanai daga wani daban. A cikin na'ura mai canzawa, kowane ƙarni na mataki yana samar da tambayoyi daga ɓangaren da aka samar, yayin da maɓallai da ƙididdigewa suna fitowa daga abubuwan da aka haɗa. Samfurin yana ƙididdige yadda ya dace kowane ɓangaren shigarwa ya kasance zuwa matsayin fitarwa na yanzu kuma yana ja cikin haɗakar bayanai masu nauyi. Wannan shi ne abin da ke barin mai canza fassarar fassara ya mayar da hankali kan madaidaicin kalmomin tushe yayin da yake rubuta kowace kalma da aka yi niyya. Bayan rubutu, lura da giciye shine manne a cikin nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'ikan nau'in nau'in nau'in iri)” na zamani da na zamani da na zamani da na zamani da na zamani, na zamani da na zamani da na zamani da na zamani da na zamani, na zamani da na zamani da na zamani da na zamani da na zamani da na zamani da na zamani waɗanda ke yin rubutu da na'urorin da ke yin rubutu da na'ura na rubutu, na'urar na'ura ta rubutu za ta iya halartar ayyukan facin hoto, ko samfurin sauti na iya daidaita sauti zuwa kalmomin da aka rubuta. A duk lokacin da ake buƙatar haɗa rafukan bayanai daban-daban guda biyu, kulawar giciye yawanci shine nama mai haɗi.
Fahimtar Fasaha
A kan inji, jan hankalin giciye yana sake yin amfani da ma'auni mai ma'auni-digo-samfurin azaman kulawar kai, tare da karkatarwa ɗaya: tambayoyin suna fitowa daga jeri ɗaya (mai ƙididdigewa) kuma maɓallai/daraja sun fito daga wani (mai rikodin). Yana lissafta ma'aunin hankali azaman softmax akan kamancen maɓalli na tambaya, sannan ya dawo da jimlar ƙimar ƙima. Saboda tambayoyi da maɓallai sun samo asali daga tushe daban-daban, jerin biyun na iya bambanta da tsayi, tsari, ko harshe gaba ɗaya.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Giciye-Hanya
Tsare-tsare-hankali shine ƙara daidaitaccen ƙirar ƙirar ƙirar ɗinki tare. Samfuran yaren hangen nesa suna amfani da shi don haka rubutu zai iya ƙasa a yankuna na hoto; masu samar da hoto na watsawa suna amfani da shi don daidaita pixels akan faɗakarwar rubutu. Bincike yana turawa zuwa ga ingantacciyar kulawar giciye (daidaituwa da bambance-bambancen bambance-bambancen) don sarrafa dogayen takardu, hotuna masu tsayi, da bidiyo. Kamar yadda tsarin AI ke haɗa ƙarin hankali, sa ran matakan kula da giciye suyi aiki azaman masu haɗin duniya masu daidaita rubutu, sauti, hangen nesa, da bayanan da aka tsara.
Aiwatar da Gaskiyar Duniya
A cikin fassarar injin jijiya, mai yankewa ya ketare-hallar zuwa tushen kalmomi don zaɓar fassarar da ta dace ga kowace kalma fitarwa.
Stable Diffusion yana amfani da jan hankali don daidaita kowane yanki na hoto da aka samar akan saƙon rubutu.
Samfuran yare-hangen nesa kamar Flamingo suna barin alamun rubutu su ƙetara zuwa fasalin hoto don amsa tambayar gani.
Maganganun magana-zuwa-rubutu suna ƙetare-hallarta zuwa rufaffiyar firam ɗin odiyo don daidaita sauti tare da kalmomin da ake rubutawa.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Cross-Attention quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Gyaran Hankalin Gaggauta-zuwa-Gaggauta
Tambayoyin da ake yawan yi
What is Cross-Attention?
Tsare-tsare ita ce hanyar da ke barin jeri ɗaya ya kalli wani: mai ƙirƙira rubutu na iya zuwa wakilcin maɓalli na shigarwar. Yadda samfura ke haɗa abin da suke samarwa da abin da suke karantawa, ƙarfafa fassarar, taken magana, da tsarin zamani na zamani.
Mene ne babban bambanci tsakanin kai da kai?
Tsare-tsare yana zana tambayoyi daga jeri ɗaya (misali, dikoda) da maɓalli da ƙima daga wani dabam (misali, mai rikodin), yana barin su biyu suyi hulɗa.
A cikin mai canza rikodin rikodin, daga ina ne tambayoyin jan hankali suka fito?
Mai ƙididdigewa yana samar da tambayoyin daga abin da aka samar da shi na ɗan lokaci, sannan yana amfani da fitinonin rikodi azaman maɓalli da ƙima don jawo bayanan shigar da suka dace.
Me yasa jeri biyu a cikin kulawar giciye zasu iya samun tsayi ko tsari daban-daban?
Tun da tambayoyin sun samo asali daga tushe ɗaya da maɓallai/daraja daga wani, jerin suna da zaman kansu kuma suna iya bambanta da tsayi, harshe, ko tsari.
Ta yaya Stable Diffusion ke amfani da jan hankali?
Tsare-tsare yana ba da damar kowane ɓangaren hoton da aka ƙirƙira ya halarci saƙon rubutu, yana sanya abubuwan gani a cikin kalmomin.
Wane aiki na lissafi ke raba hankali tare da kai?
Dukansu suna amfani da hankali samfurin ɗigo guda ɗaya: maki kamanceceniya tsakanin tambayoyi da maɓallai, softmax, sannan jimlar ƙimar ƙima.