Mamba da Wuraren Jiha Mai Zaɓa
Mamba wani tsari ne na jeri wanda aka gina akan ƙirar sararin samaniya (SSMs) wanda ke sarrafa rubutu a cikin lokaci na layi, yana ba da madadin sauri ga mai jujjuyawar mai canzawa.
Dubawa
Its key trick is making the model selectively decide what to remember and forget based on the input itself.
Zurfafa nutsewa
Mamba, wanda Albert Gu da Tri Dao suka gabatar a ƙarshen 2023, an gina su akan tsarin sararin samaniyar jiha. SSM na al'ada yana damfara duk tarihin jeri zuwa ƙayyadaddun yanayin ɓoyayyiyar girma kuma yana sabunta shi mataki-mataki, kamar ƙayyadaddun cibiyar sadarwa mai maimaitawa. Ci gaban shine zaɓi: Mamba yana sanya sigogin SSM (nawa don kiyayewa, nawa don bari a ciki) ya dogara da alamar yanzu, don haka ƙirar zata iya mai da hankali kan kalmomin da suka dace kuma suyi watsi da filler. Wannan yana ƙyale ƙayyadaddun jihar guda ɗaya ta yi aiki kamar ƙwaƙwalwar sanin abun ciki. Saboda yana guje wa kwatanta kowane alama da kowace alama, Mamba yana daidaita daidai da tsayin jeri kuma yana tsayawa kan dogon bayanai kamar genomes, audio, ko rubutu mai tsayi.
Fahimtar Fasaha
Samfurin sararin samaniya na jiha yana yin taswirorin shigarwa zuwa fitarwa ta hanyar ci gaba da tsarin layin layi wanda aka ayyana ta matrices A, B, C da girman mataki delta. Tun da farko SSMs sun kiyaye waɗannan ƙayyadaddun, suna ba da damar hangen nesa cikin sauri. Mamba yana yin ayyukan B, C, da delta na shigarwar, wanda ke karya gajeriyar hanyar jujjuyawar, don haka a maimakon haka yana amfani da na'ura mai kwatankwacin kayan masarufi da aka adana a cikin GPU SRAM mai sauri don dawo da sauri yayin samun ƙwaƙwalwar dogaro da shigarwa.
Dabarun Tasiri
Gudu da sikelin
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Shiga ku isa
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Shawarwari masu haske
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Makomar Mamba da Zaɓuɓɓukan Jiha
Mamba da magajinsa Mamba-2 suna turawa cikin gine-ginen gine-gine waɗanda ke ba da ɗimbin matakan kulawa tare da yadudduka na SSM da yawa, suna ɗaukar ƙarfin duka biyun. Yi tsammanin SSMs a cikin mataimakan yanayi na dogon lokaci, samfuran kan na'ura inda aka ƙuntata ƙwaƙwalwar ajiya, da wuraren da ba na rubutu ba kamar DNA da sauti. Bincike yana bincika ko tsantsar SSMs za su iya daidaita Masu Taswira akan ayyukan da ke buƙatar ainihin tunawa, da kuma ko sun daidaita zuwa mafi girman girman ƙira.
Aiwatar da Gaskiyar Duniya
Samfuran jeri-nauyi na DNA masu tsayin gaske inda masu canjin alamar miliyoyin suna da tsada sosai
Ƙaddamar da mataimakan harshe na dogon lokaci waɗanda ke taƙaita duka littattafai ba tare da yanke ba
Ƙirƙirar sauti na lokaci-lokaci da ƙirar magana waɗanda ke aiwatar da tsarin raƙuman ruwa yadda ya kamata
A kan na'ura ko ƙaƙƙarfan turawa inda ƙaramin ƙayyadaddun ƙayyadaddun yanayi mai maimaitawa yana adana ƙwaƙwalwar ajiya tare da ma'ajin kulawa mai girma.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Ci gaba da Bincike
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the Mamba and Selective State Spaces quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Jagora na gaba
Samfuran Sararin Samaniya na Jiha da Mamba
Tambayoyin da ake yawan yi
What is Mamba and Selective State Spaces?
Mamba wani tsari ne na jeri wanda aka gina akan ƙirar sararin samaniya (SSMs) wanda ke sarrafa rubutu a cikin lokaci na layi, yana ba da madadin sauri ga mai jujjuyawar mai canzawa. Babban dabararsa shine sanya samfurin zaɓin zaɓi abin da zai tuna da mantawa bisa shigar da kanta.
Menene babban fa'idar lissafin Mamba akan daidaitaccen Transformer?
Mamba yana guje wa kwatancen alamar nau'i-nau'i-nau'i-nau'i, don haka farashin sa yana girma daidai gwargwado tare da tsayin jeri maimakon hankali kamar quadratically.
Menene kalmar 'zaɓi' ke nufi a Mamba?
Zaɓin zaɓi yana nufin sigogi kamar B, C, da delta sun zama ayyuka na shigarwar yanzu, suna ba da ƙwaƙwalwar sanin abun ciki.
Ta yaya samfurin sararin samaniya na jiha ke wakiltar tarihin jeri?
SSMs samfura ne masu maimaitawa waɗanda ke ninka abubuwan da suka gabata zuwa ƙayyadaddun yanayi, kama da RNN.
Me yasa Mamba ba zai iya amfani da gajeriyar hanyar juyin juya hali da SSMs a baya suka yi amfani da ita ba?
Duban juzu'i yana buƙatar ƙayyadaddun sigogi (masu bambanta lokaci); Matsalolin da suka dogara da shigarwa sun karya hakan, don haka Mamba yana amfani da sikanin layi ɗaya maimakon.
Wace dabara Mamba ke amfani da ita don tsayawa cikin sauri duk da rasa gajeriyar hanyar juyin juya hali?
Mamba yana amfani da na'urar zaɓaɓɓen kayan masarufi wanda ke riƙe matsakaicin jihohi a cikin sauri SRAM don dawo da kayan aiki.