Ụdị Oghere Ọchịchị steeti na Mamba
Ụdị oghere steeti (SSMs) bụ ụdị usoro nke na-ebuga ozi na-aga n'ihu site na ọnọdụ zoro ezo abịakọrọ, na-eji usoro ogologo na-agbakọ n'ahịrị kama ịnọ n'ụzọ anọ dị ka nlebara anya.
Nchịkọta
Mamba is the 2023 architecture that made SSMs competitive with Transformers by letting that state-update process depend on the input, unlocking efficient handling of very long sequences.
Ime miri emi
Ụdị oghere steeti na-ahazi usoro usoro site na nzọụkwụ, na-ejigide ọnọdụ zoro ezo nke na-achịkọta ihe niile a hụrụ ugbu a. N'ọkwa ọ bụla ọ na-emelite steeti ahụ site na nlọghachite ahịrị ahịrị nke matrices mmụta na-achị (a na-akpọkarị A, B, C) wee wepụta mmepụta. Ọganihu nke SSMs ahaziri ahazi dị ka S4 na-egosi nlọghachite a nwere ike iwepụta ya dị ka ogologo mgbanwe ma zụọ ya nke ọma na ngwaike yiri ya. Isi ihe ọhụrụ nke Mamba bụ selectivity: ọ na-eme ka B, C, na nzọụkwụ-size parameters ọrụ nke ntinye ugbu a, otú ihe nlereanya nwere ike dynamically ikpebi ihe ga-echeta na ihe na-eleghara na nke ọ bụla token. Ntinye ntinye-ndabere na-achụ mgbanwe dị mfe mana a na-enweta ya site na nyocha ngwaike maara nke ọma, na-enye ọzụzụ ogologo oge na ncheta oge niile, ntinye ngwa ngwa.
Nghọta nka nka
Ihe na-akọwa esemokwu bụ myirịta na nhọrọ nhọrọ. Ndị SSM omuma na-eji matrices etinyere na-adabereghị na ya, nke na-eme ka a gbakọọ nlọghachi azụ dị ka otu nnukwu mgbagha - na-enwekarị myirịta mana enweghị ike ịhọpụta ọdịnaya. Nhọrọ nhọrọ nke Mamba na-agbaji aghụghọ convolution ahụ, yabụ ndị ode akwụkwọ wuru kernel yiri nke na-eme ka steeti ahụ dị ngwa ngwa GPU SRAM ma na-ezere itinye ya na ebe nchekwa nwayọ, na-echekwa ọsọ mgbe ị na-enweta echiche maara ihe.
Mmetụta atụmatụ
Mkpebi doro anya
Ọ na-enyere gị aka ikewapụta nkwupụta ọrụ aka doro anya na asụsụ ahịa.
Ọnụ ego na mmefu ego
Ị nwere ike ịjụ ajụjụ mmejuputa iwu ka mma tupu itinye ego ma ọ bụ oge.
Team na usoro ọrụ
Ndị otu nwere nghọta na-eme ka ngwaahịa, amụma na mkpebi mmụta ka mma.
Ọdịnihu nke State Space Model na Mamba
Mamba na ndị ga-anọchi ya (Mamba-2, ụdị Jamba ngwakọ) na-abanye n'ime ngalaba ebe usoro dị ogologo: genomics, ọdịyo mkpebi dị elu, na ọnọdụ ndenye akara ebe nlebara anya quadratic na-amachibidoro. Ihe na-ebute ụzọ bụ ụlọ nleba anya nke na-ahapụ obere nlebara anya ole na ole nwere ọtụtụ ọkwa Mamba, na-edota nlebara anya nke ọma ma na-edobe ọtụtụ nhazi usoro. Na-atụ anya na SSM ga-abụ akụrụngwa ọkọlọtọ n'ime ngwa ngwa ihe dị ogologo karịa karịa ngbanwe mgbanwe mgbanwe n'ogbe.
Mmejuputa n'ezie n'ụwa
Nlereanya DNA na-agbaso ọtụtụ narị puku ụzọ abụọ-ogologo ogologo na genomics, ebe nleba anya nke Transformer agaghị enwe ike ịgbakọ.
Na-ahazi ụdị ebili mmiri nke raw na oke nlele maka ọrụ okwu na egwu na-ewetughị ya.
Na-akwado ụdị ngwakọ nnukwu asụsụ dị ka Jamba na-agwakọta Mamba na nlebara anya maka nghọta ogologo okwu nke ọma.
Ntụnye gụgharia na ngwaọrụ ihu ebe ebe nchekwa oge niile kwa nzọụkwụ na ọgbọ token ngwa ngwa dị mkpa karịa izi ezi kacha elu.
Ihe ize ndụ & okporo ụzọ nche
Otu dị iche iche nwere ike iji otu okwu ahụ mee ihe n'ụzọ dị iche, yabụ kọwapụta oge n'oge.
Ihe nrịbama nwere ike ịdị ike ebe arụmọrụ ụwa na-adaghị adaba.
Ileghara ogo data na atụmatụ nyocha anya na-emepụtakarị nsonaazụ na-adịghị mma.
Map mmejuputa
Malite na nkọwa asụsụ dị larịị nke nsonaazụ ịchọrọ.
Họrọ otu metrik ịga nke ọma na otu ọnọdụ ọdịda tupu nnwale.
Gbaa obere onye na-anya ụgbọ elu nwere data nnọchite anya, ọ bụghị ihe ngosi ngosi na-egbu maramara.
Detuo ebe Model Space State na Mamba na-enyere aka yana ebe ụzọ ndị dị mfe dị mma.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the State Space Models and Mamba quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Oghere Mamba na Nhọrọ steeti
Ajụjụ a na-ajụkarị
What is State Space Models and Mamba?
Ụdị oghere steeti (SSMs) bụ ụdị usoro nke na-ebuga ozi na-aga n'ihu site na ọnọdụ zoro ezo abịakọrọ, na-eji usoro ogologo na-agbakọ n'ahịrị kama ịnọ n'ụzọ anọ dị ka nlebara anya. Mamba bụ ihe owuwu 2023 nke mere SSM ka ha na ndị Transformers na-asọ mpi site n'ikwe ka usoro mmelite steeti ahụ dabere na ntinye, na-emeghe njikwa nke ọma nke usoro ogologo ogologo.
Kedu ka ihe nlereanya oghere steeti nwere ogologo usoro n'ogologo, atụnyere nlebara anya onwe onye ọkọlọtọ?
Ndị SSM na-eji nlọghachi n'ahịrị na nha nha n'ahịrị n'ogologo, ebe nlebara anya onwe onye na-atụnyere akara ọ bụla na nke ọ bụla yana akpịrịkpa anọ.
Gịnị bụ isi ihe ọhụrụ Mamba gbakwunyere na SSM ndị a haziri ahazi dị ka S4?
Mamba na-ewebata SSM ndị ahọpụtara nke B, C na parampat-size bụ ọrụ nke ntinye, na-ahapụ ka ihe nlereanya họrọ ihe ị ga-echeta kwa token.
Kedu ihe kpatara Mamba ji chọọ nyocha myirịta ngwaike maara nke ọma?
Usoro dabere na ntinye (nhọrọ) pụtara na nlọghachite agaghịzi abụ otu mgbagha agbanweela, yabụ kernel yiri ya na-eweghachi ọsọ ọzụzụ.
Kedu usoro ụkpụrụ ụlọ na-ejikọta Mamba na Transformers maka ụdị ogologo oge?
Ngwakọta dị ka Jamba na-agwakọta ọkwa nlebara anya ole na ole (maka icheta nke ọma) na ọtụtụ akwa Mamba ogologo oge, na-edozi izi ezi na arụmọrụ.