Ikirere cya Leta Icyitegererezo na Mamba
Imiterere yimyanya ya leta (SSMs) nicyitegererezo gikurikirana gitwara amakuru imbere binyuze muri compression ihishe, igapima umurongo hamwe nuburebure bwikurikiranya aho kuba inshuro enye kwitabwaho.
Incamake
Mamba is the 2023 architecture that made SSMs competitive with Transformers by letting that state-update process depend on the input, unlocking efficient handling of very long sequences.
Kwibira cyane
Icyerekezo cya leta cyumwanya gitunganya intambwe ku yindi, ikomeza leta yihishe ivuga muri make ibintu byose bigaragara kugeza ubu. Kuri buri mwanya ivugurura leta hamwe numurongo ugaruka ugengwa na matrices yize (akenshi yanditseho A, B, C) kandi isohora ibisohoka. Iterambere rya SSMs zubatswe nka S4 ryerekanaga ko isubiramo rishobora kwandikwa nkicyemezo kirekire kandi kigatozwa neza kubikoresho bigereranijwe. Mamba y'ingenzi guhanga udushya ni uguhitamo: ituma B, C, nintambwe-ingano yimikorere yibikorwa byinjira, bityo moderi irashobora guhitamo byimazeyo ibyo ugomba kwibuka nibyo ugomba kwirengagiza kuri buri kimenyetso. Iyinjiza-biterwa nigitekerezo cyoroshye ariko igarurwa hamwe nicyuma-kimenyekanisha parallel scan, gitanga umurongo-igihe cyamahugurwa hamwe no guhora-kwibuka, gufata umwanzuro.
Ubushishozi
Gusobanura impagarara ni parallelism hamwe no guhitamo. SSMs isanzwe ikoresha matrices ihamye, yinjiza-yigenga, ituma ibisubiramo bibarwa nkicyemezo kimwe kinini - birasa cyane ariko ntibishobora guhitamo gushungura ibirimo. Ibipimo byatoranijwe bya Mamba bisenya ayo mayeri yo kwemeza, abanditsi rero bubatse igenamigambi ryisanzuye rya scan kernel ituma leta yihuta muri GPU SRAM kandi ikirinda kuyishyira mububiko bwihuse, ikabika umuvuduko mugihe wungutse ibitekerezo.
Ingaruka z'Ingamba
Ibyemezo bisobanutse
Iragufasha gutandukanya ibyifuzo bya tekiniki bisobanutse nururimi rwo kwamamaza.
Igiciro na bije
Urashobora kubaza ibibazo byiza byo gushyira mubikorwa mbere yo gukoresha amafaranga cyangwa igihe.
Itsinda hamwe nakazi
Amakipe asangiye ibitekerezo akora ibicuruzwa byiza, politiki, nibyemezo byo kwiga.
Ejo hazaza h'icyitegererezo cya Leta hamwe na Mamba
Mamba n'abasimbuye (Mamba-2, moderi ya Jamba ya Hybrid) barimo gusunika muri domaine aho urutonde rurerure cyane: genomics, amajwi y’ibisubizo bihanitse, hamwe na miriyoni-yerekana aho ibiciro bya quadratic bibujijwe. Icyerekezo cyambere ni ubwubatsi bwa Hybrid buhuza ibice bike byitondewe hamwe na Mamba nyinshi, bigashimangira kwibutsa neza mugihe ugumya kubara. Tegereza SSMs kugirango ibe ikintu gisanzwe mubikoresho birebire-aho kugirango bisimburwe byinshi.
Gushyira mu bikorwa Isi
Kwerekana ADN ikurikirana ibihumbi magana-fatizo-ndende muri genomics, aho Guhindura ibitekerezo byaba ari kubara bidashoboka.
Gutunganya amajwi mbisi yerekana amajwi hejuru yikigereranyo cyo hejuru kumvugo n'imirimo ya muzika nta gupfobya.
Imbaraga za Hybrid nini yindimi nka Jamba ivanga Mamba hamwe nibitekerezo kugirango ubashe gusobanukirwa neza.
Gutondekanya kumurongo wibikoresho aho guhora wibuka kuri buri ntambwe kandi byihuta byerekana ibimenyetso birenze ukuri.
Ingaruka & Kurinda
Amakipe atandukanye arashobora gukoresha ijambo rimwe muburyo butandukanye, sobanura intera hakiri kare.
Ibipimo birashobora kugaragara bikomeye mugihe imikorere-yisi-itaringaniye.
Kwirengagiza ubuziranenge bwamakuru na gahunda yo gusuzuma akenshi bitanga ibisubizo byoroshye.
Igishushanyo mbonera
Tangira nururimi rusobanutse rwibisubizo ukeneye.
Toranya intsinzi imwe hamwe nuburyo bumwe bwo gutsindwa mbere yo kwipimisha.
Koresha umuderevu muto hamwe namakuru ahagarariye, ntabwo ari demo yashizweho.
Inyandiko aho Leta ya Moderi ya Leta na Mamba ifasha nuburyo bworoshye bworoshye.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the State Space Models and Mamba quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Umwanya wa Leta ya Mamba
Ibibazo bikunze kubazwa
What is State Space Models and Mamba?
Imiterere yimyanya ya leta (SSMs) nicyitegererezo gikurikirana gitwara amakuru imbere binyuze muri compression ihishe, igapima umurongo hamwe nuburebure bwikurikiranya aho kuba inshuro enye kwitabwaho. Mamba nubwubatsi bwa 2023 bwatumye SSMs irushanwa na Transformers ureka iyo gahunda yo kuvugurura leta biterwa ninjiza, ifungura neza imikorere ikurikirana cyane.
Nigute leta yerekana umwanya munini hamwe nuburebure bwikurikiranya, ugereranije no kwiyitaho bisanzwe?
SSMs itondekanya hamwe numurongo ugaruka hamwe nubunini buringaniye muburebure, mugihe kwiyitaho kugereranya buri kimenyetso na buriwese hamwe nubunzani.
Ni ubuhe buryo bushya Mamba yongeyeho kuri SSM zubatswe mbere nka S4?
Mamba itangiza SSM zatoranijwe zifite B, C, nintambwe-nini yintambwe ni imikorere yinjiza, kureka icyitegererezo gihitamo icyo kwibuka kuri buri kimenyetso.
Ni ukubera iki Mamba yari akeneye ibyuma byabigenewe-bimenyerewe kubisikana?
Iyinjiza-rishingiye (guhitamo) ibipimo bisobanura ko kugaruka bitagishobora kuba umwanzuro umwe uhamye, bityo parallel scan kernel igarura umuvuduko wamahugurwa.
Ni ubuhe buryo bwububiko buhuza Mamba na Transformers kumurongo muremure?
Hybride nka Jamba ivanga ibyerekezo bike (kugirango wibuke neza) hamwe numurongo-munini-Mamba ibice, kuringaniza neza no gukora neza.