HejuruUbuyobozi bukurikira
Ikirere cya Leta Icyitegererezo na Mamba
Ibyingenzi
Ururimi AI
Mamba nicyitegererezo cyubatswe cyubatswe kumwanya wa leta (SSMs) itunganya inyandiko mugihe cyumurongo, itanga ubundi buryo bwihuse kubitekerezo bya Transformer.
Umva iki gitaboAI-byavuzwe · ~2 min
Amayeri yingenzi ni ugukora icyitegererezo guhitamo icyo kwibuka no kwibagirwa ukurikije ibyinjijwe ubwabyo.
Mamba, yatangijwe na Albert Gu na Tri Dao mu mpera za 2023, yubatswe ku cyitegererezo cya leta cyubatswe. SSM isanzwe ikomatanya amateka yose yurukurikirane muburyo bugaragara-bwihishe leta ikanayivugurura intambwe ku yindi, nkumuyoboro uhoraho usubiramo. Iterambere ni uguhitamo: Mamba ikora ibipimo bya SSM (uko ugomba kubika, amafaranga yo kureka) biterwa nikimenyetso kigezweho, bityo icyitegererezo gishobora kwibanda kumagambo ajyanye no kwirengagiza uwuzuza. Ibi bireka imwe ihamye-ya leta ikora nkibintu-byibukwa kwibuka. Kuberako irinda kugereranya buri kimenyetso nikindi kimenyetso, umunzani wa Mamba ugereranya umurongo hamwe nuburebure bwikurikiranya kandi ukaguma byihuse kubintu byinjira cyane nka genome, amajwi, cyangwa inyandiko-ndende y'ibitabo.
Kwerekana urugero rurerure cyane rwa ADN aho miliyoni-token Transformers ihenze cyane
Guha imbaraga imvugo ndende-abafasha mu ncamake ibitabo byose bitagabanije
Ibihe nyabyo byamajwi hamwe no kwerekana imvugo itunganya imivumba mbisi neza
Kuri-igikoresho cyangwa impande zoherejwe aho ntoya ihamye-ingano isubiramo leta ibika kwibuka hamwe nubwitonzi bukura
Mamba nuwasimbuye Mamba-2 barimo gusunika mubwubatsi bwa Hybrid buhuza ibice bike byitondewe hamwe na SSM nyinshi, bifata imbaraga zombi. Tegereza SSMs mubufasha-burebure-burebure, ku bikoresho byerekana ibikoresho aho kwibuka bibujijwe, hamwe na domaine itari inyandiko nka ADN n'amajwi. Ubushakashatsi burimo gusuzuma niba SSMs nziza ishobora guhuza na Transformers kumirimo ikeneye kwibukwa neza, kandi niba igereranya ubunini bunini bw'icyitegererezo.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Mamba nicyitegererezo cyubatswe cyubatswe kumwanya wa leta (SSMs) itunganya inyandiko mugihe cyumurongo, itanga ubundi buryo bwihuse kubitekerezo bya Transformer. Amayeri yingenzi ni ugukora icyitegererezo guhitamo icyo kwibuka no kwibagirwa ukurikije ibyinjijwe ubwabyo.
Mamba yirinda byose-bigereranya ibimenyetso, bityo igiciro cyacyo gikura neza hamwe nuburebure bwikurikiranya aho kuba inshuro enye nko kwitabwaho.
Guhitamo bisobanura ibipimo nka B, C, na delta bihinduka ibikorwa byinjiza byubu, bitanga ububiko-bwibuke.
SSMs ni moderi isubirwamo-yuburyo bugenda bwuzuza ibyahise muburyo bunini, busa na RNN.
Kwemeza kureba bisaba ibipimo bihamye (igihe-bidahinduka); Iyinjiza-ishingiye ku bipimo bimena ibyo, Mamba rero ikoresha parallel scan aho.
Mamba ikoresha ibyuma-bimenyesha guhitamo scan ikomeza leta hagati muri SRAM yihuse kugirango igarure ibyinjira.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Ikirere cya Leta Icyitegererezo na Mamba
Ibyingenzi