HejuruUbuyobozi bukurikira
Guhagarika-Ntibisanzwe na Kavukire Ntibisanzwe
Tekiniki
Ururimi AI
Kwitonda gake bituma Transformers ihendutse kureka buri kimenyetso cyitabira gusa igice cyatoranijwe neza cyibindi bimenyetso aho kuba byose.
Umva iki gitaboAI-byavuzwe · ~2 min
This trades a little global reach for big savings in memory and compute on long sequences.
Kwiyitaho kwuzuye kugereranya buri kimenyetso nikindi kimenyetso, bityo igiciro gikura hamwe na kare yuburebure bwikurikiranya, bikababaza inyandiko ndende. Ubwitonzi budasanzwe busimbuza ishusho yuzuye nuburyo bwubatswe. Ibishushanyo bisanzwe birimo kunyerera-idirishya (hafi) kwitondera, aho buri kimenyetso kibona abaturanyi gusa; Inzira zigenda cyangwa zagutse zisimbuka imbere kugirango zigere ku ntera ya kure ihendutse; n'ibimenyetso byisi yose, imyanya mike idasanzwe yitabira ibintu byose kandi ko ibintu byose byitabira, bikora nkamakuru yamakuru. Moderi nka Longformer, BigBird, na Sparse Transformer ihuza ibi bityo umubare rusange wibihuza ukura hafi kumurongo aho kuba inshuro enye, bigafasha ibice byibihumbi kugeza ku bihumbi mirongo.
Longformer itunganya impapuro zose zubumenyi cyangwa inyandiko zemewe mumurongo umwe ukoresheje kunyerera-idirishya wongeyeho isi yose
BigBird ikora inyandiko-ndende ikibazo gisubiza hamwe na genomics ikurikiranye hamwe n'umurongo-wo gupima
Incamake yibitabo-uburebure bwigitabo aho kwitondera byuzuye byananiza GPU yibuka
Gushakisha hamwe na sisitemu ndende yo kuganira ikoresha isi ya hub tokens kugirango yerekane amakuru yingenzi kubihumbi
Kwitonda gake bikomeza kuba ingenzi kumurongo muremure-wo kwerekana imiterere, bigenda bihuzwa hamwe nintungamubiri zitezimbere nka FlashAttention hamwe nubumenyi bwize cyangwa imbaraga zidasanzwe zitoranya ibimenyetso byo kwitabira kwinjiza. Mugihe imiterere ya Windows irambuye miriyoni yikimenyetso, ibice bivangavanze bivanga gake, byuzuye, hamwe na leta-umwanya. Tegereza ibyuma-bimenyesha ibyuma bito hamwe na maritire ishingiye kubitekerezo kugirango ukomeze kugabanya ikiguzi cyo gusoma inyongeramusaruro ndende.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
Kwitonda gake bituma Transformers ihendutse kureka buri kimenyetso cyitabira gusa igice cyatoranijwe neza cyibindi bimenyetso aho kuba byose. Ibi bigurisha gato kwisi yose kubitsa binini murwibutso no kubara kumurongo muremure.
Ubwitonzi bwuzuye bugereranya buri kimenyetso nikindi kimenyetso, gitanga O (N squared) igiciro mugihe no kwibuka.
Ibitekerezo byaho bigabanya buri kimenyetso cyo kureba kumadirishya ihamye yikimenyetso, kugabanya ibiciro kuburyo bugaragara.
Ibimenyetso bike kwisi bihuza imyanya yose, kureka amakuru atembera murwego rwose ruhendutse.
BigBird yerekanye imiterere yayo idasanzwe ni igereranya rusange ryimikorere ikurikirana mugihe igereranije neza.
Mugabanye guhuza Windows yaho wongeyeho amahuza make yisi yose, amahuza yose akura kumurongo.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Guhagarika-Ntibisanzwe na Kavukire Ntibisanzwe
Tekiniki