Ururimi AI

Ntibisanzwe

Kwitonda gake bituma Transformers ihendutse kureka buri kimenyetso cyitabira gusa igice cyatoranijwe neza cyibindi bimenyetso aho kuba byose.

Umva iki gitaboAI-byavuzwe · ~2 min

Kuriyi page2 min soma
  1. Incamake
  2. Kwibira cyane
  3. Gushyira mu bikorwa Isi
  4. Kazoza Kudakunze kwitabwaho
  5. Kubishyira mubikorwa
  6. Komeza Ubushakashatsi
  7. Ibibazo bikunze kubazwa

Incamake

This trades a little global reach for big savings in memory and compute on long sequences.

Kwibira cyane

Kwiyitaho kwuzuye kugereranya buri kimenyetso nikindi kimenyetso, bityo igiciro gikura hamwe na kare yuburebure bwikurikiranya, bikababaza inyandiko ndende. Ubwitonzi budasanzwe busimbuza ishusho yuzuye nuburyo bwubatswe. Ibishushanyo bisanzwe birimo kunyerera-idirishya (hafi) kwitondera, aho buri kimenyetso kibona abaturanyi gusa; Inzira zigenda cyangwa zagutse zisimbuka imbere kugirango zigere ku ntera ya kure ihendutse; n'ibimenyetso byisi yose, imyanya mike idasanzwe yitabira ibintu byose kandi ko ibintu byose byitabira, bikora nkamakuru yamakuru. Moderi nka Longformer, BigBird, na Sparse Transformer ihuza ibi bityo umubare rusange wibihuza ukura hafi kumurongo aho kuba inshuro enye, bigafasha ibice byibihumbi kugeza ku bihumbi mirongo.

Gushyira mu bikorwa Isi

Longformer itunganya impapuro zose zubumenyi cyangwa inyandiko zemewe mumurongo umwe ukoresheje kunyerera-idirishya wongeyeho isi yose

BigBird ikora inyandiko-ndende ikibazo gisubiza hamwe na genomics ikurikiranye hamwe n'umurongo-wo gupima

Incamake yibitabo-uburebure bwigitabo aho kwitondera byuzuye byananiza GPU yibuka

Gushakisha hamwe na sisitemu ndende yo kuganira ikoresha isi ya hub tokens kugirango yerekane amakuru yingenzi kubihumbi

Kazoza Kudakunze kwitabwaho

Kwitonda gake bikomeza kuba ingenzi kumurongo muremure-wo kwerekana imiterere, bigenda bihuzwa hamwe nintungamubiri zitezimbere nka FlashAttention hamwe nubumenyi bwize cyangwa imbaraga zidasanzwe zitoranya ibimenyetso byo kwitabira kwinjiza. Mugihe imiterere ya Windows irambuye miriyoni yikimenyetso, ibice bivangavanze bivanga gake, byuzuye, hamwe na leta-umwanya. Tegereza ibyuma-bimenyesha ibyuma bito hamwe na maritire ishingiye kubitekerezo kugirango ukomeze kugabanya ikiguzi cyo gusoma inyongeramusaruro ndende.

Kubishyira mubikorwa

Impamvu ari ngombwa

  • Umuvuduko n'igipimo. Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
  • Kugera no kugera. Yagura uburyo bwindimi nuburyo bwo gutumanaho.
  • Ibyemezo bisobanutse. Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.

Witondere

  • Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
  • Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
  • Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.

Intambwe ikurikira

  1. Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
  2. Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
  3. Komeza kugenzura abantu kugenzura ibisubizo byinshi.
  4. Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.

Komeza Ubushakashatsi

Ibaruwa y'amakuru y'ubuntu

Ibuka amakuru ya buri munsi ya AI

Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.

Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.

Isuzume

Take the Sparse Attention Patterns quiz

Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.

Tangira ikibazo

Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano

Ibibazo bikunze kubazwa

What is Sparse Attention Patterns?

Kwitonda gake bituma Transformers ihendutse kureka buri kimenyetso cyitabira gusa igice cyatoranijwe neza cyibindi bimenyetso aho kuba byose. Ibi bigurisha gato kwisi yose kubitsa binini murwibutso no kubara kumurongo muremure.

Kuki kwiyitaho byuzuye bihenze kurikurikirane?

Ubwitonzi bwuzuye bugereranya buri kimenyetso nikindi kimenyetso, gitanga O (N squared) igiciro mugihe no kwibuka.

Niki kunyerera-idirishya (hafi) kwitondera?

Ibitekerezo byaho bigabanya buri kimenyetso cyo kureba kumadirishya ihamye yikimenyetso, kugabanya ibiciro kuburyo bugaragara.

Niyihe ntego ya 'global tokens' mubitekerezo bidakunze kubaho?

Ibimenyetso bike kwisi bihuza imyanya yose, kureka amakuru atembera murwego rwose ruhendutse.

Ni ubuhe buryo bwagaragaje ko guhuza ibintu bidasanzwe, idirishya, hamwe nisi yose bikomeza kwitabwaho byuzuye?

BigBird yerekanye imiterere yayo idasanzwe ni igereranya rusange ryimikorere ikurikirana mugihe igereranije neza.

Hafi yukuntu umubare wibihuza wapima muburyo bwateguwe neza?

Mugabanye guhuza Windows yaho wongeyeho amahuza make yisi yose, amahuza yose akura kumurongo.