HejuruUbuyobozi bukurikira
Imirongo Yitondewe hamwe nudukoryo
Tekiniki
Ururimi AI
RWKV ni imyubakire itoza nka Transformer ariko ikoresha umwanzuro nkurusobe rusubirwamo, rutanga umurongo-umwanya, uhoraho-wibuke.
Umva iki gitaboAI-byavuzwe · ~2 min
Ivugurura ibitekerezo kugirango hatabaho ikiguzi cya quadratic kandi nta terambere ryingenzi-agaciro cache.
RWKV (bisobanurwa ngo 'RwaKuv') bisobanura Kwakira, Uburemere, Urufunguzo, Agaciro, ibintu bine byingenzi. Yakozwe ahanini nkumushinga ufunguye, uyobowe nabaturage bayobowe na Bo Peng. Intego nugukomeza guhuza imyitozo ya Transformers mugihe ukuraho umwanzuro wabo uhenze. Ibitekerezo bisanzwe bibika urufunguzo-agaciro cache ikura hamwe na buri kimenyetso kandi igereranya buri kimenyetso gishya nicyabanjirije. RWKV ahubwo itwara akantu gato gafite ubunini-bwihishe leta imbere, kuyivugurura hamwe nigihe cyo kubora kugirango amakuru ashaje ashire neza. Mugihe cyamahugurwa irashobora gufungurwa muburyo bubangikanye; mugihe cyibisekuruza ikora nka RNN itanga ikimenyetso kimwe icyarimwe kubiciro bihoraho. Ibi bituma bikurura ibintu birebire hamwe nibikoresho bitagabanijwe.
Gukoresha ubushobozi bwo gufungura-isoko yo kuganira kuri CPU cyangwa ibikoresho-byibukwa buke hamwe nububiko buhoraho kuri buri kimenyetso
Streaming text generation aho ibimenyetso bikorerwa icyarimwe icyarimwe nta cache ikura
Gutunganya inyandiko ndende aho Transformer urufunguzo-agaciro cache yaba nini cyane
Umuganda hamwe nindimi nyinshi zicyitegererezo zikeneye imyubakire ikora neza, yemewe kumugaragaro
RWKV yagarutse byihuse binyuze muri verisiyo (v4, v5 Eagle, v6 Finch na nyuma yayo), igabanya ikinyuranyo cyiza hamwe na Transformers mugihe ikomeza igiciro cyumurongo. Witege ko uzakomeza gukura muburyo bwo gufungura indimi nyinshi, impande zose hamwe na CPU aho buri gihe bibuka ibintu byingenzi, hamwe n'ibishushanyo mbonera. Umwanzuro wacyo usubiramo rwose bituma uba umukandida ukomeye mugutondekanya porogaramu hamwe nigihe kirekire cyane aho urufunguzo-agaciro cashe ubundi yaturika.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
RWKV ni imyubakire itoza nka Transformer ariko ikoresha umwanzuro nkurusobe rusubirwamo, rutanga umurongo-umwanya, uhoraho-wibuke. Ivugurura ibitekerezo kugirango hatabaho ikiguzi cya quadratic kandi nta terambere ryingenzi-agaciro cache.
Intego yo gushushanya ya RWKV irasa na Transformer-yuburyo bwamahugurwa hamwe nibisubirwamo, guhora-ibiciro.
RWKV yitiriwe ibice bine byayo: Kwakira, Uburemere, Urufunguzo, nagaciro.
Kimwe na RNN, RWKV ivugurura imiterere-yubunini ihagaze buri ntambwe, bityo kwibuka ntibikura hamwe nuburebure bwikurikiranya.
Kwiga kuri buri muyoboro kubora byerekana uburyo urufunguzo rwashize rugenda rwangirika muri reta ikora.
Ukoresheje gusubiramo, kuruhande rwa RWKV ugereranya buri kimenyetso nikindi kimenyetso, ukuraho igiciro cya quadratic.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Imirongo Yitondewe hamwe nudukoryo
Tekiniki