HejuruUbuyobozi bukurikira
Amazi Yururimi Icyitegererezo Ibisohoka
Tekiniki
Ubuyobozi bwa tekiniki
BitNet ni __AIU_PROTECTED_5 __ umurongo wubushakashatsi bwerekana ko imiterere yindimi nini ishobora gutozwa hamwe nuburemere bugarukira kuri bit 1 gusa, cyangwa indangagaciro eshatu murubanza rwa ternary.
Umva iki gitaboAI-byavuzwe · ~2 min
Ibi bigabanya cyane koreshwa ry'umubare w'ibikubiye n'ingufu, mu gihe ubushobozi bwo kugira ukuri buguma buri hejuru.
Moderi isanzwe ibika buri buremere nkumubare wa 16-bit. BitNet isimbuza ibi hamwe na bito-bito byerekana. Impinduka zikomeye za BitNet b1.58 ikoresha uburemere bwa ternary, buriwese igarukira kuri -1, 0, cyangwa +1, ikora kugeza kuri 1.58 bits yamakuru kuburemere (log base 2 of 3). Igitekerezo cyingenzi nuko icyitegererezo cyatojwe kuva kera hamwe nizi mbogamizi, ntikigereranijwe nyuma, bityo cyiga gukomera kuburyo bugaragara. Kuberako ibiro ari -1, 0, cyangwa +1, kugwiza bihenze muri matrix math gusenyuka mubyongeweho no gukuramo. Igisubizo kiri hasi cyane yibuka ryagutse, gukoresha ingufu, nubukererwe, hamwe nagaciro 0 nako gashobora kuba gake, byose mugihe bihuye byuzuye-byuzuye byerekana urugero ugereranije kubipimo byinshi.
__AIU_PROTECTED_5 __ 'BitNet b1.58 2B4T ikora neza kuri CPU, ituma LLM ifata nta GPU yabigenewe.
Abafasha ku bikoresho bihuza moderi ishoboye mububiko buke bwa terefone bitewe nuburemere ~ 1.58-bit.
Kugabanya ingufu zifatika hamwe nigiciro cya karubone kubikorwa byinshi bya serivisi za API mugusimbuza kureremba-ingingo kugwiza hamwe ninyongera.
Ibikorwa byoherejwe (IoT, ibyuma byinjizwamo) aho uburemere bwa ternary butuma ururimi rwaho rusobanuka neza muri bije yingufu zingufu.
BitNet yerekeza ahazaza aho moderi ishoboye ikorera kuri terefone, mudasobwa zigendanwa, hamwe nibikoresho bidafite datacenter GPUs. Inzitizi nyamukuru ni ibyuma: ibyuma byuyu munsi byubatswe kubibare bireremba-mibare, kubwibyo byihuta byihariye byongerewe imbaraga kuri ternary yongeyeho-ibikorwa gusa bishobora kugwiza inyungu. Tegereza byinshi kavukire ya 1-bit, imiterere nini ya BitNet, hamwe no kwinjiza mubufasha bwibikoresho aho ubuzima bwa bateri nibibazo byihariye, birashoboka kuvugurura ubukungu bwa AI.
Ibaruwa y'amakuru y'ubuntu
Inkuru eshatu zizewe za AI buri gitondo cy'iminsi y'akazi, zanditse mu rurimi rworoshye. Ubuntu iteka ryose, nta kwamamaza.
Imeri imwe buri munsi y'akazi. Kwiyimura mu buryo bumwe. Ntitwigera tugurisha cyangwa ngo dusangire aderesi yawe.
Isuzume
Ibisubizo ako kanya kuri buri kibazo, n'icyemezo gishobora gusangirwa gifite ID yagenzurwa umaze gutsinda isomo.
Fasha uburezi bwa AI bw'ubuntu. AI Understanding ni umuryango utegamiye kuri leta wa 501(c)(3) — nta kwamamaza, nta kwishyura, iteka ryose. Tanga impano
BitNet ni __AIU_PROTECTED_5 __ umurongo wubushakashatsi bwerekana ko imiterere yindimi nini ishobora gutozwa hamwe nuburemere bugarukira kuri bit 1 gusa, cyangwa indangagaciro eshatu murubanza rwa ternary. Ibi bigabanya kwibuka nimbaraga zikoreshwa mugihe gikomeza bitangaje.
Ibipimo bya ternary bifata kimwe mubintu bitatu, kandi guhagararira leta eshatu bisaba log base 2 ya 3, hafi 1.58 bits.
Hamwe nuburemere bugarukira kuri -1, 0, na +1, kugwiza uburemere bigabanuka kongeramo, gukuramo, cyangwa kwirengagiza agaciro, wirinda kugendagenda hejuru-ingingo kugwira.
BitNet ibika neza-neza neza kopi yuburemere kandi ikoresha igereranya-igereranya igereranya gradients binyuze mukubara, igafasha gusubira inyuma.
Leta 0 ireka amahuriro amwe azimya neza, atangiza ubuke bushobora gukoreshwa kugirango bikorwe neza.
Kwihuta kwuyu munsi byateguwe hafi yo kugwiza-ingingo, bityo ibyuma byabugenewe kubikorwa bya ternary byongeweho bishingiye kubikorwa birakenewe kugirango ufungure byimazeyo umuvuduko wa BitNet ninyungu zingufu.
Komeza wige
Abandi bayobozi batoranijwe kuriyi ngingo
HejuruUbuyobozi bukurikira
Amazi Yururimi Icyitegererezo Ibisohoka
Tekiniki