1-Bit na Ternary BitNet Model
BitNet ni __AIU_PROTECTED_5 __ umurongo wubushakashatsi bwerekana ko imiterere yindimi nini ishobora gutozwa hamwe nuburemere bugarukira kuri bit 1 gusa, cyangwa indangagaciro eshatu murubanza rwa ternary.
Incamake
This slashes memory and energy use dramatically while keeping surprisingly strong accuracy.
Kwibira cyane
Moderi isanzwe ibika buri buremere nkumubare wa 16-bit. BitNet isimbuza ibi hamwe na bito-bito byerekana. Impinduka zikomeye za BitNet b1.58 ikoresha uburemere bwa ternary, buriwese igarukira kuri -1, 0, cyangwa +1, ikora kugeza kuri 1.58 bits yamakuru kuburemere (log base 2 of 3). Igitekerezo cyingenzi nuko icyitegererezo cyatojwe kuva kera hamwe nizi mbogamizi, ntikigereranijwe nyuma, bityo cyiga gukomera kuburyo bugaragara. Kuberako ibiro ari -1, 0, cyangwa +1, kugwiza bihenze muri matrix math gusenyuka mubyongeweho no gukuramo. Igisubizo kiri hasi cyane yibuka ryagutse, gukoresha ingufu, nubukererwe, hamwe nagaciro 0 nako gashobora kuba gake, byose mugihe bihuye byuzuye-byuzuye byerekana urugero ugereranije kubipimo byinshi.
Ubushishozi
BitNet ikoresha igenamigambi rya BitLinear igereranya uburemere kuri ternary hamwe na activations kugirango bisobanuke neza mugihe cyo gutambuka imbere, mugihe ukomeje kopi-yuzuye 'igicucu' kopi yuburemere kugirango igende neza ikoresheje igereranya. Kuberako buri buremere ari -1, 0, cyangwa +1, ibicuruzwa byadomo byiganjemo compte ya transformateur bihinduka ibyongeweho no gukuramo aho kureremba-ingingo igwira, aribyo bifungura ingufu nubwiyongere bwihuse kubikoresho bikwiye.
Ingaruka z'Ingamba
Igiciro na bije
Ibyemezo byubwubatsi bitwara imikorere nigiciro cyimikorere kumyaka.
Ibyemezo bisobanutse
Ubuhanga bwa tekinike bufasha amakipe guhitamo umurongo ukwiye, ntabwo ari shyashya gusa.
Kugenzura ubuziranenge
Guhitamo neza bya injeniyeri bigabanya ibintu byizewe mubikorwa.
Kazoza ka 1-Bit na Ternary BitNet Model
BitNet yerekeza ahazaza aho moderi ishoboye ikorera kuri terefone, mudasobwa zigendanwa, hamwe nibikoresho bidafite datacenter GPUs. Inzitizi nyamukuru ni ibyuma: ibyuma byuyu munsi byubatswe kubibare bireremba-mibare, kubwibyo byihuta byihariye byongerewe imbaraga kuri ternary yongeyeho-ibikorwa gusa bishobora kugwiza inyungu. Tegereza byinshi kavukire ya 1-bit, imiterere nini ya BitNet, hamwe no kwinjiza mubufasha bwibikoresho aho ubuzima bwa bateri nibibazo byihariye, birashoboka kuvugurura ubukungu bwa AI.
Gushyira mu bikorwa Isi
__AIU_PROTECTED_5 __ 'BitNet b1.58 2B4T ikora neza kuri CPU, ituma LLM ifata nta GPU yabigenewe.
Abafasha ku bikoresho bihuza moderi ishoboye mububiko buke bwa terefone bitewe nuburemere ~ 1.58-bit.
Kugabanya ingufu zifatika hamwe nigiciro cya karubone kubikorwa byinshi bya serivisi za API mugusimbuza kureremba-ingingo kugwiza hamwe ninyongera.
Ibikorwa byoherejwe (IoT, ibyuma byinjizwamo) aho uburemere bwa ternary butuma ururimi rwaho rusobanuka neza muri bije yingufu zingufu.
Ingaruka & Kurinda
Gutezimbere igipimo kimwe gishobora guhisha intege nke za sisitemu.
Ibikorwa Remezo no kubungabunga akenshi usanga bidahabwa agaciro.
Icyuho cyumutekano no kwitegereza birashobora kwiyongera uko sisitemu igenda igorana.
Igishushanyo mbonera
Sobanura ubukererwe, ubuziranenge, nigiciro cyibiciro mbere yo kubishyira mubikorwa.
Ibipimo byerekana umutwaro ufatika hamwe namakuru yimiterere.
Gukurikirana ibikoresho kubikosa, drift, ningaruka zabakoresha.
Tegura inzira yo gusubiza ibyabaye mbere yo gupima.
Komeza Ubushakashatsi
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the 1-Bit and Ternary BitNet Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ubuyobozi bukurikira
Amazi Yururimi Icyitegererezo Ibisohoka
Ibibazo bikunze kubazwa
What is 1-Bit and Ternary BitNet Models?
BitNet ni __AIU_PROTECTED_5 __ umurongo wubushakashatsi bwerekana ko imiterere yindimi nini ishobora gutozwa hamwe nuburemere bugarukira kuri bit 1 gusa, cyangwa indangagaciro eshatu murubanza rwa ternary. Ibi bigabanya kwibuka nimbaraga zikoreshwa mugihe gikomeza bitangaje.
Kuki BitNet b1.58 isobanurwa ko ikoresha hafi 1.58 bits kuburemere?
Ibipimo bya ternary bifata kimwe mubintu bitatu, kandi guhagararira leta eshatu bisaba log base 2 ya 3, hafi 1.58 bits.
Niki gituma ibikorwa bya matrix ya BitNet bihendutse kuruta muburyo busanzwe?
Hamwe nuburemere bugarukira kuri -1, 0, na +1, kugwiza uburemere bigabanuka kongeramo, gukuramo, cyangwa kwirengagiza agaciro, wirinda kugendagenda hejuru-ingingo kugwira.
Mugihe cyamahugurwa, nigute BitNet ivugurura uburemere nubwo intambwe yo gutandukanya itandukanye?
BitNet ibika neza-neza neza kopi yuburemere kandi ikoresha igereranya-igereranya igereranya gradients binyuze mukubara, igafasha gusubira inyuma.
Ni izihe nyungu zinyongera zemerera agaciro 0 (ternary, ntabwo ari binary) zitanga?
Leta 0 ireka amahuriro amwe azimya neza, atangiza ubuke bushobora gukoreshwa kugirango bikorwe neza.
Ni ikihe kibazo nyamukuru cyibikoresho byo kumenya BitNet yunguka neza?
Kwihuta kwuyu munsi byateguwe hafi yo kugwiza-ingingo, bityo ibyuma byabugenewe kubikorwa bya ternary byongeweho bishingiye kubikorwa birakenewe kugirango ufungure byimazeyo umuvuduko wa BitNet ninyungu zingufu.