Ụdị 1-Bit na Ternary BitNet
BitNet bụ ahịrị nyocha nke Microsoft na-egosi na enwere ike ịzụ ụdị asụsụ buru ibu na oke ibu naanị 1 bit, ma ọ bụ ụkpụrụ atọ n'ime ikpe ternary.
Nchịkọta
This slashes memory and energy use dramatically while keeping surprisingly strong accuracy.
Ime miri emi
Ụdị omenala na-echekwa ibu ọ bụla dị ka ọnụọgụ 16-bit. BitNet dochie ndị a na oke obere-bit nnọchite anya. Ụdị BitNet b1.58 na-enwe mmetụta na-eji ternary arọ, nke ọ bụla na-ejedebe na -1, 0, ma ọ bụ +1, nke na-arụ ọrụ ruo ihe dị ka 1.58 bit nke ozi kwa arọ (log base 2 of 3). Echiche dị oke mkpa bụ na a zụrụ ihe nlereanya ahụ site na mmalite site na mmachi ndị a, ọ bụghị ọnụ ma emesịa, ya mere ọ na-amụta ka ọ sie ike na oke nkenke. N'ihi na ihe ọ̀tụ̀tụ̀ dị nnọọ -1, 0, ma ọ bụ +1, mmụba ọnụ ọnụ na mgbakọ na mwepụ matriks na-adaba na mgbakwunye na mwepu. Nsonaazụ dị obere bandwidth ebe nchekwa, oriri ike, na latency, yana uru 0 na-enye ohere ka ọ dị obere, niile ka ha na-adakọ ụdị nkenke zuru oke na nha nha n'ọtụtụ akara.
Nghọta nka nka
BitNet na-eji oyi akwa BitLinear omenala nke na-akọwapụta ihe ọ̀tụ̀tụ̀ dị arọ ruo ternary yana ịgbalite ka ọ dị obere nkenke n'oge ngafe na-aga n'ihu, ebe ọ na-edobe oyiri 'onyinyo' dị elu maka mmelite gradient site na nleba anya ozugbo. N'ihi na ịdị arọ nke ọ bụla bụ -1, 0, ma ọ bụ +1, ngwaahịa ntụpọ na-achịkwa mgbako mgbako na-aghọ mgbakwunye na mwepu kama ịba ụba nke n'elu mmiri, nke bụ ihe na-emepe ike na ọsọ ọsọ na ngwaike dabara adaba.
Mmetụta atụmatụ
Ọnụ ego na mmefu ego
Mkpebi ihe owuwu ụlọ na-akwalite arụmọrụ yana ọnụ ahịa ọrụ ruo ọtụtụ afọ.
Mkpebi doro anya
Nkà mmụta nka na-enyere ndị otu egwuregwu aka ịhọrọ nchịkọta ziri ezi, ọ bụghị naanị nke kachasị ọhụrụ.
Quality akara
Nhọrọ injinia ka mma na-ebelata ihe omume ntụkwasị obi na mmepụta.
Ọdịnihu nke ụdị 1-Bit na Ternary BitNet
BitNet na-atụ aka n'ọdịdị ebe ụdị nwere ike na-agba na ekwentị, laptọọpụ, na ngwaọrụ ihu na-enweghị GPU datacenter. Isi ọkpọ ọkpọ bụ ngwaike: a na-ewu ibe nke taa maka mgbakọ na mwepụ na-ese n'elu mmiri, yabụ ndị na-eme ngwa ngwa pụrụ iche emebere maka ọrụ mgbakwunye ternary-naanị nwere ike ịba ụba uru. Na-atụ anya ka ụlọ ọrụ 1-bit dị ala karịa, ụdị ụdị BitNet buru ibu, yana ntinye n'ime ndị na-enyere aka ngwaọrụ ebe ndụ batrị na ihe nzuzo, nwere ike ịmegharị akụnụba nke ntinye AI.
Mmejuputa n'ezie n'ụwa
Microsoft's BitNet b1.58 2B4T na-agba ọsọ nke ọma na CPU, na-eme ka ntinye LLM na-enweghị GPU raara onwe ya nye.
Ndị enyemaka ngwaọrụ dabara n'ụdị nwere ike n'ime obere ebe nchekwa ekwentị na-ekele ~ 1.58-bit.
Mbelata ike ntinye na ọnụ ahịa carbon maka ọrụ API dị elu site n'iji mgbakwunye dochie anya ihe na-ese n'elu mmiri na-amụba.
Nbugharị Edge (IoT, ngwaike agbakwunyere) ebe ịdị arọ nke atọ na-eme ka nghọta asụsụ obodo nwee ike n'ime mmefu ego siri ike.
Ihe ize ndụ & okporo ụzọ nche
Ịkwalite otu akara ngosi nwere ike zoo adịghị ike sistemụ sara mbara.
A na-eledakarị ihe akụrụngwa na ụgwọ ọrụ anya.
Ọdịiche nchekwa na nleba anya nwere ike itolite ka sistemu na-adịwanye mgbagwoju anya.
Map mmejuputa
Kọwaa latency, ịdịmma na ebumnuche ọnụ ahịa tupu mmejuputa ya.
Benchmark n'okpuru ibu dị adị na ọnọdụ data.
Nleba anya akụrụngwa maka mperi, ịkpafu na mmetụta onye ọrụ.
Kwadebe ụzọ nzaghachi azụghachi azụ na ihe omume tupu ịchachaa.
Nọgide na-eme nchọpụta
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the 1-Bit and Ternary BitNet Models quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Ntuziaka na-esote
Mmepụta Ụdị Asụsụ Watermarking
Ajụjụ a na-ajụkarị
What is 1-Bit and Ternary BitNet Models?
BitNet bụ ahịrị nyocha nke Microsoft na-egosi na enwere ike ịzụ ụdị asụsụ buru ibu na oke ibu naanị 1 bit, ma ọ bụ ụkpụrụ atọ n'ime ikpe ternary. Nke a na-ebelata ike ebe nchekwa na iji ume n'ụzọ dị egwu ebe ọ na-edobe izi ezi siri ike dị ịtụnanya.
Kedu ihe kpatara eji kọwaa BitNet b1.58 ka ọ na-eji ihe dịka 1.58 bits kwa arọ?
Ọkpụrụkpụ ternary na-ewere otu n'ime ụkpụrụ atọ, na-anọchi anya steeti atọ chọrọ ntọala ndekọ 2 nke 3, ihe dịka 1.58 bits.
Kedu ihe na-eme matriks nke BitNet dị ọnụ ala karịa n'ụdị ọkọlọtọ?
N'iji ịdị arọ ejedebere na -1, 0, na +1, ịmụba site na ịdị arọ na-ebelata n'ịgbakwụnye, mwepu, ma ọ bụ ileghara uru, na-ezere ọnụ ahịa n'elu mmiri na-amụba.
N'oge ọzụzụ, kedu ka BitNet si emelite ihe ọ̀tụ̀tụ̀ ọ̀tụ̀tụ̀ ọ̀tụ̀tụ̀ dị iche iche n'agbanyeghị usoro ngụkọta ọnụ ọgụgụ na-adịghị iche?
BitNet na-edobe nnomi nke ịdị arọ dị elu ma na-eji ihe nleba anya kwụ ọtọ na-agafe gradients site na ọnụọgụgụ, na-enye ohere ịgbasa azụ azụ.
Kedu uru ọzọ nke ikwe ka uru 0 (ternary, ọ bụghị ọnụọgụ abụọ) na-enye?
Steeti 0 na-ahapụ ụfọdụ njikọ ka agbanyụọ nke ọma, na-ewebata sparity nke enwere ike iji ya rụọ ọrụ ọzọ.
Kedu ihe bụ isi ihe ịma aka ngwaike maka ịghọta uru BitNet zuru oke?
Emebere ihe ngwa ngwa nke oge a gburugburu ịgbakọ ọtụtụ n'elu mmiri, yabụ ngwaike raara onwe ya nye maka arụmọrụ dabere na ternary agbakwunyere chọrọ iji kpọghee ọsọ ọsọ na ike BitNet zuru oke.