InoteveraGaidhi rinotevera
Watermarking Mutauro Model Outputs
Tekinoroji
Nhungamiro yehunyanzvi
1-Bit uye Ternary BitNet Models
BitNet ndiyo Microsoft's tsvagiridzo inoratidza kuti mhando dzemitauro mikuru inogona kudzidziswa nehuremu hunoganhurirwa kubhiti 1 chete, kana matatu matatu muchiitiko chechipiri.
Teerera kugwaro iriAI-yakarondedzerwa · ~2 min
Pa peji ino2 min verenga
Pfupiso
Izvi zvinoderedza ndangariro uye kushandiswa kwesimba zvakanyanya uku uchichengeta huchokwadi hwakasimba hunoshamisa.
Kudzika Kwakadzika
Mamodheru akajairika anochengeta huremu hwega hwega senhamba ye16-bit. BitNet inotsiva izvi nekunyanyisa yakaderera-bit inomiririra. Iyo inopesvedzera BitNet b1.58 musiyano inoshandisa ternary uremu, imwe neimwe inoganhurirwa ku -1, 0, kana +1, inoshanda kusvika ku1.58 bits eruzivo pahuremu (log base 2 ye3). Pfungwa yakakosha ndeyekuti iyo modhi inodzidziswa kubva kutanga nezvipingaidzo izvi, kwete kuverengerwa mushure, saka inodzidza kuve yakasimba kune yakaganhurwa chaiyo. Nekuti huremu hungori -1, 0, kana +1, kuwedzeredza kunodhura mumatrix math inodonha mukuwedzera nekubvisa. Mhedzisiro yacho yakadzikira zvakanyanya memory bandwidth, kushandiswa kwesimba, uye latency, ine kukosha kwe0 zvakare inogonesa sparsity, zvese izvi zvichifananidza yakazara-chaiyo modhi pahukuru hwakafanana pamabhenji mazhinji.
Kuitwa muNyika yeChokwadi
Microsoft's BitNet b1.58 2B4T inoshanda zvakanaka paCPU, ichigonesa LLM kufungidzira pasina GPU yakatsaurirwa.
Pa-chishandiso vabatsiri vanokwana modhi inokwanisa mundangariro shoma yefoni nekuda kwe ~ 1.58-bit uremu.
Kuderedza inference simba uye kabhoni mutengo weakakwira-vhoriyamu API masevhisi nekutsiva inoyangarara-nzvimbo inowanza nekuwedzera.
Edge deployments (IoT, yakamisikidzwa Hardware) uko ternary uremu inoita kuti kunzwisisa kwemutauro kugoneke mukati mesimba remabhajeti.
Ramangwana re1-Bit uye Ternary BitNet Models
BitNet inonongedza kumberi uko mamodheru anokwanisa anomhanya pamafoni, malaptop, uye edge zvishandiso zvisina datacenter GPU. Iyo huru bhodhoro ndeye Hardware: machipi anhasi akavakirwa anoyangarara-point math, saka nyanzvi dzekukwidziridza dzakagadziridzwa kune ternary yekuwedzera-chete mashandiro anogona kuwedzera mabhenefiti. Tarisira mamwe madhizaini e1-bit, akakura BitNet-maitiro emhando, uye kubatanidzwa mune-pa-mudziyo vabatsiri uko hupenyu hwebhatiri uye zvakavanzika zvine basa, zvichigona kugadzirisa zvakare hupfumi hweAI inference.
Kuzvishandisa
Nei zvichikosha
- Mutengo uye bhajeti. Zvisarudzo zvezvivakwa zvinotyaira kuita uye mutengo wekushandisa kwemakore.
- Sarudzo dzakajeka. Dzidzo yehunyanzvi inobatsira zvikwata kusarudza murwi wakakodzera, kwete iwo mutsva chete.
- Kudzora kwemhando yepamusoro. Sarudzo dzeinjiniya dziri nani dzinoderedza zviitiko zvekuvimbika mukugadzira.
Chenjera
- Kugadzirisa imwe bhenji kunogona kuvanza yakafara system kushaya simba.
- Infrastructure uye mari yekugadzirisa inowanzotarisirwa pasi.
- Chengetedzo uye kucherechedzwa mapundu anogona kukura sezvo masisitimu anowedzera kuoma.
Matanho anotevera
- Tsanangura latency, mhando, uye mutengo zvinangwa usati waitwa.
- Benchmark pasi pechokwadi mutoro uye data mamiriro.
- Chishandiso chekutarisa zvikanganiso, kudonha, uye mushandisi maitiro.
- Gadzirira nzira dzekudzosera kumashure uye dzezviitiko usati wawedzera.
Ramba Uchiongorora
Tsamba yemahara
Tora iyo yemazuva ese AI pfupiso
Nhatu dzakasimbiswa dzeAI nyaya mangwanani ega ega pakati pevhiki, dzakanyorwa neChirungu chakajeka. Yemahara zvachose, hapana ads.
Imwe email zuva rega rega revhiki. Bvisa kunyoresa kamwe chete. Hatimbotengese kana kugovera kero yako.
Zviedze iwe pachako
Take the 1-Bit and Ternary BitNet Models quiz
Mhinduro yepakarepo pamhinduro yega yega, uye chitupa chinogovaniswa chine ID inobatika kana wapedza kosi.
Tsigira dzidzo yemahara yeAI. AI Understanding ndeye 501(c)(3) isingabatsiri - hapana ads, hapana paywall, zvachose. Ita chipo
Mibvunzo inowanzo bvunzwa
Chii chinonzi 1-Bit uye Ternary BitNet Models?
BitNet ndiyo Microsoft's tsvagiridzo inoratidza kuti mhando dzemitauro mikuru inogona kudzidziswa nehuremu hunoganhurirwa kubhiti 1 chete, kana matatu matatu muchiitiko chechipiri. Izvi zvinoderedza ndangariro uye kushandiswa kwesimba zvakanyanya uku uchichengeta huchokwadi hwakasimba hunoshamisa.
Sei BitNet b1.58 ichitsanangurwa sekushandisa zvingangoita 1.58 bits pahuremu?
Ternary huremu hunotora imwe yematatu, uye inomiririra nyika nhatu inoda log base 2 ye3, ingangoita 1.58 bits.
Chii chinoita kuti BitNet's matrix mashandiro akachipa pane akajairwa modhi?
Zviine huremu hunogumira ku -1, 0, uye +1, kuwanda nehuremu kunoderedza kuwedzera, kubvisa, kana kufuratira kukosha, kudzivirira kuwanda kwenzvimbo inoyangarara inodhura.
Panguva yekudzidziswa, BitNet inogadziridza sei uremu kunyangwe isiri-yakasarudzika quantization nhanho?
BitNet inochengeta yakakwira-chaiyo master kopi yehuremu uye inoshandisa iyo yakatwasuka-kuburikidza estimator kupfuudza gradients kuburikidza neiyo quantization, ichigonesa yakajairika backpropagation.
Ndeipi imwe bhenefiti inobvumira kukosha 0 (ternary, kwete yakachena bhinari) inopa?
Iyo 0 nyika inoita kuti zvimwe zvinongedzo zvivharwe zvinobudirira, zvichiunza sparsity inogona kushandiswa kuti iwedzere kushanda zvakanaka.
Ndeipi dambudziko guru remahara rekuona BitNet's izere kunyatsoshanda kuwana?
Mafambisirwo emazuva ano akagadzirwa akatenderedza-inoyangarara-nzvimbo yekuwedzera, saka yakatsaurirwa Hardware yeternary yekuwedzera-yakavakirwa mashandiro inodiwa kuvhura zvizere kumhanya kweBitNet uye simba mabhenefiti.
Ramba uchidzidza
Mazano anoenderana
Mamwe madhairekitori akasarudzirwa nyaya iyi