Incamake
Quantisation igabanya moderi ya AI ibika nimero zayo neza, kuburyo moderi yari ikeneye data-center GPU irashobora rimwe na rimwe gukora kuri mudasobwa igendanwa cyangwa terefone. Nuburiganya nyamukuru butuma imiterere yururimi runini ihendutse kandi byihuse kugirango ikoreshwe henshi.
Quantisation ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo.
Kwibira cyane
Umuyoboro udasanzwe ni ikirundo kinini cyimibare bita uburemere, mubisanzwe ubikwa nka 16- cyangwa 32-bit-kureremba-ngingo. Quantisation yongeye kubika ibyo bipimo ukoresheje bits nkeya, mubisanzwe 8-bit (INT8) cyangwa na 4-bit integer. Uhereye kuri 16-bit ukagera kuri 4-biti bigabanya kwibuka hafi inshuro enye, bityo moderi ya miliyari 70-ibipimo bikenera hafi 140GB kuri 16-bit irashobora guhuza hafi 35GB kuri 4-bit. Imibare mito nayo inyura mububiko bwihuse, mubisanzwe byihutisha ibisekuruza. Ifatwa nukuri: gukanda indangagaciro zingirakamaro murwego ruto zitangiza ikosa. Uburyo bwiza bugabanya icyo gihombo uhitamo witonze ibintu bipima no kurinda uburemere bworoshye, bityo moderi yitwara hafi kimwe mugihe ikoresha igice cyibikoresho.
Ubushishozi
Buri tsinda ryibipimo bibona igipimo cyerekana ikarita nyayo kumurongo muto wuzuye; kugwiza inyuma kubipimo hafi yubaka umubare wambere. Uburyo bwo kubara nyuma yimyitozo nka GPTQ na AWQ isesengura dataset ntoya kugirango hamenyekane uburemere bwingenzi kandi ushireho umunzani kugirango ugabanye amakosa yasohotse, aho kuzenguruka ibintu byose buhumyi. Ibikorwa bikunze kubikwa neza cyane kuko biratandukanye mugihe cyo gukora. Igisubizo nicyitegererezo kibika 4-bit integer ariko ikabara ibisubizo hafi cyane ya verisiyo yuzuye.
Kumenya Kwiga
Quantisation igabanya moderi ya AI ibika nimero zayo neza, kuburyo moderi yari ikeneye data-center GPU irashobora rimwe na rimwe gukora kuri mudasobwa igendanwa cyangwa terefone. Nuburiganya nyamukuru butuma imiterere yururimi runini ihendutse kandi byihuse kugirango ikoreshwe henshi. Quantisation ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo. Kugirango wubake byimbitse, fata Quantisation nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha Quantization igishushanyo mbonera, kugarura, no gusubiramo imirongo nka sisitemu imwe y'itumanaho ihuriweho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mugihe kimwe, ibintu bya Hallucinated birashobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Yagura uburyo bwindimi nuburyo bwo gutumanaho. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Gukoresha uburyo bwo kuganira nka Llama mugace ka GPU ukoresha umuguzi wa 4-bit ya GGUF cyangwa GPTQ aho gukenera amakarita menshi yamakuru.
Abafasha ku bikoresho kuri terefone, aho moderi 8-bit cyangwa 4-biti reka imvugo nibiranga inyandiko bikore nta murongo uhuza.
Kugabanya ibicu byerekana igiciro kubakiriya-baterankunga ukoresheje moderi ya INT8, ihuza ibyifuzo byinshi kuri buri GPU.
Ibikoresho byo kumpera nka kamera yubwenge cyangwa sensor ya IoT ikoresha comptabilite igizwe nicyerekezo cyururimi-rugero ntarengwa rwo kwibuka.
Uburyo bwo Gushyira mu bikorwa
Umubare mubikorwa
Gukoresha uburyo bwo kuganira nka Llama mugace ka GPU ukoresha umuguzi wa 4-bit ya GGUF cyangwa GPTQ aho gukenera amakarita menshi yamakuru.
Gukoresha uburyo bwo kuganira nka Llama mugace kamwe kubakoresha GPU ukoresheje dosiye ya biti 4 ya GGUF cyangwa GPTQ aho gukenera amakarita menshi ya data-centre Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Umubare mubikorwa
Abafasha ku bikoresho kuri terefone, aho moderi 8-bit cyangwa 4-biti reka imvugo nibiranga inyandiko bikore nta murongo uhuza.
Abafasha ku bikoresho kuri terefone, aho moderi ya 8-bit cyangwa 4-biti ireka imvugo nibiranga inyandiko bikora nta muyoboro uhuza Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Umubare mubikorwa
Kugabanya ibicu byerekana igiciro kubakiriya-baterankunga ukoresheje moderi ya INT8, ihuza ibyifuzo byinshi kuri buri GPU.
Kugabanya ibiciro byerekana ibicuruzwa byunganira abakiriya ukoresheje moderi ya INT8, guhuza ibyifuzo byinshi kuri buri kipe ya GPU mubisanzwe ibona ibisubizo byiza iyo isobanuye ibipimo byujuje ubuziranenge imbere, igakomeza inzira yo kuzamura abantu kubibazo, kandi ikurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Umubare mubikorwa
Ibikoresho byo kumpera nka kamera yubwenge cyangwa sensor ya IoT ikoresha comptabilite igizwe nicyerekezo cyururimi-rugero ntarengwa rwo kwibuka.
Ibikoresho byo kumpande nka kamera yubwenge cyangwa sensor ya IoT ikoresha urugero rwerekana urugero rwururimi-rwerekana imipaka ntarengwa yibuka Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere imbere, agakomeza inzira yo kuzamuka kwabantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Komeza kugenzura abantu kugenzura ibisubizo byinshi. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.