Incamake
QLoRA nubuhanga butuma uhuza neza urugero rwururimi runini kumuguzi umwe GPU ubika moderi yahagaritswe mubice 4 gusa kuburemere. Cyakoze gukora moderi ya 65B-parameter ishoboka kubikoresho byabanje gukora gusa moderi igice cyubunini.
QLoRA na 4-Bit Byiza-Guhuza ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo.
Kwibira cyane
Mubisanzwe, gutunganya neza moderi nini bisobanura gupakira uburemere bwose muri 16-bit neza no kuvugurura byose, bisaba kwibuka cyane. QLoRA ikomatanya ibitekerezo bibiri. Ubwa mbere, ihagarika icyitegererezo cyateganijwe ikagereranya kugeza kuri 4 bits, igabanya kwibuka hafi inshuro enye. Icya kabiri, ikoresha LoRA: aho kuvugurura matrike nini yuburemere, itera inshinge ntoya yo gutozwa yo mu rwego rwo hasi ya adaptor matrices iruhande rwabo, bityo miriyoni nkeya gusa zikaba zivugururwa. 4-bit shingiro igumaho mugihe gradients zinyura gusa muri adaptate nto. Yamenyekanye mu 2023 na Dettmers na bagenzi be, QLoRA yerekanye ko guhuza neza moderi ya 65B kuri imwe ya 48GB GPU ishobora guhuza ubuziranenge bwuzuye 16-bitunganijwe neza.
Ubushishozi
QLoRA yerekanye amayeri atatu. NF4. Umubare wikubye kabiri ugabanya umubare uhoraho ubwabo, ukabika ububiko bwinyongera. Impapuro zogukoresha zikoresha ububiko bwa GPU-CPU kugirango zinjize imitoma mugihe kirekire, ikingira impanuka yibuka. Mugihe cyimbere ninyuma yinyuma, uburemere bwa 4 bit bitandukanijwe kugeza kuri 16-bit-gusa-mugihe cya matrix kugwira, hanyuma bikajugunywa.
Kumenya QLoRA na 4-Bit Byiza-Guhuza
QLoRA nubuhanga butuma uhuza neza urugero rwururimi runini kumuguzi umwe GPU ubika moderi yahagaritswe mubice 4 gusa kuburemere. Cyakoze gukora moderi ya 65B-parameter ishoboka kubikoresho byabanje gukora gusa moderi igice cyubunini. QLoRA na 4-Bit Byiza-Guhuza ni igice cyururimi-AI ikoreshwa mu gusoma, kubyara, gushyira mu byiciro, no guhindura inyandiko n'imvugo ku gipimo. Kugirango wubake byimbitse, fata QLoRA na 4-Bit Byiza-Guhuza nkicyitegererezo gikora, ntabwo ari ikintu kimwe: gusobanura ibyagezweho, gusobanura ibitekerezo, no gutandukanya ibyo sisitemu ishobora gukora byizewe nibisaba guca imanza zinzobere.
Mu myitozo, amakipe akomeye akoresha QLoRA na 4-Bit Byiza-Guhuza igishushanyo mbonera, kugarura, no gusubiramo imirongo nka sisitemu imwe y'itumanaho ihuriweho. Bandika ibipimo ngenderwaho byerekana intsinzi, bagerageza kurwanya amakuru afatika hamwe nakazi keza, kandi bagasubiramo bashingiye kubikorwa byagaragaye ko batsinzwe aho gutsinda inshuro imwe. Aha niho imyumvire yubumenyi ihinduka mubushobozi burambye kubicuruzwa, politiki, nibikorwa.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mugihe kimwe, ibintu bya Hallucinated birashobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi. Uburyo bukomeye cyane ni uguhuza umuvuduko wikigereranyo hamwe na disipuline yimiyoborere: kuyobora abaderevu, gufata ibimenyetso, gutangaza ibyemezo byicyemezo, no gukomeza kuvugurura uburyo bwo kwirinda nkimyitwarire yicyitegererezo, ibyo abakoresha bategereje, nibisabwa n'amategeko bigenda bihinduka.
Ingaruka z'Ingamba
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika.
Ururimi rwakazi rushobora kugenda byihuse nta gutamba guhuzagurika. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Yagura uburyo bwindimi nuburyo bwo gutumanaho.
Yagura uburyo bwindimi nuburyo bwo gutumanaho. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo.
Amakipe arashobora kumara umwanya munini murubanza mugihe automatike ikora gusubiramo. Mubikorwa byujuje ubuziranenge, ibi bihindurwa mumategeko agenga imikorere, imipaka nyirubwite, hamwe n'imihango yo gusubiramo kenshi kugirango amakipe ashobore kwigirira ikizere aho gupima ibidasobanutse.
Gushyira mu bikorwa Isi
Gutangira neza-gutunganya neza moderi ya 70B Llama kuri 48GB GPU imwe kugirango yubake umufasha-wunganira abakiriya mumajwi yayo bwite adakodesha cluster ya seriveri.
Umushakashatsi ufite umuguzi umwe RTX 4090 ahuza icyitegererezo gifunguye niche yubuvuzi-busubiza dataset ijoro ryose.
Iterambere rirema udukingirizo duto duto, twahinduranya LoRA adapteri kubikorwa bitandukanye, byose bigabana moderi imwe ya 4-bit fatizo yuzuye mububiko.
Hobbyist ahindura neza icyitegererezo kumurongo wibiganiro byabo kugirango bigane uburyo bwo kwandika ukoresheje ibyuma bya Colab-yubusa.
Uburyo bwo Gushyira mu bikorwa
QLoRA na 4-Bit Nziza-Guhuza imyitozo
Gutangira neza-gutunganya neza moderi ya 70B Llama kuri 48GB GPU imwe kugirango yubake umufasha-wunganira abakiriya mumajwi yayo bwite adakodesha cluster ya seriveri.
Gutangira uhuza neza moderi ya 70B Llama kumurongo umwe wa 48GB GPU kugirango wubake umufasha-wunganira abakiriya mwijwi ryarwo bwite udakodesha seriveri ya cluster Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byimbere imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi akurikirana inyungu zibyara umusaruro nibiciro byigihe.
QLoRA na 4-Bit Nziza-Guhuza imyitozo
Umushakashatsi ufite umuguzi umwe RTX 4090 ahuza icyitegererezo gifunguye niche yubuvuzi-busubiza dataset ijoro ryose.
Umushakashatsi ufite umuguzi umwe RTX 4090 ahuza icyitegererezo gifunguye niche yubuvuzi busubiza dataset ijoro ryose Amakipe akunze kubona ibisubizo byiza iyo asobanuye ibipimo ngenderwaho byimbere, agakomeza inzira yo kuzamuka kwabantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro nibiciro byamakosa mugihe runaka.
QLoRA na 4-Bit Nziza-Guhuza imyitozo
Iterambere rirema udukingirizo duto duto, twahinduranya LoRA adapteri kubikorwa bitandukanye, byose bigabana moderi imwe ya 4-bit fatizo yuzuye mububiko.
Iterambere rirema udukingirizo duto duto, twahinduranya adapteri ya LoRA kumirimo itandukanye, bose bagabana moderi imwe ya 4-bit fatizo yuzuye yibitse mumakipe Amakipe ubusanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbere, kandi agakurikirana inyungu zibyara umusaruro nibiciro byigihe.
QLoRA na 4-Bit Nziza-Guhuza imyitozo
Hobbyist ahindura neza icyitegererezo kumurongo wibiganiro byabo kugirango bigane uburyo bwo kwandika ukoresheje ibyuma bya Colab-yubusa.
Hobbyist ahindura neza icyitegererezo kumurongo wibiganiro byabo kugirango bigane uburyo runaka bwo kwandika ukoresheje ibikoresho byubusa bya Colab-yo mu rwego rwubusa Amakipe asanzwe abona ibisubizo byiza iyo asobanuye ibipimo byujuje ubuziranenge imbere, agakomeza inzira yo kuzamura abantu kubibazo byimbitse, kandi akurikirana inyungu zibyara umusaruro hamwe nibiciro byamakosa mugihe runaka.
Ingaruka & Kurinda
Ibintu bifatika bishobora kwinjiza bucece raporo, gushyigikira imigendekere, cyangwa ibisubizo byubushakashatsi.
Kwihuta byihuse birashobora gukora ibisubizo bidahuye mubisabwa bisa.
Ibyanditswe byumvikana birashobora kugaragara niba kugenzura kugenzura ari ntege.
Igishushanyo mbonera
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira.
Sobanura imiterere isohoka, amajwi, hamwe nubuziranenge mbere yo gutangira. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro.
Ibisubizo byibanze hamwe nisoko yizewe igihe cyose ukuri kwingirakamaro. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Komeza kugenzura abantu kugenzura ibisubizo byinshi.
Komeza kugenzura abantu kugenzura ibisubizo byinshi. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho.
Kurikirana uburyo bwo kunanirwa no kongera imyitozo cyangwa akazi gahoraho. Fata buri ntambwe nk irembo ryibimenyetso: niba ibipimo bitujujwe, hagarika kuzenguruka, funga icyuho, hanyuma noneho wagure imikoreshereze.