Dubawa
QLoRA wata dabara ce da ke ba ku damar daidaita ɗimbin ƙirar harshe akan GPU mabukata guda ɗaya ta hanyar adana daskararrun ƙirar a cikin rago 4 kawai a kowane nauyi. Ya sanya keɓance samfuran siga-65B mai yiwuwa akan kayan masarufi waɗanda a baya zasu iya ɗaukar nau'ikan juzu'in girman wannan.
QLoRA da 4-Bit Fine-Tuning wani ɓangare ne na tarin harshe-AI da ake amfani da shi don karantawa, ƙirƙira, rarrabawa, da canza rubutu da magana a sikeli.
Zurfafa nutsewa
A al'ada, daidaitawa babban samfuri yana nufin ɗaukar kowane nauyi a daidaitaccen 16-bit da sabunta su duka, wanda ke buƙatar babban ƙwaƙwalwar ajiya. QLoRA ya haɗu da ra'ayoyi biyu. Da farko, yana daskare samfurin da aka riga aka horar kuma yana ƙididdige shi zuwa 4 ragowa, yana kashe ƙwaƙwalwar ajiya kusan ninki huɗu. Na biyu, yana amfani da LoRA: maimakon sabunta manyan matrices masu nauyi, yana allura ƴan ƙaramin adaftar adaftar ma'auni tare da su, don haka kawai ƴan sigogi miliyan ne ake sabunta su. Tushen 4-bit yana tsayawa yayin da gradients ke gudana ta cikin ƙananan adaftan kawai. An gabatar da shi a cikin 2023 ta Dettmers da abokan aiki, QLoRA ya nuna cewa ingantaccen tsarin 65B akan GPU 48GB guda ɗaya zai iya dacewa da ingancin cikakken daidaitawar 16-bit mai kyau.
Fahimtar Fasaha
QLoRA ya gabatar da dabaru uku. NF4 (4-bit NormalFloat) nau'in bayanai ne wanda aka inganta don rarraba kararrawa na ma'aunin jijiyoyi, yana ba da daidaito mafi inganci fiye da bayyanannen int4. Ƙididdigar ƙididdigewa sau biyu tana damfara ma'aunin ƙididdigewa da kansu, yana adana ƙarin ƙwaƙwalwar ajiya. Masu inganta shafi na yin amfani da haɗewar ƙwaƙwalwar ajiya ta GPU-CPU don ɗaukar spikes yayin dogon jeri, da hana faɗuwar abin tunawa. Yayin wucewar gaba da baya, ma'aunin 4-bit ana ƙididdige su zuwa 16-bit daidai-in-lokaci don haɓaka matrix, sannan a jefar da su.
Jagorar QLoRA da 4-Bit Fine-Tuning
QLoRA wata dabara ce da ke ba ku damar daidaita ɗimbin ƙirar harshe akan GPU mabukata guda ɗaya ta hanyar adana daskararrun ƙirar a cikin rago 4 kawai a kowane nauyi. Ya sanya keɓance samfuran siga-65B mai yiwuwa akan kayan masarufi waɗanda a baya zasu iya ɗaukar nau'ikan juzu'in girman wannan. QLoRA da 4-Bit Fine-Tuning wani ɓangare ne na tarin harshe-AI da ake amfani da shi don karantawa, ƙirƙira, rarrabawa, da canza rubutu da magana a sikeli. Don gina fahimta mai zurfi, bi da QLoRA da 4-Bit Fine-Tuning azaman samfurin aiki, ba sifa ɗaya ba: ayyana sakamakon da ake so, fayyace zato, kuma raba abin da tsarin zai iya yi da dogaro daga abin da har yanzu yana buƙatar yanke hukunci na ƙwararru.
A aikace, ƙungiyoyi masu ƙarfi da ke amfani da QLoRA da 4-Bit Fine-Tuning ƙirar ƙirar ƙira, dawo da, da sake duba madaukai azaman tsarin sadarwar haɗin gwiwa ɗaya. Suna rubuta ƙayyadaddun ƙa'idodin nasara, gwaji akan bayanan gaskiya da gudanawar aiki, da jujjuyawar bisa ga tsarin gazawar da aka lura maimakon cin nasara na lokaci ɗaya. Wannan shine inda fahimtar ka'idar ta juya zuwa iyawa mai dorewa a cikin samfura, manufofi, da ayyuka.
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba. A lokaci guda, abubuwan da ba a iya gani ba na iya shigar da rahotanni cikin nutsuwa, kwararar goyan baya, ko abubuwan bincike. Hanyar da ta fi dacewa ita ce haɗa saurin gwaji tare da horon gudanarwa: gudanar da matukin jirgi, kama shaida, buga rajistan ayyukan yanke shawara, da ci gaba da sabunta abubuwan tsaro kamar yadda halayen ƙira, tsammanin mai amfani, da buƙatun tsari ke tasowa.
Dabarun Tasiri
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba.
Gudun aikin harshe na iya tafiya da sauri ba tare da sadaukar da daidaito ba. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa.
Yana faɗaɗa damar shiga cikin harsuna da salon sadarwa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa.
Ƙungiyoyi za su iya ciyar da ƙarin lokaci akan hukunci yayin da aiki da kai ke sarrafa maimaitawa. A cikin ƙawance masu inganci, ana fassara wannan zuwa ƙa'idodin aiki waɗanda za a iya aunawa, iyakokin ikon mallaka, da kuma bita-da-kullin bita don ƙungiyoyi su iya haɓaka kwarin gwiwa a maimakon ɓata shakku.
Aiwatar da Gaskiyar Duniya
Farawa mai kyau-sautun samfurin 70B Llama akan GPU guda 48GB don gina mataimaki na goyon bayan abokin ciniki a cikin muryar saƙon sa ba tare da hayar tarin sabar ba.
Mai bincike tare da mabukaci guda ɗaya RTX 4090 yana daidaita ƙirar buɗaɗɗe zuwa saitin bayanan amsa tambayoyin likita na dare.
Mai haɓakawa yana ƙirƙirar ƙanana, masu adaftar LoRA masu musanyawa don ayyuka daban-daban, duk suna raba ƙirar tushe guda 4-bit wanda aka loda cikin ƙwaƙwalwar ajiya.
Masu sha'awar sha'awa suna tsara samfuri akan rajistan ayyukansu na sirri don kwaikwayi wani salon rubutu ta amfani da kayan aikin Colab kyauta.
Hanyoyin Aiwatarwa
QLoRA da 4-Bit Fine-Tuning a aikace
Farawa mai kyau-sautun samfurin 70B Llama akan GPU guda 48GB don gina mataimaki na goyon bayan abokin ciniki a cikin muryar saƙon sa ba tare da hayar tarin sabar ba.
Kyakkyawan farawa mai kyau-sautun samfurin 70B Llama akan guda 48GB GPU don gina mataimaki na goyon bayan abokin ciniki a cikin sautin saƙon sa ba tare da hayar ƙungiyar sabar uwar garken yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓaka ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
QLoRA da 4-Bit Fine-Tuning a aikace
Mai bincike tare da mabukaci guda ɗaya RTX 4090 yana daidaita ƙirar buɗaɗɗe zuwa saitin bayanan amsa tambayoyin likita na dare.
Mai bincike tare da mabukaci guda ɗaya RTX 4090 yana daidaita samfurin buɗewa zuwa bayanan bayanan amsa tambayoyin likitanci na dare Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin nasarorin samarwa da ƙimar kuskure akan lokaci.
QLoRA da 4-Bit Fine-Tuning a aikace
Mai haɓakawa yana ƙirƙirar ƙanana, masu adaftar LoRA masu musanyawa don ayyuka daban-daban, duk suna raba ƙirar tushe guda 4-bit wanda aka loda cikin ƙwaƙwalwar ajiya.
Mai haɓakawa yana ƙirƙira da yawa na ƙananan adaftan LoRA masu musanyawa don ayyuka daban-daban, duk raba samfurin tushe guda 4-bit wanda aka ɗora a cikin ƙwaƙwalwar ajiya Ƙungiyoyi yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ƙofofin inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin diddigin abubuwan samarwa da ƙimar kuskure akan lokaci.
QLoRA da 4-Bit Fine-Tuning a aikace
Masu sha'awar sha'awa suna tsara samfuri akan rajistan ayyukansu na sirri don kwaikwayi wani salon rubutu ta amfani da kayan aikin Colab kyauta.
Masu sha'awar sha'awa suna tsara samfuri akan rajistan ayyukan su na sirri don kwaikwayi wani salon rubutu ta amfani da Ƙungiyoyin kayan aikin Colab kyauta yawanci suna samun sakamako mafi kyau lokacin da suka ayyana ma'auni masu inganci a gaba, kiyaye hanyar haɓakar ɗan adam don ƙararraki, da bin duk nasarorin samarwa da ƙimar kuskure akan lokaci.
Hatsari & Tsare-tsare
Abubuwan da aka ruɗe suna iya shigar da rahotanni cikin nutsuwa, kwararar tallafi, ko abubuwan bincike.
Hankali na gaggawa na iya ƙirƙirar sakamako mara daidaituwa a cikin buƙatun iri ɗaya.
Za a iya fallasa bayanan rubutu mai ma'ana idan ikon samun dama yana da rauni.
Taswirar Hanya
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa.
Ƙayyade tsarin fitarwa, sautin, da ma'auni masu inganci kafin fitowa. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci.
Amsa a ƙasa tare da amintattun tushe a duk lokacin da daidaito ya shafi mahimmanci. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma.
Ajiye wurin binciken ɗan adam don abubuwan da ake samu masu girma. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai.
Bibiyar tsarin gazawar kuma sake horar da tsokaci ko tafiyar aiki akai-akai. Ɗauki kowane mataki azaman ƙofar shaida: idan ba a cika sharuɗɗa ba, dakatar da fitar, rufe tazarar, sannan kawai faɗaɗa amfani.