I-QLoRA kanye ne-4-Bit Fine-Tuning
I-QLoRA iwubuchule obukuvumela ukuthi ushune kahle imodeli yolimi olukhulu ku-GPU yomthengi oyedwa ngokugcina imodeli efriziwe ngamabhithi angu-4 ngesisindo.
Uhlolojikelele
It made customizing 65B-parameter models possible on hardware that previously could only handle models a fraction of that size.
I-Deep Dive
Imvamisa, ukulungisa kahle imodeli enkulu kusho ukulayisha sonke isisindo ngokunemba okungu-16-bit nokuyibuyekeza yonke, okudinga inkumbulo enkulu. I-QLoRA ihlanganisa imibono emibili. Okokuqala, imisa imodeli eqeqeshwe kusengaphambili futhi iyilinganisele phansi ibe amabhithi angu-4, inqamula inkumbulo ngokuphindwe kane. Okwesibili, isebenzisa i-LoRA: esikhundleni sokubuyekeza omatikuletsheni abakhulu besisindo, ijova omatikuletsheni be-adaptha bezinga eliphansi abaqeqeshekayo eduze kwabo, ngakho izigidi ezimbalwa zamapharamitha ziyabuyekezwa. Isisekelo se-4-bit sihlala singashintshi ngenkathi ama-gradient egeleza kuphela kuma-adaptha amancane. Yethulwe ngo-2023 ngabakwaDettmers kanye nozakwabo, i-QLoRA yabonisa ukuthi ukulungisa kahle imodeli engu-65B ku-48GB GPU eyodwa kungase kufane nekhwalithi yokucushwa kahle kwe-16-bit.
I-Technical Insight
I-QLoRA yethula amaqhinga amathathu. I-NF4 (4-bit NormalFloat) iwuhlobo lwedatha oluthuthukiselwe ukusatshalaliswa kwe-bell-curve yezisindo ze-neural, okunikeza ukunemba okungcono kune-int4 engenalutho. Ukulinganisa okuphindwe kabili kucindezela ama-quantization constants ngokwawo, konga inkumbulo eyengeziwe. Izilungiseleli ezifakwe ekhasini zisebenzisa inkumbulo ehlanganisiwe ye-GPU-CPU ukuze zimunce ama-spikes phakathi nokulandelana okude, zigweme ukuphahlazeka kwenkumbulo. Ngesikhathi sokudlula okuya phambili nangemuva, izisindo ezingu-4-bit ziyenziwa zibe yi-16-bit ngesikhathi esifanele ukuze i-matrix iphindaphindeke, bese ilahlwa.
I-Strategic Impact
Isivinini nesikali
Ukugeleza komsebenzi wolimi kungahamba ngokushesha ngaphandle kokudela ukuvumelana.
Finyelela futhi ufinyelele
Yandisa ukufinyelela kuzo zonke izilimi nezitayela zokuxhumana.
Izinqumo ezicacile
Amaqembu angachitha isikhathi esiningi ekwahluleleni kuyilapho i-automation isingatha impinda.
Ikusasa le-QLoRA kanye ne-4-Bit Fine-Tuning
4-bit fine-tuning isiphenduke umkhuba ojwayelekile, futhi ucwaningo manje luphushela ekunembeni okuphansi ngisho nangaphezulu, okufaka phakathi izethulo ezingu-2-bit kanye no-1-bit (ternary). Izikimu ezintsha zokulinganisa ezifana ne-AWQ, GPTQ, ne-HQQ ziphucula ukunemba ngokuqhubekayo, kuyilapho amasu afana ne-QA-LoRA ehlose ukugcina imodeli ilinganiselwe ngisho nangemva kokuhlanganisa ama-adaptha. Njengoba amamodeli anesisindo esivulekile ekhula, lindela ukusebenzisa amathuluzi okuvumela abathanda ukuzilibazisa ukuthi bashune kahle amamodeli we-70B-plus ku-GPU eyodwa yokudlala ukuze abe umkhuba, okwenza intando yeningi ngokwezifiso.
Ukuqaliswa Komhlaba Wangempela
Isiqalisi sishuna kahle imodeli ye-70B Llama ku-48GB GPU eyodwa ukuze kwakhiwe umsizi wosekelo lwekhasimende ngephimbo layo lomkhiqizo ngaphandle kokuqasha iqoqo leseva.
Umcwaningi onomthengi oyedwa i-RTX 4090 uvumelanisa imodeli evulekile kudathasethi ye-niche yokuphendula imibuzo yezokwelapha ngobusuku obubodwa.
Unjiniyela udala inqwaba yama-adaptha e-LoRA amancane, ashintshwayo emisebenzi ehlukene, wonke abelana ngemodeli eyodwa yesisekelo esingu-4-bit elayishwe kunkumbulo.
Umuntu othanda ukuzilibazisa ushuna kahle imodeli kumalogi akhe engxoxo ukuze alingise isitayela esithile sokubhala esebenzisa ihadiwe yamahhala ye-Colab-grade.
Izingozi & Guardrails
Amaqiniso akhonjiwe angafaka ngokuthula imibiko, ukugeleza kosekelo, noma imiphumela yocwaningo.
Ukuzwela okusheshayo kungadala imiphumela engahambisani kuzo zonke izicelo ezifanayo.
Idatha yombhalo ebucayi ingase idalulwe uma izilawuli zokufinyelela zibuthakathaka.
Ukuqalisa Umhlahlandlela
Chaza ifomethi yokuphumayo, ithoni, namazinga wekhwalithi ngaphambi kokukhishwa.
Izimpendulo eziyisisekelo ngemithombo ethembekile noma nini lapho ukunemba kubalulekile.
Gcina indawo yokuhlola isibuyekezo somuntu ukuze uthole imiphumela ephezulu.
Landela amaphethini okuhluleka futhi uqeqeshe kabusha imiyalo noma ukuhamba komsebenzi njalo.
Qhubeka Uhlole
Free newsletter
Get the daily AI briefing
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Take the QLoRA and 4-Bit Fine-Tuning quiz
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
Umhlahlandlela olandelayo
Ukwenqaba Isampula Ukushuna Kahle
Imibuzo evame ukubuzwa
What is QLoRA and 4-Bit Fine-Tuning?
I-QLoRA iwubuchule obukuvumela ukuthi ushune kahle imodeli yolimi olukhulu ku-GPU yomthengi oyedwa ngokugcina imodeli efriziwe ngamabhithi angu-4 ngesisindo. Kwenze ukwenza ngokwezifiso amamodeli wepharamitha angu-65B kwenzeke ku-hardware ngaphambili ebekwazi ukuphatha amamodeli ingxenye encane yalowo sayizi.
Uyini umbono oyinhloko wokulondoloza inkumbulo ngemuva kwengxenye ye-'4-bit' ye-QLoRA?
I-QLoRA igcina izisindo eziqandisiwe eziqandisiwe ngamabhithi angu-4 ngenani ngalinye, isika inkumbulo cishe ngokuphindwe kane uma iqhathaniswa ne-16-bit.
Ngesikhathi sokucushwa kahle kwe-QLoRA, imaphi amapharamitha abuyekezwa ngokwehla kwe-gradient?
Imodeli eyisisekelo ifriziwe; ama-adaptha e-adaptha ajovwe ngamatrices kuphela athola izibuyekezo zegradient, okuyingxenye encane yamapharamitha.
Iyini i-NF4 kumongo we-QLoRA?
I-NF4 (i-NormalFloat 4-bit) iwuhlobo lwedatha oluklanywe ukuzungeza ukusatshalaliswa kwe-bell-curve yezisindo zenethiwekhi ye-neural ukuze kube nokunemba okungcono kune-plain int4.
Iyiphi inkinga 'i-paged optimizers' ekhelini le-QLoRA?
Izilungiseleli ezinamakhasi zisebenzisa inkumbulo ehlanganisiwe ye-GPU-CPU ukuze zimunce ama-memory spikes, zigweme ukuphahlazeka kwememori engaphandle kwenkumbulo phakathi nokuqeqeshwa kokufakwayo okude.
Ziguqulwa nini izisindo ezingu-4-bit zibuyele ekunembeni okuphezulu phakathi nokuqeqeshwa?
Izisindo ezingu-4-bit zenziwa zanele ukuze zibe ukunemba okungu-16-bit endizeni ukuze kuphindaphindeke i-matrix ngayinye, bese ikhophi enembayo ephezulu ilahlwa ukuze kongiwe inkumbulo.