Erayga Qaamuuska AI

Waa maxay QLoRA?

Qeexid

Farsamo hagaajin ah oo isku dareysa qiyaasidda miisaanka 4-bit iyo adaabiyeyaasha LoRA si loo yareeyo baahiyaha xusuusta.

Shuruudaha la xiriira

LoRA (Laqabsiga Darajada Hoose)
Habka hagaajinta wanaagsan ee wax-ku-oolka ah ee ku daraya mitirada adabtarada ee darajada hoose.
Tirada
Miisaanka moodeelka oo loo beddelo qaababka saxda ah ee hoose sida 8-bit ama 4-bit.
Hagaajinta
Sii wadida tababarka xogta gaarka ah ee domain-ka si loo waafajiyo qaabka horay loo tababaray ee hawl gaar ah.
Dajinta Tilmaamaha
Hagaajinta qaab ku saabsan lammaanaha jawaab-celinta-tilmaan-bixinta si loo horumariyo hawsha soo socota.
Tirade Model
Yaraynta saxnaanta tirada ee miisaanka moodeelka si loo dhimo xusuusta iyo qiimaha la fiirsashada.
Farsamaynta Fine-Tuning Waxtarka leh (PEFT)
Hababka la qabsada moodooyinka iyadoo la tababarayo qayb yar oo xaddidaadyo lagu daray.

Wax badan ka baro hagayaashayada bilaashka ah

QLoRA and 4-Bit Fine-Tuning

Eeg sidoo kale

DPO (Direct Preference Optimization)Flash AttentionTree of ThoughtsMulti-Head AttentionReActPositional EncodingAgentic LoopRoPE (Rotary Positional Embeddings)
Ka baadh Qaamuuska AI oo buuxaBaadh dhammaan hagayaasha AI ee bilaashka ah