What is QLoRA? Definition | AI Understanding

Ma'anarsa

Dabarar daidaitawa mai kyau wacce ta haɗu da ƙididdige nauyin 4-bit tare da adaftar LoRA don rage buƙatun ƙwaƙwalwar ajiya.

Sharuɗɗa masu alaƙa

LoRA (Ƙarancin Matsayi)

Hanyar daidaitawa mai inganci mai inganci wacce ke ƙara ƙananan matrix adaftar.

Mayar da ma'aunin ƙira zuwa ƙananan madaidaicin tsari kamar 8-bit ko 4-bit.

Kyakkyawan-Tuning

Ci gaba da horarwa akan ƙayyadaddun bayanai na yanki don daidaita samfurin da aka riga aka horar zuwa takamaiman aiki.

Tunatarwa Umarni

Kyakkyawan daidaita samfurin akan nau'i-nau'i na amsa umarni-don inganta ɗawainiya mai biyo baya.

Ƙididdigar Samfura

Rage daidaitattun lambobi na ma'aunin ƙira don rage ƙwaƙwalwar ajiya da ƙimar ƙima.

Ma'auni-Ingantacciyar Kyawun-Tuning (PEFT)

Hanyoyin da ke daidaita samfura ta hanyar horar da ƙaramin juzu'i na ƙarin sigogi.

Ƙara koyo a cikin jagororinmu na kyauta

QLoRA and 4-Bit Fine-Tuning

Duba kuma

DPO (Direct Preference Optimization)Flash Attention Tree of Thoughts Multi-Head Attention ReAct Positional Encoding Agentic Loop RoPE (Rotary Positional Embeddings)

Nemo cikakken AI ƙamus Bincika duk jagororin AI kyauta