Luy QLoRA? Maanaam | AI Understanding

Maanaam

Pexem ajustement bu boole 4-bit ak adaptëru LoRA ngir wàññi bëg-bëgu mémoire.

Term yu ci méngoo

LoRA (Adaptaasioŋ bu am rang bu woyof)

Pexem ajustement bu baax te baax ci parametre yi, di yokk matrisi adaptatër yu rang bu woyof.

Kantifikaasioŋ

Soppi diisaayu model ci formaa yu gëna ndaw yu melni 8-bit wala 4-bit.

Akordement bu baax

Wéyal tàggat ci done yuñ jagleel benn domen ngir méngale xeetu tàggat buñ njëkka tàggat ak benn liggéey buñ jagleel.

Tegtal yi tuning

Fine-tuning ab model ci ñaari tegtal-tontu ngir gëna mëna topp liggéey bi.

Model Kantifikaasioŋ

Wàññi njubteg lim ci diisaayu model ngir wàññi njëgu mémoire ak inference.

Parametre-Reglage bu baax (PEFT)

Pexe yuy méngale model yi ci tàggat ab subset bu ndaw ci ay paramet yuñ yokk.

Nekk leen ci sunuy tegtal yu amul fayda

QLoRA and 4-Bit Fine-Tuning

Xoolal itam

DPO (Direct Preference Optimization)Flash Attention Tree of Thoughts Multi-Head Attention ReAct Positional Encoding Agentic Loop RoPE (Rotary Positional Embeddings)

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda