Jàng Xibaar Jumtukaay yi Liggéey yi Sunu yitte

Baatu Glossaire IA

Lan mooy QLoRA?

Maanaam

Pexem ajustement bu boole 4-bit ak adaptëru LoRA ngir wàññi bëg-bëgu mémoire.

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda

LoRA (Adaptaasioŋ bu am rang bu woyof)Pexem ajustement bu baax te baax ci parametre yi, di yokk matrisi adaptatër yu rang bu woyof.KantifikaasioŋSoppi diisaayu model ci formaa yu gëna ndaw yu melni 8-bit wala 4-bit.Akordement bu baaxWéyal tàggat ci done yuñ jagleel benn domen ngir méngale xeetu tàggat buñ njëkka tàggat ak benn liggéey buñ jagleel.Tegtal yi tuningFine-tuning ab model ci ñaari tegtal-tontu ngir gëna mëna topp liggéey bi.Model KantifikaasioŋWàññi njubteg lim ci diisaayu model ngir wàññi njëgu mémoire ak inference.Parametre-Reglage bu baax (PEFT)Pexe yuy méngale model yi ci tàggat ab subset bu ndaw ci ay paramet yuñ yokk.

Nekk leen ci sunuy tegtal yu amul fayda

QLoRA and 4-Bit Fine-Tuning

Xoolal itam

DPO (Direct Preference Optimization)Flash Attention Tree of Thoughts Multi-Head Attention ReAct Positional Encoding Agentic Loop RoPE (Rotary Positional Embeddings)