What is LoRA (Low-Rank Adaptation)? Definition | AI Understanding

Maanaam

Pexem ajustement bu baax te baax ci parametre yi, di yokk matrisi adaptatër yu rang bu woyof.

Term yu ci méngoo

Parametre-Reglage bu baax (PEFT)

Pexe yuy méngale model yi ci tàggat ab subset bu ndaw ci ay paramet yuñ yokk.

Pexem ajustement bu boole 4-bit ak adaptëru LoRA ngir wàññi bëg-bëgu mémoire.

Akordement bu baax

Wéyal tàggat ci done yuñ jagleel benn domen ngir méngale xeetu tàggat buñ njëkka tàggat ak benn liggéey buñ jagleel.

Tegtal yi tuning

Fine-tuning ab model ci ñaari tegtal-tontu ngir gëna mëna topp liggéey bi.

DPO (Optimisation préférence directe)

Xeetu tàggat yaram buy gëna suqali xeetu model yi ci ñaari tànneef te soxlawul xeetu neexal bu wuute.

Pexem regularisasioŋ buy yombal etiket yu dëgër yi ngir gëna mëna yamale.

Nekk leen ci sunuy tegtal yu amul fayda

AI Workflow Automation Barlow Twins and Redundancy Reduction Domain Adaptation Kubeflow and ML Pipeline Orchestration

Xoolal itam

Learning Rate Loss Function Large Language Model (LLM)Machine Learning (ML)Latency Memory (Agent Memory)Mixture of Experts (MoE)Knowledge Graph

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda