Luy ajustement bu baax ci paramet yi (PEFT)? Tekki | AI Understanding

Maanaam

Pexe yuy méngale model yi ci tàggat ab subset bu ndaw ci ay paramet yuñ yokk.

Term yu ci méngoo

Akordement bu baax

Wéyal tàggat ci done yuñ jagleel benn domen ngir méngale xeetu tàggat buñ njëkka tàggat ak benn liggéey buñ jagleel.

LoRA (Adaptaasioŋ bu am rang bu woyof)

Pexem ajustement bu baax te baax ci parametre yi, di yokk matrisi adaptatër yu rang bu woyof.

Ginaaw tàggat yaram

Jéego yi ñuy jëfandikoo ngir tàggat yaram ginaaw bi ñu njëkkee tàggat, lu ci melni ajustement instruction, gëna xéewale tànneef yi, ak ajustement kaaraange.

Tegtal yi tuning

Fine-tuning ab model ci ñaari tegtal-tontu ngir gëna mëna topp liggéey bi.

Taux de apprentissage

Hyperparametre tàggat yaram buy saytu ñaata parametre di soppi jéego bu nekk ci yeesal.

DPO (Optimisation préférence directe)

Xeetu tàggat yaram buy gëna suqali xeetu model yi ci ñaari tànneef te soxlawul xeetu neexal bu wuute.

Nekk leen ci sunuy tegtal yu amul fayda

Fine-Tuning Hard Parameter Sharing in Multi-Task Networks Gumbel-Softmax and Reparameterization Rejection Sampling Fine-Tuning

Xoolal itam

Parameter Perplexity Overfitting Pipeline Open-Source Model Precision OCR (Optical Character Recognition)Pretraining

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda