AI Glossary Nguva

Chii QLoRA?

Tsanangudzo

Iyo yakanaka-tuning tekinoroji inosanganisa 4-bit huremu quantization neLoRA adapters kuderedza ndangariro zvinodiwa.

Mashoko anoenderana

LoRA (Low-Rank Adaptation)
A parameter-inoshanda zvakanaka-tuning nzira inowedzera yakaderera-rank adapter matrices.
Quantization
Kushandura huremu hwemodhi kudzikisa mafomati chaiwo se8-bit kana 4-bit.
Kugadziriswa kwakanaka
Kuenderera mberi nekudzidziswa padomeine-chaiyo data kugadzirisa iyo isati yadzidziswa modhi kune rimwe basa.
Instruction Tuning
Kunyatsogadzirisa modhi pamirairo-mhinduro mbiri kuti uvandudze basa rinotevera.
Model Quantization
Kuderedza kurongeka kwenhamba yezviyereso zvemuenzaniso kuderedza ndangariro uye mutengo wekufungidzira.
Parameter-Inoshanda Fine-Tuning (PEFT)
Nzira dzinogadzirisa mamodheru nekudzidzisa diki diki rekuwedzera paramita.

Dzidza zvakawanda mumadhairekitori edu emahara

QLoRA and 4-Bit Fine-Tuning

Onawo

DPO (Direct Preference Optimization)Flash AttentionTree of ThoughtsMulti-Head AttentionReActPositional EncodingAgentic LoopRoPE (Rotary Positional Embeddings)
Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori