AI Glossary Nguva

Chii chinonzi QLoRA?

Tsanangudzo

Iyo yakanaka-tuning tekinoroji inosanganisa 4-bit huremu quantization neLoRA adapters kuderedza ndangariro zvinodiwa.

Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori

Mashoko anoenderana

LoRA (Kushandurwa kweLow-Rank)A parameter-inoshanda zvakanaka-tuning nzira inowedzera yakaderera-rank adapter matrices.KuwandaKushandura huremu hwemodhi kudzikisa mafomati chaiwo se8-bit kana 4-bit.Kugadziriswa kwakanakaKuenderera mberi nekudzidziswa padomeine-chaiyo data kugadzirisa iyo isati yadzidziswa modhi kune rimwe basa.Kugadzirisa MirayiridzoKunyatsogadzirisa modhi pamirairo-mhinduro mbiri kuti uvandudze basa rinotevera.Kuderedzwa kweModel (Model Quantization)Kuderedza kurongeka kwenhamba yezviyereso zvemuenzaniso kuderedza ndangariro uye mutengo wekufungidzira.Parameter-Inoshanda Fine-Tuning (PEFT)Nzira dzinogadzirisa mamodheru nekudzidzisa diki diki rekuwedzera paramita.

Dzidza zvakawanda mumadhairekitori edu emahara

QLoRA and 4-Bit Fine-Tuning

Onawo

DPO (Direct Preference Optimization)Flash AttentionTree of ThoughtsMulti-Head AttentionReActPositional EncodingAgentic LoopRoPE (Rotary Positional Embeddings)