Baatu Glossaire IA

Lan mooy Kodage posisioŋ?

Maanaam

Leeral yiñ yokk ci token yiñ samp ngir transformatër yi mëna xàmmee xeetu toppalante yi.

Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda

Term yu ci méngoo

RoPE (Njëfandikoo position Rotaire)Pexem kodage positionel buy wëlbati vecteur laaj ak butoŋu ngir kodage position token relatif yi.ALiBiPexem position bias buy yar poñ yi ñuy am ci distance token, di jàppale model yi ñu extrapole ci contexte yu gëna gudd.Parametre-Reglage bu baax (PEFT)Pexe yuy méngale model yi ci tàggat ab subset bu ndaw ci ay paramet yuñ yokk.AGI (Xarañteg xelu masin)Sistemu IA buñu xalaat ni mën na def liggéey yu bari ci wàllu xel ci wàllu nit ci wàll yu bari.Agent IASistem losisel bu mëna seetlu, xalaat, ak jël ay matuwaay ngir mëna yegg ci mébet, di faral di jëfandikoo jumtukaay ak mémoire.TegtalEtiketu wala metadone yu nit ñi yokk ngir tàggat wala jàngat xeeti jàngu masin.

Nekk leen ci sunuy tegtal yu amul fayda

Positional Interpolation for Long ContextInstant-NGP Hash EncodingByte-Pair EncodingTokenization and Byte Pair Encoding

Xoolal itam

Multi-Head AttentionFlash AttentionQLoRASliding Window AttentionDPO (Direct Preference Optimization)BPE (Byte Pair Encoding)Tree of ThoughtsSentencePiece