Jàng Xibaar Jumtukaay yi Liggéey yi Sunu yitte

Baatu Glossaire IA

Lan mooy RoPE (Njëfandikoo position Rotaire)?

Maanaam

Pexem kodage positionel buy wëlbati vecteur laaj ak butoŋu ngir kodage position token relatif yi.

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda

Kodage posisioŋLeeral yiñ yokk ci token yiñ samp ngir transformatër yi mëna xàmmee xeetu toppalante yi.ALiBiPexem position bias buy yar poñ yi ñuy am ci distance token, di jàppale model yi ñu extrapole ci contexte yu gëna gudd.RAG-BoolePexem seetlu buy defar ay anam laajte yu bari, seetlu bu nekk ci ñoom, ba noppi boole rang yi.ANN (Dëkkandoo bi gëna jege)Algorithm yiy wut vecteur yu jege ab laajte te duñu def benn méngale bu mat sëkk, di jaay njub ngir gaawaay.RAG (Generation buñ yokk ngir am)Benn anam buy jëlee xam-xam bi bawoo ci biti, ba noppi dugal ko ci jamonoy inference.Jàng mu am doole ci feedback nit (RLHF)Xeetu tàggat yaram buy jëfandikoo siñaal yi nit ñi taamu ngir jëmmal xeetu doxalin.

Nekk leen ci sunuy tegtal yu amul fayda

Audio Embeddings and Representation Learning Sentence-BERT Embeddings X-Vector Speaker Embeddings HyDE Hypothetical Document Embeddings

Xoolal itam

Multi-Head Attention Sliding Window Attention Flash Attention BPE (Byte Pair Encoding)QLoRA SentencePiece DPO (Direct Preference Optimization)Tree of Thoughts