Baatu Glossaire IA

Lan mooy BPE (kodage ñaari byte)?

Maanaam

Algorithme tokenization subword buy boole ñaari araf yi gëna bari ci ay token yuñ mëna jëfandikoowaat.

Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda

Term yu ci méngoo

TokenisasioŋXeetu xaaj mbind ci ay jeton ngir dugal ci model.OCR (Xamme arafu Optik)Xarala yuy soppi mbind ci nataal wala skane ci mbind mu masin mëna jàng.Top-k jël misaalPexem dekodaas buy jël misaal ci k token yi ci topp.Tasaaro ci ginaawAlgorithm bi gëna am solo biy yeesal diisaayu model bi ci tasaare njuumti yiñ wax luy waaja am ci reso bi.Bi-EkodeerModèle buy kode laajte yi ak këyit yi ci vecteur yu wuute suko defee ñu mëna leen méngale ci diir bu gàtt ci eskaal bi.Seetug BeamAlgorithme decodage buy tëye limu kàndidaa yi ci kaw ci jéego bu nekk ngir am njariñ yu gëna am wërsëg.

Nekk leen ci sunuy tegtal yu amul fayda

ByteDance DoubaoCycleGAN Unpaired TranslationTokenizer-Free Byte-Level ModelsInstant-NGP Hash Encoding

Xoolal itam

Sliding Window AttentionSentencePieceALiBiANN (Approximate Nearest Neighbor)RoPE (Rotary Positional Embeddings)HNSWPositional EncodingReranker