AI Glossary Nguva

Chii chinonzi BPE (Byte Pair Encoding) (Kukodhiwa KweByte Pair)?

Tsanangudzo

A subword tokenization algorithm iyo inobatanidza anowanzo hunhu pairs kuita reusable tokens.

Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori

Mashoko anoenderana

Kukamura MazwiMaitirwo ekupatsanura mavara kuita tokens yemhando yekuisa.OCR (Kuziva Mavara eMifananidzo)Tekinoroji inoshandura mavara mumifananidzo kana scanner kuita mavara anoverengwa nemuchina.Kusarudza Top-kA decoding strategy iyo samples chete kubva k ingangoita anotevera tokens.Kudzokera kumashureIyo yakakosha kudzidziswa algorithm inogadziridza maremu emhando nekuparadzira zvikanganiso zvekufungidzira kumashure kuburikidza netiweki.Bi-Encoder (Mutsvagiri Wevaviri)Modhi inokodha mibvunzo uye zvinyorwa mumavheji akasiyana kuti akwanise kuenzaniswa nekukurumidza pachiyero.Kutsvaga kweBeamA decoding algorithm iyo inochengeta epamusoro akati wandei akateedzana padanho rega rega kuti uwane yepamusoro-inogoneka inobuda.

Dzidza zvakawanda mumadhairekitori edu emahara

ByteDance DoubaoCycleGAN Unpaired TranslationTokenizer-Free Byte-Level ModelsInstant-NGP Hash Encoding

Onawo

Sliding Window AttentionSentencePieceALiBiANN (Approximate Nearest Neighbor)RoPE (Rotary Positional Embeddings)HNSWPositional EncodingReranker