AI Glossary Nguva

Chii SentencePiece?

Tsanangudzo

Mutauro-agnostic tokenizer inodzidza subword mauniti zvakananga kubva kune yakaomeswa zvinyorwa pasina pre-kupatsanurwa pachena.

Mashoko anoenderana

CLIP
Iyo multimodal modhi yekuvaka iyo inodzidza yakagovaniswa inomiririra pakati pezvinyorwa nemifananidzo.
Kuenderera mberi nekudzidza
Nzira dzekudzidzisa dzinoita kuti modhi irambe ichidzidza kubva kune itsva data pasina kukanganwa ruzivo rwekare.
In-Context Kudzidza
Kugona kwemuenzaniso kutevedzera mapatani kubva kumienzaniso yakapihwa zvakananga mukukasira.
Chinangwa Classification
Kufanotaura chinangwa chemushandisi kubva pane zvinyorwa kuti zvifambe nemazvo.
Mutauro Mukuru (LLM)
Mutauro wemodhi yakadzidziswa pane yakakura text corpora kugadzira nekuongorora zvinyorwa.
Chiratidzo
Chikamu chemavara chinogadziriswa nemhando dzemitauro, senge chidimbu chezwi kana chiratidzo.

Dzidza zvakawanda mumadhairekitori edu emahara

SentencePiece Tokenization

Onawo

BPE (Byte Pair Encoding)ANN (Approximate Nearest Neighbor)Sliding Window AttentionHNSWALiBiRerankerRoPE (Rotary Positional Embeddings)Hybrid Search
Bhurawuza yakazara AI GlossaryOngorora ese emahara AI madhairekitori