What is Guarded Decoding? Definition | AI Understanding

Maanaam

Pexem defar buy tënk jeton yiy génne ci jumtukaay yu baax wala tànneef yu méngoo ak sàrt yi.

Term yu ci méngoo

Top-k jël misaal

Pexem dekodaas buy jël misaal ci k token yi ci topp.

Top-p (Nukleus)

Pexem dekodaas buy jël misaal ci ensemble token bi gëna ndaw te probabilite yi tollu ci p.

Parser de sortie

Logique biy saytu ak soppi model biy génne ci jumtukaay yu dëgër yuñ mëna jëfandikoo ci masin.

Dekodage spekulatif

Benn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Reglage decodage buy wàññi probabilite token yi model bi defar ba pare ngir wàññi loop yi.

Penalti bu bari

Reglage decodage buy wàññi probabilite token yi méngoo ak ni ñu feeñee ba leegi.

Nekk leen ci sunuy tegtal yu amul fayda

Contrastive Decoding Minimum Bayes Risk Decoding Self-Consistency Decoding Medusa Decoding Heads

Xoolal itam

Groundedness Human Preference Model Feature Store Inference Endpoint Eval Harness Knowledge Base Embedding Model Latent Space

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda