Luy Top-k échantillonnage? Tekki | AI Understanding

Maanaam

Pexem dekodaas buy jël misaal ci k token yi ci topp.

Term yu ci méngoo

Top-p (Nukleus)

Pexem dekodaas buy jël misaal ci ensemble token bi gëna ndaw te probabilite yi tollu ci p.

Decodage buñ wottu

Pexem defar buy tënk jeton yiy génne ci jumtukaay yu baax wala tànneef yu méngoo ak sàrt yi.

Jàng ci ay yoon yu néew

Jàng wala méngale doxalin ci misaal yu néew.

Benn xeetu làkk buy natt ni model bi yéemu ci token yi ci topp dëgg.

Dekodage spekulatif

Benn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Caabi yuñ denc ak tensor valeur yu bawoo ci jeton yu njëkk yi may transformateur yi ñu defar ay token yu bees te duñu delloosi seen xel ci jamono yi weesu.

Nekk leen ci sunuy tegtal yu amul fayda

Typical Sampling Speculative Sampling Verification Entropy-Based Sampling Early Stopping

Xoolal itam

Tool Use Tokenization Transfer Learning Token Transformer Temperature Training Loss System Prompt

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda