Baatu Glossaire IA

Lan mooy Top-k jël misaal?

Maanaam

Pexem dekodaas buy jël misaal ci k token yi ci topp.

Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda

Term yu ci méngoo

Top-p (Nukleus)Pexem dekodaas buy jël misaal ci ensemble token bi gëna ndaw te probabilite yi tollu ci p.Decodage buñ wottuPexem defar buy tënk jeton yiy génne ci jumtukaay yu baax wala tànneef yu méngoo ak sàrt yi.Jàng ci ay yoon yu néewJàng wala méngale doxalin ci misaal yu néew.PerplexityBenn xeetu làkk buy natt ni model bi yéemu ci token yi ci topp dëgg.Dekodage spekulatifBenn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.Cache KVCaabi yuñ denc ak tensor valeur yu bawoo ci jeton yu njëkk yi may transformateur yi ñu defar ay token yu bees te duñu delloosi seen xel ci jamono yi weesu.

Nekk leen ci sunuy tegtal yu amul fayda

Typical SamplingSpeculative Sampling VerificationEntropy-Based SamplingEarly Stopping

Xoolal itam

Tool UseTokenizationTransfer LearningTokenTransformerTemperatureTraining LossSystem Prompt