Baatu Glossaire IA

Lan mooy Penalti nekk?

Maanaam

Reglage decodage buy wàññi probabilite token yi feeñ, di ñaax topic yu bees.

Xoolal Glossaire IA bi yéppSaytu bépp tegtal IA bu amul fayda

Term yu ci méngoo

Penalti bu bariReglage decodage buy wàññi probabilite token yi méngoo ak ni ñu feeñee ba leegi.Baamtu PenaltiReglage decodage buy wàññi probabilite token yi model bi defar ba pare ngir wàññi loop yi.Top-k jël misaalPexem dekodaas buy jël misaal ci k token yi ci topp.Decodage buñ wottuPexem defar buy tënk jeton yiy génne ci jumtukaay yu baax wala tànneef yu méngoo ak sàrt yi.Dekodage spekulatifBenn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.Cache KVCaabi yuñ denc ak tensor valeur yu bawoo ci jeton yu njëkk yi may transformateur yi ñu defar ay token yu bees te duñu delloosi seen xel ci jamono yi weesu.

Nekk leen ci sunuy tegtal yu amul fayda

Repetition Penalty and Decoding Controls

Xoolal itam

Beam SearchParent-Document RetrievalMulti-Query RetrievalRAG-FusionSelf-PlayPost-trainingMid-trainingWatermarking