Lan mooy Baamtu Penalti? Tekki | AI Understanding

Maanaam

Reglage decodage buy wàññi probabilite token yi model bi defar ba pare ngir wàññi loop yi.

Term yu ci méngoo

Penalti bu bari

Reglage decodage buy wàññi probabilite token yi méngoo ak ni ñu feeñee ba leegi.

Reglage decodage buy wàññi probabilite token yi feeñ, di ñaax topic yu bees.

Top-k jël misaal

Pexem dekodaas buy jël misaal ci k token yi ci topp.

Decodage buñ wottu

Pexem defar buy tënk jeton yiy génne ci jumtukaay yu baax wala tànneef yu méngoo ak sàrt yi.

Dekodage spekulatif

Benn pexem gaawaayu inference fu ab modelu projet bu ndaw digle ay jeton yu ab model bu gëna mag di xool ci paralel.

Palanteer buy gliise

Modèlu attention boo xamni token bu nekk dafay bàyyi xel ci palanteer bu yam ci token yi ci wetam ngir wàññi calcul bi.

Nekk leen ci sunuy tegtal yu amul fayda

Repetition Penalty and Decoding Controls

Xoolal itam

Beam Search Parent-Document Retrieval Multi-Query Retrieval RAG-Fusion Self-Play Post-training Mid-training Watermarking

Xoolal Glossaire IA bi yépp Saytu bépp tegtal IA bu amul fayda