AI Glossary Term
What does “Presence Penalty” mean?
Definition
A decoding setting that reduces the probability of tokens that have appeared at all, encouraging new topics.
How Presence Penalty works
Example
When brainstorming gift ideas, a presence penalty discourages the model from circling back to the same words and nudges it to introduce new ones.
Why it matters
It encourages variety and new topics. Too high a setting can make writing wander or avoid necessary terms.
Common questions
Presence vs frequency penalty?
Presence penalizes any word that has appeared once; frequency penalizes more as the count rises.
When is it useful?
Brainstorming or long creative output where you want broader coverage.
Does it affect accuracy?
It can, by discouraging a correct word from being reused, so avoid it for factual tasks that need repeated terms.