What does “Frequency Penalty” mean?
Definition
A decoding setting that reduces the probability of tokens proportionally to how often they've appeared so far.
A decoding setting that reduces the probability of tokens proportionally to how often they've appeared so far.