What is Benchmark?

When benchmark test examples or close variants are present in training data, inflating reported performance.

A held-out dataset used to measure model quality after training.

A benchmark of Python programming problems used to measure code-generation correctness via unit tests.

A simple reference model used to compare whether more complex approaches actually improve results.

A collection of structured or unstructured examples used for training, validation, or testing.

A dataset used during development to tune models and prevent overfitting.