AI Glossary Term

What does “Pass@k” mean?

Definition

A code-evaluation metric measuring the chance that at least one of k generated samples passes the tests.

Related terms

Perplexity
A language-model metric measuring how surprised the model is by true next tokens.
Cross-Encoder
A model that scores a query and document together in one pass for high-accuracy relevance judgments.
HumanEval
A benchmark of Python programming problems used to measure code-generation correctness via unit tests.
API (Application Programming Interface)
A structured way for one software system to send requests to and receive responses from another system.
Classification
A task where a model assigns an input to one or more predefined categories.
Domain Adaptation
Methods that transfer a model trained in one domain to perform better in another domain.

Learn more in our free guides

Dense Passage Retrieval

See also

LLM-as-JudgeMMLUBi-EncoderGSM8KHybrid SearchFactualityRerankerCitations
Browse the full AI GlossaryExplore all free AI guides