AI Glossary Term

What does “MMLU” mean?

Definition

A benchmark testing language models across 57 academic and professional subjects using multiple-choice questions.

Related terms

LLM-as-Judge
Using a language model to score or compare outputs from other models during evaluation.
GSM8K
A benchmark of grade-school math word problems used to evaluate step-by-step reasoning in language models.
Memory (Agent Memory)
Stored context an AI agent uses across steps or sessions to improve continuity.
Multimodal Model
A model that can process or generate multiple data types such as text, image, and audio.
Model Registry
A central catalog for versioning, approving, and tracking models across environments.
AGI (Artificial General Intelligence)
A hypothetical AI system that can perform most intellectual tasks at a human level across many domains.

See also

Pass@kHumanEvalBi-EncoderFactualityCross-EncoderCitationsHybrid SearchWatermarking
Browse the full AI GlossaryExplore all free AI guides