AI Glossary Term

What is Context Window?

Definition

The maximum amount of input tokens a language model can process at once.

Related terms

The process of splitting text into tokens for model input.

A shift in real-world input data over time that can degrade model performance.

Multimodal Model

A model that can process or generate multiple data types such as text, image, and audio.

A language-model metric measuring how surprised the model is by true next tokens.

The input instructions and context provided to a generative model.

Sliding Window Attention

An attention pattern where each token attends only to a fixed-size window of nearby tokens to reduce compute.

Learn more in our free guides

Model Context Protocol Position Interpolation for Context Extension YaRN Context Window Scaling YaRN and Context Length Extension

Browse the full AI Glossary Explore all free AI guides