AI Glossary Term

What does “Latency” mean?

Definition

The time between sending a request and receiving the model's output.

Related terms

Attention Mechanism
A model component that dynamically focuses on relevant parts of an input when producing an output.
Autonomous System
A system that can make decisions and act with limited or no direct human control in real time.
CLIP
A multimodal model architecture that learns shared representations between text and images.
Data Drift
A shift in real-world input data over time that can degrade model performance.
Inference-Time Compute
The amount of processing power consumed while producing each response.
Knowledge Cutoff
The latest point in time reflected in a model's training data.

See also

Label SmoothingLarge Language Model (LLM)Knowledge GraphLearning RateKnowledge DistillationLoRA (Low-Rank Adaptation)Loss FunctionJailbreak
Browse the full AI GlossaryExplore all free AI guides