AI Glossary Term

What is Test-Time Compute?

Definition

Additional inference computation used during response generation to improve quality or reasoning.

Related terms

Inference-Time Compute
The amount of processing power consumed while producing each response.
RAG (Retrieval-Augmented Generation)
A method that retrieves external knowledge and feeds it into generation at inference time.
Usage-Based Billing
Pricing where costs scale with API calls, tokens, inference time, or consumed compute.
Training Loss
The model error value computed during training and optimized downward over time.
Baseline Model
A simple reference model used to compare whether more complex approaches actually improve results.
Benchmark
A standardized test or dataset used to measure and compare model performance.

Learn more in our free guides

Computer VisionSentiment AnalysisReal-Time Voice AgentsTest-Time Augmentation
Browse the full AI GlossaryExplore all free AI guides