What does Distilled Model mean? Definition | AI Understanding

Definition

A smaller model trained to imitate a larger model's behavior while using less compute at inference.

Related terms

Inference-Time Compute

The amount of processing power consumed while producing each response.

Knowledge Distillation

Training a smaller model to imitate the outputs of a larger model.

The runtime phase where a trained model generates predictions or outputs.

Removing less important model weights or neurons to reduce size and compute.

Test-Time Compute

Additional inference computation used during response generation to improve quality or reasoning.

Usage-Based Billing

Pricing where costs scale with API calls, tokens, inference time, or consumed compute.

Learn more in our free guides

AI Models Explained Model Collapse Model Lifecycle Model Context Protocol

See also

Differential Privacy Embedding Model Data Provenance Eval Harness Data Lineage Feature Store Constitutional AI Groundedness

Browse the full AI Glossary Explore all free AI guides