AI Glossary Term

What is Distilled Model?

Definition

A smaller model trained to imitate a larger model's behavior while using less compute at inference.

Related terms

Inference-Time Compute
The amount of processing power consumed while producing each response.
Knowledge Distillation
Training a smaller model to imitate the outputs of a larger model.
Inference
The runtime phase where a trained model generates predictions or outputs.
Pruning
Removing less important model weights or neurons to reduce size and compute.
Test-Time Compute
Additional inference computation used during response generation to improve quality or reasoning.
Usage-Based Billing
Pricing where costs scale with API calls, tokens, inference time, or consumed compute.

Learn more in our free guides

AI Models ExplainedModel CollapseModel LifecycleModel Context Protocol
Browse the full AI GlossaryExplore all free AI guides