AI Glossary Term

What does “Foundation Model” mean?

Definition

A large pre-trained model that can be adapted to many downstream tasks.

How Foundation Model works

Diagram for Foundation Model: Text, Images, Code feed into Foundation model: one big pre-trained base, which produces Chatbot, Summarizer, Code assistant.TextImagesCodeFoundation model: one bigpre-trained baseChatbotSummarizerCodeassistant

Example

One large language model, trained once on a broad mix of text, can be adapted into a customer-support bot, a summarizer, or a coding assistant by prompting or light fine-tuning.

Why it matters

Because many products build on the same few base models, their strengths and flaws spread widely. Choices made at the base level affect everything above it.

Common questions

Who coined the term?

Researchers at Stanford's Center for Research on Foundation Models used it in a 2021 report.

Is every large model a foundation model?

The term refers to broad, adaptable models. A large model built for a single narrow task would not usually be called one.

What are the risks?

Errors or biases in the base can carry into every application, and few organizations can afford to train them.

Learn more in our free guides

Test yourself

See also