What does Transformer mean? Definition | AI Understanding

Definition

A neural architecture that uses attention to model relationships across sequences in parallel.

Related terms

Multi-Head Attention

A transformer mechanism that runs several attention operations in parallel to capture different types of relationships.

Convolutional Neural Network (CNN)

A neural architecture optimized for processing grid-like data such as images.

A subset of machine learning that uses many-layer neural networks for representation learning.

Memory (Agent Memory)

Stored context an AI agent uses across steps or sessions to improve continuity.

Flash Attention

An optimized attention algorithm that reduces memory use and speeds up transformer training and inference.

AGI (Artificial General Intelligence)

A hypothetical AI system that can perform most intellectual tasks at a human level across many domains.

Learn more in our free guides

Transformers Diffusion Transformers Spatial Transformer Networks DETR Transformer Detection

See also

Transfer Learning Training Loss Top-p (Nucleus) Sampling Unsupervised Learning Top-k Sampling Validation Set Tool Use Vector Database

Browse the full AI Glossary Explore all free AI guides