What does Quantization mean? Definition | AI Understanding

Definition

Converting model weights to lower precision formats such as 8-bit or 4-bit.

Related terms

Model Quantization

Reducing numeric precision of model weights to decrease memory and inference cost.

A fine-tuning technique that combines 4-bit weight quantization with LoRA adapters to reduce memory needs.

Backpropagation

The core training algorithm that updates model weights by propagating prediction errors backward through the network.

Convolutional Neural Network (CNN)

A neural architecture optimized for processing grid-like data such as images.

Feature Extraction

Converting raw data into informative features that a model can use.

AI systems that produce new content such as text, images, audio, video, or code.

Learn more in our free guides

Residual Vector Quantization SmoothQuant and Activation Quantization GPTQ and AWQ Post-Training Quantization Quantization

See also

Pruning RAG (Retrieval-Augmented Generation)Prompt Injection Recall Prompt Engineering Recommendation System Prompt Red Teaming

Browse the full AI Glossary Explore all free AI guides