What is Model Quantization?

Converting model weights to lower precision formats such as 8-bit or 4-bit.

A fine-tuning technique that combines 4-bit weight quantization with LoRA adapters to reduce memory needs.

An optimized attention algorithm that reduces memory use and speeds up transformer training and inference.

Stored context an AI agent uses across steps or sessions to improve continuity.

A software system that can observe, reason, and take actions to achieve a goal, often using tools and memory.

A field focused on reducing harmful behavior, failures, and misuse risks in AI systems.