What does Learning Rate mean? Definition | AI Understanding

Definition

A training hyperparameter controlling how much parameters change each update step.

Related terms

A vector showing how much each parameter should change to reduce loss.

A configuration value set before training, such as learning rate, batch size, or depth.

How well a model performs on new, unseen data outside the training set.

Parameter-Efficient Fine-Tuning (PEFT)

Methods that adapt models by training a small subset of added parameters.

A decoding algorithm that keeps the top several candidate sequences at each step to find higher-probability outputs.

A mathematical objective that quantifies prediction error during training.

Learn more in our free guides

Deep Learning Reinforcement Learning Machine Learning Basics Supervised Learning

See also

Large Language Model (LLM)LoRA (Low-Rank Adaptation)Latency Label Smoothing Machine Learning (ML)Knowledge Graph Memory (Agent Memory)Knowledge Distillation

Browse the full AI Glossary Explore all free AI guides