What does “Normalization” mean?
Definition
Transforming values to a consistent scale to improve optimization stability.
Related terms
Learn more in our free guides
Group NormalizationRMSNorm and Pre-Layer NormalizationText Normalization for SpeechLayer Normalization