AI Glossary Term
What does “Alignment Tax” mean?
Definition
The extra cost in time, compute, or product velocity required to make systems safer and more controllable.
How Alignment Tax works
Example
A team adds extra safety training and review steps before release. The model is safer, but the added work delays shipping and, if not done carefully, can make it refuse harmless requests.
Why it matters
The idea is that safety has costs, which creates pressure to cut corners. Better methods aim to make the tax small or zero.
Common questions
Does the tax always exist?
Not necessarily. Some safety methods improve usefulness too, and the size of any cost varies.
What kinds of cost?
Compute, development time, slower releases, and in some cases lower performance on certain tasks.
Why does it matter?
If safety is expensive, competitive pressure can discourage it, so reducing the cost makes safer practices easier to adopt.