Preprint proposes SingularClip to preserve learning plasticity in changing tasks
An arXiv preprint identifies growing imbalance among neural-network weight singular values as a possible cause of lost adaptability, then proposes periodically clipping those values in continual and reinforcement learning.