Paper proves a width-independent compression bound for deep neural networks
A new arXiv paper proves that certain deep, wide multilayer perceptrons can be represented by narrower networks without the compressed width depending on the original network’s width.