SHIFT-LLM reports a training-free way to recover accuracy after pruning LLM layers
A new preprint describes SHIFT-LLM, a post-pruning correction method that uses lightweight linear adapters to approximate the computations removed from large language models. The authors report accuracy gains of up to 15.7 points on Llama-3.1-8B-Instruct across seven zero-shot benchmarks.