Preprint reports asymmetric risks that LLM compression metrics can miss
An arXiv preprint evaluating 3 LLMs across 11 compression methods reports that aggregate accuracy and perplexity can conceal uneven knowledge loss, overconfidence on newly lost information, and offsetting shifts in subgroup bias.