ProViP uses head-aware pruning to cut visual tokens in vision-language models
A new arXiv preprint proposes ProViP, a training-free method that progressively removes redundant visual tokens and focuses pruning on the attention heads most useful for selecting critical visual information. In one reported LLaVA-1.5-7B experiment, it retained 95.9% of the original performance while delivering a…