Texture Versus Shape Bias in CNNs

Humans often recognize an object across changes in surface pattern, though people also use texture. A classifier may learn a different balance. Geirhos and colleagues used images in which shape and texture pointed to different categories to test ImageNet-trained convolutional neural networks. In those experiments, the tested CNNs often followed texture more than human observers did. The team also explored stylized training images to encourage greater shape use. The finding is about evaluated models and procedures; architecture, data and task can change the balance. A cue-conflict image is diagnostic because the two sources of evidence disagree. Imagine the outline and body parts of a cat filled with a surface pattern associated with an elephant. A texture-based decision and a shape-based decision now produce different labels. Ordinary accuracy on images where both cues agree cannot reveal that preference. A shape-bias score summarizes choices on a defined cue-conflict set, not an absolute measure of human-like understanding or all kinds of robustness. Texture can be legitimately useful. A fabric inspector may need to detect weave defects, and a material classifier is supposed to use surface properties. The concern arises when a product must recognize object identity after lighting, paint, camera or background changes. Increasing shape preference may help some shifts, but it can also harm tasks where texture carries the intended signal. Stylized training changes both visual statistics and data distribution, so evaluation must include clean images, cue-conflict tests and target deployment conditions. To investigate, specify the task and create controlled images that preserve shape while changing texture and vice versa. Check whether generated images introduce artifacts that themselves become shortcuts. Compare models and human annotations under the same label rule. Do not claim a universally superior cue from one benchmark. The useful outcome is knowing what information the model relies on and whether that reliance will hold when its environment changes.