Perceptual Hashing for Near-Duplicate Images

Two files can look the same to a person yet have different bytes. A resized photo, a recompressed JPEG and the original file will usually have different cryptographic hashes. A perceptual hash instead summarizes some visual structure so related images may receive similar short signatures. OpenCV documents several image-hashing methods, including average and perceptual hashes, for finding similar images. The exact invariances differ by algorithm; a technique that tolerates modest compression may fail after a large crop or rotation.

To compare two binary signatures, a common measure is Hamming distance: the number of bit positions that differ. Smaller distance often suggests greater similarity under the chosen hash. A threshold turns that continuous clue into a candidate duplicate decision, and threshold choice trades missed near-duplicates against false matches. Test the threshold on the actual image collection. A catalog of nearly identical products can produce visually close signatures even when the photos represent different items. Perceptual hashes do not include semantic context or ownership.

Hashing is attractive for large collections because signatures are compact and can be indexed. But preprocessing choices such as resizing, color conversion and orientation affect results. A changed subject placed against the same background may share broad visual structure; an important edit in a small area may barely change a coarse hash. Conversely, a crop can dramatically alter global structure despite preserving the main subject. Review candidate pairs visually before deleting, merging or making an accusation.

Keep purposes separate. A cryptographic digest checks whether bytes are identical or changed; a perceptual hash ranks visual resemblance. Neither proves when a picture was taken, who created it or whether a document is authentic. For moderation or evidence handling, track the original file, method and threshold, and allow review of close calls. A single distance value is a screening signal, not a verdict.