Why AI Image Generators Get Hands Wrong

Diffusion models learn from billions of image-caption pairs by learning to reverse added noise. They become very good at local visual patterns: skin texture, lighting, the general look of a hand. What they never receive is an explicit rule that a hand has five fingers joined to a palm in a particular order. Several factors make hands hard. Hands take up a small part of most photos, so they get few pixels. Latent diffusion models such as Stable Diffusion also shrink images by a factor of eight in each dimension before generating, which can leave a hand only a handful of latent cells. Hands take an enormous range of poses, grip objects, overlap each other and are often partly hidden, so the training data is full of incomplete views. Fingers look alike, so a model producing 'finger, finger, finger' has no strong signal telling it when to stop. Captions almost never mention hands, let alone their pose, so the prompt offers little guidance. The result is a set of familiar errors: extra or missing fingers, fused digits, thumbs on the wrong side, and hands melting into objects or other people. Teeth, ears and jewelry go wrong for similar reasons. Newer systems have reduced these failures. Larger models, higher training resolutions, better filtered and captioned data, transformer-based architectures and fine-tuning on human preference ratings all helped. Midjourney's version 5 in 2023 was widely noted for better hands, and later models from several labs improved further. Errors have not disappeared, though, especially in complex poses, crowds and hands holding things. A common misconception is that the model 'cannot count'. It is more accurate to say it learns appearance statistically, and correct structure emerges only when the data and model capacity are sufficient.