视觉人工智能指南

Why AI Image Generators Get Hands Wrong

AI image generators get hands wrong because hands are small, highly flexible, often partly hidden and rarely described in captions.

  • 4 分钟阅读
  • 最后更新
在本页4 分钟阅读
  1. 概述
  2. 深入探讨
  3. 战略影响
  4. The Future of Why AI Image Generators Get Hands Wrong
  5. 现实世界的实施
  6. 风险与防护栏
  7. 实施路线图
  8. 不断探索
  9. 常见问题

概述

Models learn what hands look like on the surface without reliably learning their structure, such as five fingers per hand. Hand errors became a well-known sign of synthetic images, and understanding why they happen explains both how newer models improved and why counting fingers is no longer a dependable way to spot fakes.

深入探讨

Diffusion models learn from billions of image-caption pairs by learning to reverse added noise. They become very good at local visual patterns: skin texture, lighting, the general look of a hand. What they never receive is an explicit rule that a hand has five fingers joined to a palm in a particular order. Several factors make hands hard. Hands take up a small part of most photos, so they get few pixels. Latent diffusion models such as Stable Diffusion also shrink images by a factor of eight in each dimension before generating, which can leave a hand only a handful of latent cells. Hands take an enormous range of poses, grip objects, overlap each other and are often partly hidden, so the training data is full of incomplete views. Fingers look alike, so a model producing 'finger, finger, finger' has no strong signal telling it when to stop. Captions almost never mention hands, let alone their pose, so the prompt offers little guidance. The result is a set of familiar errors: extra or missing fingers, fused digits, thumbs on the wrong side, and hands melting into objects or other people. Teeth, ears and jewelry go wrong for similar reasons. Newer systems have reduced these failures. Larger models, higher training resolutions, better filtered and captioned data, transformer-based architectures and fine-tuning on human preference ratings all helped. Midjourney's version 5 in 2023 was widely noted for better hands, and later models from several labs improved further. Errors have not disappeared, though, especially in complex poses, crowds and hands holding things. A common misconception is that the model 'cannot count'. It is more accurate to say it learns appearance statistically, and correct structure emerges only when the data and model capacity are sufficient.

战略影响

速度与规模

视觉人工智能可以大规模自动化检查、检测和标记任务。

构建选择

创意团队可以通过更少的手动修改更快地构建概念原型。

团队与工作流程

操作可以使用以前难以处理的图像和视频信号。

The Future of Why AI Image Generators Get Hands Wrong

Hand errors will likely keep shrinking as models grow and training data improves, but unusual poses, interlocked hands and hands manipulating objects remain harder than a simple open palm. Video generation adds a new version of the problem, because fingers must stay consistent from frame to frame. For anyone judging authenticity, hand checks are a weak signal. A malformed hand still suggests an image was generated, but a correct hand proves nothing. Provenance records and watermarks are more reliable than checking anatomy.

现实世界的实施

An early Stable Diffusion portrait shows someone holding a coffee cup with six fingers wrapped around it, a typical failure when a model blends many overlapping grip poses.

A group scene from an older model merges two people's hands where they touch, because the model has no firm idea of where one body ends and another begins.

An artist feeds a ControlNet OpenPose or depth map made from a photo of her own hand to force a correct pose, then inpaints any remaining errors.

A fact-checker notes that a suspected fake has perfectly normal hands, a reminder that newer generators often draw hands correctly and other clues are needed.

风险与防护栏

  • 如果出处不明,肖像权和同意可能会成为法律风险。

  • 模型性能可能因光照、人口统计和环境的不同而有所不同。

  • 除非监控置信阈值,否则误报可能会被忽视。

实施路线图

  1. 定义精确度、召回率和错误成本的接受标准。

  2. 使用符合实际生产条件的数据进行测试。

  3. 为低置信度或高影响力的预测添加人工审核。

  4. 跟踪模型漂移并在相机或数据集更改后重新验证。

不断探索

Free newsletter

Get the daily AI briefing

Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.

One email each weekday. Unsubscribe in one click. We never sell or share your address.

Test yourself

Take the Why AI Image Generators Get Hands Wrong quiz

Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.

开始测验

Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation

常见问题

What is Why AI Image Generators Get Hands Wrong?

AI image generators get hands wrong because hands are small, highly flexible, often partly hidden and rarely described in captions. Models learn what hands look like on the surface without reliably learning their structure, such as five fingers per hand. Hand errors became a well-known sign of synthetic images, and understanding why they happen explains both how newer models improved and why counting fingers is no longer a dependable way to spot fakes.

According to the guide, what does a diffusion model mainly learn from image-caption pairs?

Models learn how things look statistically. Nothing in training gives them an explicit rule that a hand has five fingers.

How does latent compression in Stable Diffusion make hands harder to draw?

A small hand that shrinks eightfold in each dimension ends up with very little space to represent five distinct fingers.

Why do captions give models little help with hands?

Without text describing hand poses, the model cannot link prompt words to hand structure.

Which Midjourney version does the guide say was widely noted for better hands in 2023?

Midjourney's version 5, released in 2023, was widely noted for improved hands, part of a broader trend of scaling and better data.

What does an ADetailer-style detect-and-repaint workflow do?

Enlarging the crop gives the hand many more latent cells during regeneration, which improves its structure.