À suivreGuide suivant
Pourquoi les générateurs d’images IA se trompent
IA visuelle
GUIDE DE L'IA Visuelle
AI video gets physics wrong because generators learn statistical patterns of how pixels usually change over time, not the rules of mass, force and collision.
They imitate the look of motion without simulating what causes it. That is why objects vanish, liquids act strangely, limbs pass through things and clips stay short, and it matters for anyone trying to judge whether footage is real or use these models for planning and robotics.
Video generators are trained on huge collections of footage to predict or denoise frames. The training objective rewards output that resembles real video. It does not reward output that obeys conservation of mass or momentum. Common physics, such as a ball falling or a person walking, is well represented in the data and usually looks right. Rare or complex events, such as glass shattering, a specific collision, or liquid pouring into an oddly shaped container, appear less often and are harder to learn. OpenAI's own technical material on Sora noted that it did not accurately model interactions like glass shattering. Object permanence is a memory problem. When something is hidden, the model has to carry its identity through frames where it is invisible. Models attend over a limited amount of context, so hidden objects can come back changed or not at all. Cause and effect is also weak: a bite, a spill or a dent should leave a lasting change, but the model may treat it as a passing visual event. Clip length is limited mainly by compute. A video is represented as spacetime tokens, and attention cost rises steeply as the token count grows, so many products generate seconds rather than minutes. Longer videos are often made by extending clips, which lets errors compound. A common misconception is that these models contain a physics engine. They do not, though they may pick up some implicit physical regularities. Researchers have built benchmarks such as Physics-IQ to test this and found that visually realistic output does not mean physical understanding. World-model research tries to close the gap: Google DeepMind's Genie line generates interactive environments, Meta's V-JEPA learns by predicting in an abstract representation space instead of pixels, and NVIDIA's Cosmos targets physical AI such as robotics.
L’IA visuelle peut automatiser les tâches d’inspection, de détection et de marquage à grande échelle.
Les équipes créatives peuvent prototyper des concepts plus rapidement avec moins de révisions manuelles.
Les opérations peuvent utiliser des signaux d’image et vidéo qui étaient auparavant difficiles à traiter.
Physical plausibility has improved with scale and better data, and it is likely to keep improving for common scenes. Harder cases, such as long-horizon cause and effect, rare interactions and reliable object permanence across long occlusions, may need architectural changes like explicit memory, 3D structure or hybrid simulation rather than scale alone. World models aimed at robotics and interactive environments are an active research area, and benchmarks that separately test visual realism and physical correctness will help show real progress. It is not settled whether pure video prediction can learn robust physics, and researchers disagree about it.
A generated person bites a cookie, but afterward the cookie has no bite mark. OpenAI named this kind of failure among Sora's limitations when it previewed the model in 2024.
A dog walks behind a tree and comes out the other side with a different coat pattern, because the model did not keep a stable memory of the hidden object.
A runner's legs appear to swap sides mid-stride and the feet slide along the ground, which shows the model learned the look of running, not the contact forces involved.
A basketball passes through the rim, briefly vanishes, and reappears in a player's hands, a sequence that looks smooth frame to frame but makes no physical sense.
Les droits à l’image et le consentement peuvent devenir des risques juridiques si la provenance n’est pas claire.
Les performances du modèle peuvent varier en fonction de l'éclairage, des données démographiques et des environnements.
Les faux positifs peuvent passer inaperçus si les seuils de confiance ne sont pas surveillés.
Définissez des critères d’acceptation pour la précision, le rappel et les coûts d’erreur.
Testez avec des données qui correspondent aux conditions de production réelles.
Ajoutez un examen humain pour les prédictions peu fiables ou à fort impact.
Suivez la dérive du modèle et revalidez après les modifications de la caméra ou de l’ensemble de données.
Free newsletter
Three verified AI stories every weekday morning, written in plain English. Free forever, no ads.
One email each weekday. Unsubscribe in one click. We never sell or share your address.
Test yourself
Instant feedback on every answer, and a shareable certificate with a verifiable ID once you pass a course.
Support free AI education. AI Understanding is a 501(c)(3) nonprofit — no ads, no paywall, ever. Make a donation
AI video gets physics wrong because generators learn statistical patterns of how pixels usually change over time, not the rules of mass, force and collision. They imitate the look of motion without simulating what causes it. That is why objects vanish, liquids act strangely, limbs pass through things and clips stay short, and it matters for anyone trying to judge whether footage is real or use these models for planning and robotics.
Models are trained to predict or denoise frames so the output looks like the training footage. Physical correctness is not measured directly.
Events that are uncommon in the data and physically complex give the model fewer examples to learn from, so its output is less reliable.
To keep a hidden object consistent, the model has to carry its identity through frames where it is invisible, and limited context makes that unreliable.
More frames mean more tokens, and attention cost grows fast with token count, so length is limited by compute.
Video generators have no explicit physics simulator. Any physics they show is implicit in learned patterns.
Continuez à apprendre
Plus de guides sélectionnés pour ce sujet
À suivreGuide suivant
Pourquoi les générateurs d’images IA se trompent
IA visuelle