TALECRAFTERS
← All posts
CRAFTPRODUCTION

Why Hands Still Fail, and How to Frame Around Them

Konstantinos Chatzimichail3 min read
CRAFT

Hands fail because they have more articulated joints than anything else in a typical frame, they occlude themselves constantly, and every viewer has spent their life looking at them. The reliable production answer is compositional: frame so the hardest hand configurations are not in shot.

Hands have been the standing joke about generative imagery for years, and the joke has outlived its accuracy: a still of a hand at rest is now usually fine. What has not changed is hands in motion, hands interacting with objects, and hands doing anything specific — which is, unfortunately, most of what hands do in advertising.

Why it is structurally hard

  • Articulation. A hand has more independently moving joints than the rest of a body’s visible structure combined, and the valid configurations are a small subset of the possible ones.
  • Self-occlusion. Fingers hide other fingers constantly, so the model is inferring geometry it cannot see from geometry it can, at every frame.
  • Variety in training data. Hands appear at every scale, angle and degree of blur, in far more configurations than faces, which means less consistent signal per configuration.
  • Expertise in the viewer. Everybody has looked at hands their entire life and can detect a wrong one instantly without being able to say what is wrong.
  • No partial credit at the extremities. A slightly wrong shoulder is invisible; a sixth finger is the only thing in the frame.

In video it compounds, because the hand has to be correct in every frame and consistent between them. Extremity drift is typically the third thing to degrade as a clip runs on, and it is the first one an untrained viewer reliably catches.

The eight compositional moves

The technique is the same one physical production has always used for something difficult: do not put it in the shot.

  1. Crop at the wrist. A frame that ends above the hands cannot have wrong hands, and it is a legitimate composition rather than an evasion.
  2. Put hands behind an object. A hand on the far side of a cup, a counter or a laptop is half a hand.
  3. Hands at rest and together. Interlocked or resting hands present a simpler silhouette than a hand in mid-gesture.
  4. Motion blur. A hand moving fast enough to blur is a hand that does not have to resolve.
  5. Out of focus. A hand in the near foreground at f/2 is a shape, and shapes do not have finger counts.
  6. Small in frame. Fewer pixels per hand is fewer pixels in which to be wrong.
  7. Gloves. Genuinely effective, and appropriate in more categories than people assume: food, industry, medical, laboratory, cold weather.
  8. Cut before the gesture completes. The end of a gesture is where the configuration is most specific and most likely to fail.

When you genuinely need the hand

Product interaction is the case where none of the above helps, because the hand holding the product is the shot. Three approaches, in order of cost:

APPROACHCOSTWHEN
Generate many, gate hardModerateThe shot is achievable but the acceptance rate is low. Budget the attempts explicitly.
Inpaint the hand into an approved plateModerateThe rest of the frame is right and only the hand failed.
Film the hand, composite into a generated worldHigherWhen the hand has to do something specific. Two hours and a phone camera is often enough.
Getting a usable hand-on-product shot

The third is under-used and frequently the cheapest overall. A hand, a product and a piece of neutral background, filmed properly, then composited into a generated environment, removes the least reliable element from the least reliable process.

The gate

Whatever the approach, every frame containing a visible hand gets checked at full size before it goes anywhere. Count the fingers, check the joint directions, check the thumb is on the correct side, and check the hand connects to a plausible wrist.

In video, do this on the first frame, the last frame and one in the middle at minimum. A hand that is correct at the start and wrong at the end is the standard failure, and it is invisible at playback speed.

The extremity gate, with the pass criteria and the rule about never patching a frame into passing.

THE CONSISTENCY CHECKLIST

Questions people actually ask

Why does AI still get hands wrong?

Because hands have more articulated joints than anything else in a typical frame, they occlude themselves constantly so geometry has to be inferred, they appear in far more configurations than faces in training data, and every viewer is an expert in them. There is also no partial credit: a sixth finger is the only thing in the frame.

How do you avoid AI hand problems?

Compositionally. Crop at the wrist, put hands behind an object, keep them at rest, use motion blur or shallow focus, keep them small in frame, use gloves where the category allows, and cut before a gesture completes. Cropping at the wrist costs nothing and removes the failure entirely.

What do you do when the shot needs a hand holding the product?

Generate many and gate hard with the attempts budgeted explicitly, inpaint the hand into an otherwise approved plate, or film the hand against neutral background and composite it into a generated world. The third is under-used and is often the cheapest overall.

Are hands worse in AI video than in images?

Considerably. The hand has to be correct in every frame and consistent between them, and extremity drift is typically the third thing to degrade as a clip runs on — and the first one an untrained viewer reliably catches.

How should you check a frame for hand errors?

At full size, every time: count the fingers, check joint directions, check the thumb is on the correct side, and check the hand connects to a plausible wrist. In video, check the first frame, the last frame and one in the middle — a hand correct at the start and wrong at the end is the standard failure and is invisible at playback speed.

WRITTEN BY

Konstantinos Chatzimichail
FOUNDER AND CREATIVE DIRECTOR, TALECRAFTERS

Founder of TaleCrafters. Writes the pipelines the studio works to, directs the films that come out of them, and publishes both.

More from Konstantinos

TERMS USED HERE

TAKE THE TOOL WITH YOU

READ NEXT