Key Points
When a climber reaches for the next hold, do people follow the hand or look at the face? We map viewers’ gaze to parts of the athlete’s body instead of points on the screen. The colors show where people looked at a particular moment and which body parts drew their eyes over the whole clip.

Abstract
If you follow a tennis player’s right hand, your eyes move across the screen even though you are looking at the same hand. We estimate the athlete’s pose in each video frame, then map viewers’ gaze to a 3D body model in that pose. If someone looks just beyond the model’s surface, for example at the edge of the athlete’s hair or clothing, we also count that gaze toward nearby body parts.
In our experiment, participants watched clips of climbing, tennis and a martial arts kick and judged whether the athletes’ movements felt dynamic. Combining the gaze measurements on a model in a fixed pose let us compare the three clips. In the climbing clip, viewers tended to look at the head, arms and right side of the body. In the tennis and kicking clips, they looked mainly at the head.
Publications
- Fuyuko Iwasaki, Shouta Hioki, Shunsuke Yoneda, Michiko Inoue, Masashi Nishiyama,
Using 3D heatmaps to visualize the gaze distributions of observers watching a moving subject, Proceedings of IEEE International Conference on Systems, Man, and Cybernetics (SMC), pp. 7097 - 7102, October 2025. [Slides] - 岩崎 芙由子, 井上 路子, 米田 駿介, 西山 正志,
被写体動作の躍動感を評価する観察者から計測された視線の3Dヒートマップ表現,
信学技報, vol. 123, no. 358, PRMU2023-39, pp. 1 - 6, January 2024. [Slides] [Short movie]