Conversation activity recognition using interaction video sequences in pedestrian groups
[Abstract]
We introduce a method for recognizing conversation activity in a group of people walking outdoors using a color video sequence acquired from a camera.
Many methods have been developed to recognize whether people are walking together or talking together in a color video sequence.
However, a method has yet to be proposed to recognize conversation activity in a pedestrian group walking outdoors.
In this paper, we design a feature extraction approach for conversation activity recognition using physical body interactions caused by pedestrians' conversations.
Our method generates an interaction video sequence in a virtual space using a temporal posture signal and a temporal walking position signal that represent pedestrians' body interactions.
Our method uses the interaction video sequence as an informative and visible feature to determine a conversation activity label.
The experimental results showed that our interaction video sequence recognized conversation activity more accurately than alternative techniques that use the appearance of the body regions of a pedestrian group or time-series changes of the posture and walking position among pedestrians.
[Publications]
- Tsubasa Kondo, Michiko Inoue, Shunsuke Yoneda, and Masashi Nishiyama
Reducing Computational Cost in Pedestrian Conversation Activity Recognition through Skeleton Spatiotemporal Graphs,
Proceedings of IEEE 14th Global Conference on Consumer Electronics (GCCE), OS-AIP, pp. 815 - 818, September 2025.
[Outstanding Prize Excellent Student Paper Awards]
[Slides]
- Wataru Ganaha, Takumi Ozaki, Michiko Inoue, and Masashi Nishiyama,
Conversation activity recognition using interaction video sequences in pedestrian groups,
Proceedings of 27th International Conference on Pattern Recognition (ICPR), Part XIV, pp. 359 - 374, December 2024.
[Poster]
- 近藤 翼, 井上 路子, 米田 駿介, 西山 正志,
歩行者の会話の活発さ認識の軽量化における骨格時空間グラフの有効性検証,
画像センシングシンポジウム (SSII), IS2-36, pp. 1 - 8, May 2025.
[Poster]
[Short movie]
- 尾崎 匠,井上 路子,西山 正志,
会話の活発さ認識における歩行者間のインタラクションの重要度の可視化,
ビジョン技術の実利用ワークショップ (ViEW), IS4-12, pp. 525 - 531, December 2023.
[Poster]
- 尾崎 匠,我那覇 航,井上 路子,西山 正志,
歩行者間の会話の盛衰認識における複数グループ対応の検討,
画像の認識・理解シンポジウム(MIRU), IS1-71, July 2023.
[Poster]