Inferring State Transition from Bystander to Participant in Free-style Conversational Interaction
[Abstract]
We propose a novel method for inferring the state transition from bystander to participant in free-style conversational interactions, using physical behaviors acquired from cameras and a microphone. Although existing methods address participants and a presenter, these methods do not consider bystanders, who play an important role in the interaction. In the research field of cognitive science, the existing model considers psychological aspects of changing from bystander to participant. However, this model is difficult to implement because inferring the psychological aspects of bystanders is a challenging task. Instead of using psychological aspects, our method exploits physical behaviors such as standing position, facial direction, and voice direction. We analyzed the suitable parameters of the behavior to increase performance in inferring state transitions, using datasets collected from poster presentations.
[Publications]
- 神原 隆宏, 西山 正志, 岩井 儀雄,
対話型プレゼンテーションにおける非参与者から参与者への状態遷移推定,
ヒューマンインタフェース学会論文誌, Vol. 22, No. 1, pp. 13 - 24, February 2020.
- Tatsuya Era, Hiroki Yoshimura, Masashi Nishiyama, Yoshio Iwai,
Inferring State Transition from Bystander to Participant in Free-style Conversational Interaction,
Proceedings of 14th IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS), pp. 1 - 6, August 2017.
[Short movie]