Key Points
We use a camera and wireless devices together to learn the relationship between radio signal strength and person positions when there is no shielding. When the camera's view is temporarily blocked, this learned relationship is used to estimate person positions.
Abstract
A camera can use images to locate people, but this becomes difficult when an object blocks its view. This research uses radio waves that can pass through an obstruction to estimate people's positions while the camera's view is temporarily blocked.
To learn how radio signal strength relates to position, a computer needs examples that pair the two measurements. While people are visible, we use the camera to locate them and wireless devices to measure signal strength at the same time. We collect these pairs automatically and train a computer model to learn the relationship. When the camera's view is blocked, the model uses the radio measurements to estimate people's positions.
We tested the method with people walking through a poster exhibition space where the camera's view was temporarily blocked. The position estimation error was 15.9 cm when one person was walking and 18.7 cm when two people were walking at the same time.
Publications
- Yuji Makimura, Daichi Hayashi, Teppei Kobiki, Shouki Sakemoto and Masashi Nishiyama,
Estimating Person Positions using a Camera and Wireless Devices in a Space with Temporary Shielding, Proceedings of 21st International Conference on Computer Vision Theory and Applications (VISAPP), Vol. 2, pp. 259 - 266, March 2026. [Slides] - 牧村 悠司, 林 大智, 木挽 哲星, 酒本 将希, 西山 正志,
一時遮蔽が生じる空間における映像と電波強度を併用した人物位置推定, 精密工学会誌, vol. 90, no. 12, pp. 924 - 932, December 2024. [DOI] - 牧村 悠司，西山 正志,
一時遮蔽が生じる空間での映像と電波強度を併用した人物位置推定の検討,
動的画像処理実利用化ワークショップ (DIA), IS3-17, pp. 439 - 443, March 2023. [Poster] - 木挽 哲星，牧村 悠司，酒本 将希，西山 正志，岩井 儀雄,
一時遮蔽が生じる空間におけるカメラと無線機器を併用した人物追跡のためのデータセット構築,
動的画像処理実利用化ワークショップ (DIA), IS2-23, pp. 308 - 314, March 2023. [Poster]
