Video Generation using Motion Magnification for Visualization of High-frequency Components in Body Sway


BodySwayViz.jpg
[Abstract]
We propose a method for temporally enhancing the high-frequency components of video sequences with no artifacts to observe the micromovement of the human body. The existing methods of video motion magnification cause severe artifacts in the enhanced video sequence because the temporal micromovement and the spatial appearance of a subject are not stably separated from the input video sequence. When the observer views the enhanced video sequence with severe artifacts, they cannot fully check the high-frequency components of body sway. Here, we assume that the temporal micromovement is the same among all pixels contained in the subject's head. Our method stably separates the video sequence into the temporal micromovement and the spatial appearance. Then, our method amplifies the high-frequency components of the temporal micromovement. The experimental results show that our method enhanced the video sequence of body sway with no artifacts. We confirmed that the high-frequency components were viewed in the enhanced video sequence. We also visualized the reason for success or failure in baggage weight classification using the video sequence of body sway as an application of our method.
[Publication]
[Short movies]





otama1.png