A body-mounted camera system for head-pose estimation and user-view image synthesis
A body-mounted camera system for head-pose estimation and user-view image synthesis
复制标题
用于头部姿势估计和用户视图图像合成的穿戴式摄像头系统
DOI：
10.1016/j.imavis.2005.12.019
复制
发表时间：
2007
期刊：
影响因子：
--
通讯作者：
M. Yachida
中科院分区：
文献类型：
--
作者：
H. Yamazoe;A. Utsumi;K. Hosaka;M. Yachida
在本文中，我们提出了一个身体安装的系统来捕捉用户体验的音频/视频信息。该系统由两个摄像头（头部检测和广角）和一个麦克风。头部检测相机捕获用户头部运动，而广角彩色相机捕获用户正面视图图像。然后基于估计的人类头部运动从广角图像合成近似对应于用户视图的图像区域。合成的图像和头部运动数据与音频数据一起存储在存储设备中。该系统克服了头戴式摄像机在易于戴上/取下设备方面的缺点。它对第三人的视觉影响也较小。使用所提出的系统，我们可以同时记录音频数据，图像在用户的视野，和头部姿态（点头，摇头等）。同步这些数据包含用于记录/分析人类活动的重要信息，并且可以用于更广泛的应用领域，例如数字日记或交互分析。实验结果证明了该系统的有效性。
In this paper, we propose a body-mounted system to capture user experience as audio/visual information. The proposed system consists of two cameras (head-detection and wide angle) and a microphone. The head-detection camera captures user head motions, while the wide angle color camera captures user frontal view images. An image region approximately corresponding to user view is then synthesized from the wide angle image based on estimated human head motions. The synthesized image and head-motion data are stored in a storage device with audio data. This system overcomes the disadvantages of head-mounted cameras in terms of ease of putting on/taking off the device. It also has less obtrusive visual impact on third persons. Using the proposed system, we can simultaneously record audio data, images in the user field of view, and head gestures (nodding, shaking, etc.) simultaneously. These data contain significant information for recording/analyzing human activities and can be used in wider application domains such as a digital diary or interaction analysis. Experimental results demonstrate the effectiveness of the proposed system.