Human-Centered Human-Computer Interface Using Computer Vision

点击翻译按钮获取中文摘要

In this research, we have realized a human-centered human-computer interface system that enables us to move a target object in a 3D CG world or a real robot by moving our hand.Conventional systems have the following three issues from the human-centered viewpoint.1.Need camera calibration.2.Have a limited camera field of view. We need to keep our mind on our hand position so that it may not go outside the camera field of view.3.Interpret hand motions only with respect to the reference frame fixed in the world. We sometimes, however, use the reference frame attached to our body in considering 3D spatial relation in such a way that, for example, the right direction is the direction of our right hand.We have proposed a vision algorithm using the multiple view affine invariance theory to solve the above issues. Then, we have develop a human interface system with a computer-controllable active camera system. Since we use invariance under viewing transformations, we do not need to know any camera parameters, thus requiring no camera calibration. This feature also allows the system to to move the cameras with a simple mechanism to keep the user in the field of view. Moreover, the system can interpret hand motions with respect to the world-fixed coordinate system and the human-centered one by taking the reference frame to obtain the invariants on an object fixed in the world and that on the user's body, respectively. The system can select an appropriate interpretation depending on the situation. Operation experiments confirm the usefulness of the system.