Human-Centered Human-Computer Interface Using Computer Vision

在本研究中，我们实现了一个以人为中心的人机界面系统，使我们能够移动目标对象在三维CG世界或真实的机器人通过移动我们的手。传统的系统有以下三个问题，从以人为中心的观点：1.需要相机校准。我们需要注意我们的手的位置，这样它就不会超出摄像机的视野。3.只根据世界上固定的参考系来解释手的运动。然而，我们有时会使用附着在我们身体上的参考系来考虑三维空间关系，例如，正确的方向是我们右手的方向，我们提出了一种基于多视图仿射不变性理论的视觉算法来解决上述问题。然后，我们开发了一个人机界面系统与计算机控制的主动摄像机系统。由于我们在观察变换下使用不变性，因此我们不需要知道任何相机参数，因此不需要相机校准。该功能还允许系统通过简单的机制移动摄像头，以保持用户在视野中。此外，该系统可以解释相对于世界固定的坐标系和人类为中心的一个参考框架，以获得固定在世界上的对象和用户的身体上的不变量，分别手运动。系统可以根据情况选择适当的解释。运行实验证实了该系统的有效性。

In this research, we have realized a human-centered human-computer interface system that enables us to move a target object in a 3D CG world or a real robot by moving our hand.Conventional systems have the following three issues from the human-centered viewpoint.1.Need camera calibration.2.Have a limited camera field of view. We need to keep our mind on our hand position so that it may not go outside the camera field of view.3.Interpret hand motions only with respect to the reference frame fixed in the world. We sometimes, however, use the reference frame attached to our body in considering 3D spatial relation in such a way that, for example, the right direction is the direction of our right hand.We have proposed a vision algorithm using the multiple view affine invariance theory to solve the above issues. Then, we have develop a human interface system with a computer-controllable active camera system. Since we use invariance under viewing transformations, we do not need to know any camera parameters, thus requiring no camera calibration. This feature also allows the system to to move the cameras with a simple mechanism to keep the user in the field of view. Moreover, the system can interpret hand motions with respect to the world-fixed coordinate system and the human-centered one by taking the reference frame to obtain the invariants on an object fixed in the world and that on the user's body, respectively. The system can select an appropriate interpretation depending on the situation. Operation experiments confirm the usefulness of the system.