Human Interfaces Usag international and unintentional Nonverbal Behaviors

无意非言语行为在人与人的交际中起着重要的作用。然而，只有有意的非语言行为被用于人机界面，这可以被认为是人机交流。因此，我们建议使用无意的非语言行为，除了有意的行为，以实现用户友好的人机界面。在这个项目中，我们已经调查的框架，需要在使用无意的行为有效，并开发了两个应用系统，使用这些行为来证明我们的方法的有用性。至于框架，我们设计了一个人机交互方法，通过手势和语言交流来恢复故障，这是无法避免的识别无意行为的计算机视觉。其中一个应用系统是智能轮椅，可以根据他/她的头部运动的观察结果改变如何避免接近行人。如果他/她的头经常转向它，他/她可能会注意到它。否则，他/她可能不会注意到它。在后一种情况下，轮椅靠边，以避免碰撞。在前者中，它一直在观察行人，因为他/她通常会在它靠近他/她时开始避开它。他/她不会移动头部以显示他/她注意到轮椅。然而，行为可以为轮椅提供有价值的信息，以确定回避方法。第二个是一个浏览器系统，使我们能够迅速找到所需的信息。包含信息的多个窗口从显示器底部出现，快速向上移动。我们移动我们的眼睛来获取窗口中的信息。这种眼球运动的速度控制着窗口向上移动的速度，这样我们就可以尽可能快地从系统中获取信息。虽然我们不打算移动眼睛来控制速度，但该动作有助于实现用户友好的人机界面。

Unintentional nonverbal behaviors play an important role in human-human communication. However, only intentional nonverbal behaviors are used in human interfaces, which can be considered as human-machine communication. Thus we propose to use unintentional nonverbal behaviors in addition to intentional behaviors to realize user-friendly human interfaces. In this project, we have investigated the framework that is required in using unintentional behaviors effectively and have developed two application systems using such behaviors to prove the usefulness of our approach. As to the framework, we have devised a human-machine interaction method through gestures and verbal communication to recover failures, which cannot be avoided in recognizing unintentional behaviors by computer vision. One of the application systems is an intelligent wheelchair that can change how to avoid an approaching pedestrian according to the observation results of his/her head movements. If his/her head often turns toward it, he/she can be expected to notice it. Otherwise, he/she may not notice it. In the latter case, the wheelchair steps aside to avoid collision. In the former, it keeps observing the pedestrian because he/she usually starts avoiding it when it comes close to him/her. He/she does not move the head to show his/her noticing the wheelchair. However, the behavior can give valuable information for the wheelchair to determine the avoidance method. The second is a browser system that enables us to find necessary information speedily. Multiple windows containing information appear from the bottom of the display, moving upward swiftly. We move our eyes to obtain the information in the windows. The speed of such eye movements controls the upward moving speed of the windows so that we can get information from the system as fast as possible. Although we do not intend to move the eyes to control the speed, the action helps to realize a user-friendly human interface.