Human Interfaces Usag international and unintentional Nonverbal Behaviors

非故意非言语行为在人与人之间的交流中起着重要的作用。然而，只有有意的非语言行为才能用于人机界面，这可以被认为是人机交流。因此，我们建议在有意的行为之外，使用非故意的非语言行为来实现用户友好的人机界面。在这个项目中，我们研究了有效使用非故意行为所需的框架，并开发了两个使用这些行为的应用系统来证明我们方法的有效性。在该框架中，我们设计了一种通过手势和语言交流的人机交互方法来恢复故障，这是计算机视觉识别无意行为时无法避免的。其中一个应用系统是智能轮椅，它可以根据行人头部运动的观察结果来改变如何避开接近的行人。如果他/她的头经常转向它，他/她可能会注意到它。否则，他/她可能不会注意到它。在后一种情况下，轮椅会让开以避免碰撞。在前者中，它一直在观察行人，因为他/她通常在行人接近他/她时开始躲避它。他/她没有移动头部以表示他/她注意到了轮椅。然而，该行为可以为轮椅确定避让方法提供有价值的信息。第二个是浏览器系统，它使我们能够快速地找到必要的信息。多个包含信息的窗口从显示屏底部出现，快速向上移动。我们移动眼睛来获取橱窗里的信息。这种眼球运动的速度控制着窗户的向上移动速度，这样我们就可以尽可能快地从系统中获取信息。虽然我们不打算移动眼睛来控制速度，但该动作有助于实现用户友好的人性化界面。

Unintentional nonverbal behaviors play an important role in human-human communication. However, only intentional nonverbal behaviors are used in human interfaces, which can be considered as human-machine communication. Thus we propose to use unintentional nonverbal behaviors in addition to intentional behaviors to realize user-friendly human interfaces. In this project, we have investigated the framework that is required in using unintentional behaviors effectively and have developed two application systems using such behaviors to prove the usefulness of our approach. As to the framework, we have devised a human-machine interaction method through gestures and verbal communication to recover failures, which cannot be avoided in recognizing unintentional behaviors by computer vision. One of the application systems is an intelligent wheelchair that can change how to avoid an approaching pedestrian according to the observation results of his/her head movements. If his/her head often turns toward it, he/she can be expected to notice it. Otherwise, he/she may not notice it. In the latter case, the wheelchair steps aside to avoid collision. In the former, it keeps observing the pedestrian because he/she usually starts avoiding it when it comes close to him/her. He/she does not move the head to show his/her noticing the wheelchair. However, the behavior can give valuable information for the wheelchair to determine the avoidance method. The second is a browser system that enables us to find necessary information speedily. Multiple windows containing information appear from the bottom of the display, moving upward swiftly. We move our eyes to obtain the information in the windows. The speed of such eye movements controls the upward moving speed of the windows so that we can get information from the system as fast as possible. Although we do not intend to move the eyes to control the speed, the action helps to realize a user-friendly human interface.