Human Interfaces Usag international and unintentional Nonverbal Behaviors

点击翻译按钮获取中文摘要

Unintentional nonverbal behaviors play an important role in human-human communication. However, only intentional nonverbal behaviors are used in human interfaces, which can be considered as human-machine communication. Thus we propose to use unintentional nonverbal behaviors in addition to intentional behaviors to realize user-friendly human interfaces. In this project, we have investigated the framework that is required in using unintentional behaviors effectively and have developed two application systems using such behaviors to prove the usefulness of our approach. As to the framework, we have devised a human-machine interaction method through gestures and verbal communication to recover failures, which cannot be avoided in recognizing unintentional behaviors by computer vision. One of the application systems is an intelligent wheelchair that can change how to avoid an approaching pedestrian according to the observation results of his/her head movements. If his/her head often turns toward it, he/she can be expected to notice it. Otherwise, he/she may not notice it. In the latter case, the wheelchair steps aside to avoid collision. In the former, it keeps observing the pedestrian because he/she usually starts avoiding it when it comes close to him/her. He/she does not move the head to show his/her noticing the wheelchair. However, the behavior can give valuable information for the wheelchair to determine the avoidance method. The second is a browser system that enables us to find necessary information speedily. Multiple windows containing information appear from the bottom of the display, moving upward swiftly. We move our eyes to obtain the information in the windows. The speed of such eye movements controls the upward moving speed of the windows so that we can get information from the system as fast as possible. Although we do not intend to move the eyes to control the speed, the action helps to realize a user-friendly human interface.