Study of Human Interface based on the Principle of Entrainment in Communication

(1)体验式虚拟交流系统综合开发了一个用于人机交互分析的体验式虚拟面对面交流系统，并对该系统的有效性进行了验证。该系统提供了虚拟通信环境，其中两个远程说话者通过他们的虚拟演员(VA)或虚拟波(VW)进行通信，表示他们基于他们的动作和声音的面对面的交互行为。说话者可以通过观察他们在同一虚拟空间中与包括他们自己在内的VAS或VW的交互来获得交互意识。在该系统中，即使网络中存在数据传输的时延，由于VA的每次行为在相同的空间中以相同的方式延迟，因此VAS的时间交互关系保持自然。因此，该系统不同于传统的电信系统，在传统的电信系统中，说话者之间的通信空间是分开的，因为只显示与之交谈的伙伴。(2)具身交互机器人系统基于人类面对面交互中的夹带机制，提出了具身交互机器人系统的概念。在此基础上开发了系统原型，其中包括两个模型：一个是听话者的头部、手臂和身体的反应模型，该模型基于语音突发-停顿到点头的移动平均(MA)模型；另一个是说话人的身体反应模型，该模型基于说话人自己的MA模型。最后，验证了该系统身体交互的有效性。还评估了机器人作为物理媒体的效果，并与作为电子媒体的计算机图形进行了比较。预计这些系统将成为信息媒体和通信技术的基础，以及分析和理解各种人类互动的方法。

(1) Embodied Viritual Communication SystemAn embodied virtual face-to-face communication system for human interaction analysis by synthesis was developed, and the effectiveness of the system was demonstrated. The system provides virtual communication environments where two remote talkers communicate through their virtual actors (VAs) or virtual waves (VWs) representing their face-to-face interactive behavior on the basis of their motions and voices. Talkers can obtain interaction awareness by observing their interaction of VAs or VWs including themselves in the same virtual space. In the system, even if the time lags of data transmission exist in network, the temporal interaction relation of VAs keeps natural because each behavior of VA is delayed in the same way in the same space. Thus, this system is quite unlike the conventional telecommunication systems where the communication space between talkers is separated because only the partner to talk to is displayed.(2) Embodied Interaction Robots SystemThe concept of embodied interaction robots system was proposed based on an entrainment mechanism in human face-to-face interaction. Then, the prototype of the system was developed in which two models were incorporated : one was a listener's response model of head, arms andbody with timing equivalent to nodding on the basis of the moving average (MA) model of burst-pause of speech to nodding ; the other was a speaker's bodily response model based on his own MA model. Finally, the effectiveness of the system's bodily interaction was demonstrated. The effects of robots as physical media were also evaluated in comparison with computer graphics as electronic media.The systems would be expected to form the foundation of information media and communication technologies as well as the methodology for the analysis and understanding of various human interactions.