Study of Human Interface based on the Principle of Entrainment in Communication

(1)具身虚拟交流系统开发了用于人机交互综合分析的具身虚拟面对面交流系统，并对系统的有效性进行了验证。该系统提供了虚拟通信环境，两个远程通话者通过代表他们面对面互动行为的虚拟演员（VAs）或虚拟波（VWs）以他们的动作和声音为基础进行通信。说话者可以通过观察自己与包括自己在内的虚拟对象或虚拟大众在同一虚拟空间中的互动来获得交互意识。在系统中，即使网络中存在数据传输的时间滞后，由于虚拟机的各个行为在同一空间中以相同的方式延迟，虚拟机的时间交互关系保持自然。因此，该系统与传统的通信系统非常不同，在传统的通信系统中，讲话者之间的通信空间是分开的，因为只显示要与之交谈的伙伴。(2)具身交互机器人系统基于人类面对面交互的夹带机制，提出了具身交互机器人系统的概念。在此基础上，结合两个模型构建了该系统的原型：一个模型是基于言语对点头的突发-暂停移动平均（MA）模型的听者头部、手臂和身体的响应模型，其时间相当于点头；另一个是基于他自己的MA模型的说话者的身体反应模型。最后，验证了系统身体交互的有效性。机器人作为物理媒介的效果也与计算机图形学作为电子媒介进行了比较评估。预计这些系统将构成信息媒介和通信技术的基础，以及分析和理解各种人类相互作用的方法。

(1) Embodied Viritual Communication SystemAn embodied virtual face-to-face communication system for human interaction analysis by synthesis was developed, and the effectiveness of the system was demonstrated. The system provides virtual communication environments where two remote talkers communicate through their virtual actors (VAs) or virtual waves (VWs) representing their face-to-face interactive behavior on the basis of their motions and voices. Talkers can obtain interaction awareness by observing their interaction of VAs or VWs including themselves in the same virtual space. In the system, even if the time lags of data transmission exist in network, the temporal interaction relation of VAs keeps natural because each behavior of VA is delayed in the same way in the same space. Thus, this system is quite unlike the conventional telecommunication systems where the communication space between talkers is separated because only the partner to talk to is displayed.(2) Embodied Interaction Robots SystemThe concept of embodied interaction robots system was proposed based on an entrainment mechanism in human face-to-face interaction. Then, the prototype of the system was developed in which two models were incorporated : one was a listener's response model of head, arms andbody with timing equivalent to nodding on the basis of the moving average (MA) model of burst-pause of speech to nodding ; the other was a speaker's bodily response model based on his own MA model. Finally, the effectiveness of the system's bodily interaction was demonstrated. The effects of robots as physical media were also evaluated in comparison with computer graphics as electronic media.The systems would be expected to form the foundation of information media and communication technologies as well as the methodology for the analysis and understanding of various human interactions.