Analysis by Synthesis of Embodied Communication System and It's Application to Human Interface

点击翻译按钮获取中文摘要

On the basis of the entrainment among verbal and nonverbal behavior in face-to-face communication, Embodied Communication System for Mind Connection (E-COSMIC) is developed for supporting essential human interaction in communication. E-COSMIC consists of an embodied virtual communication system for human interaction analysis by synthesis and a speech driven embodied interaction system. The former provides networked virtual communication environment in which two remote talkers can share embodied interaction through their avatars of VirtualActors or VirtualWaves including themselves in the same virtual space. The latter is a speech driven embodied interaction robots system for supporting human interaction by generating the communicative motions of robots coherently related to speech input on the basis of the analysis using the former. E-COSMIC would form the foundation of mediated communication technologies as well as the methodology for the analysis and understanding of human interactions.