Synthesizing Conversation Between Human-Like Cooperative Agents

本研究的目标是开发一个系统，自动生成和动画多个合作代理之间的对话与适当的和同步的语音，语调，面部表情和手势。 研究是基于理论，解决这些渠道之间的关系和协调。 本研究的意义在于为合作会话理论提供一个三维的计算机动画实验平台。 人机交互和训练系统需要更多的交互和合作的合成代理。 对话是由一个对话计划器创建的，它产生文本以及话语的语调。 说话者/听者的关系、文本的内容、语调和所采取的动作都决定了面部表情、嘴唇运动、眼睛注视、头部运动和手臂姿势生成器。 该项目将集中在代理必须提出和同意抽象计划的领域，并且可能必须激励和执行物理动作，并在对话期间引用物理环境中的对象。

The goal of this research is to develop a system which automatically generates and animates conversations between multiple cooperative agents with appropriate and synchronized speech, intonation, facial expressions, and hand gestures. The research is based on theory which addresses relations and coordinations between these channels. The significance of this research is to provide a three-dimensional computer animation testbed for cooperative conversation theories. Human-machine interaction and training systems need more interactive and cooperative synthetic agents. Conversations are created by a dialogue planner that produces the text as well as the intonation of the utterances. The speaker/listener relationship, the content of text, the intonation and the undertaken actions all determine facial expressions, lip motions, eye gaze, head motion, and arm gesture generators. This project will focus on domains in which agents must propose and agree on abstract plans, and may have to motivate and carry out physical actions and refer to objects in their physical environment during conversation.