Making Discourse Visible: Realizing Conversational Facial Displays in Interactive Agents

让话语可见：在交互式代理中实现对话式面部显示

• 批准号: 0308121
• 负责人: Matthew Stone
• 金额: $ 39.33万
• 依托单位: Rutgers University New Brunswick
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-07-15 至 2007-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0308121&HistoricalAwards=false
• 关键词: Making; Discourse; Visible; Realizing; Conversational

When people communicate, they systematically employ a diverse set of nonverbal cues, and highlight the intended interpretation of their utterances. In face-to-face conversation, expressive movements of the brows and head are particularly pervasive. This project studies these facial conversational signals from the dual perspectives of human communication and computer animation, with the goal of realizing them effectively in spoken dialogue interfaces modeled on face-to-face conversation. The research strategy is to categorize and document facial conversational signals, to model their meaning and interpretation, to implement computational systems that generate and animate these signals, and to evaluate the contribution these systems can make to users' understanding of agents.This specific project fits into a broader program that uses animated agents to enhance the flexibility and accessibility of interfaces, by improving the robustness of dialogue systems, increasing communication bandwidth between users and computers, and supporting more collaborative styles of interaction. The results of this project, including new software, data and training materials, promise to lower the barriers to entry to this research area, and add to its momentum.

当人们交流时，他们系统地使用各种各样的非语言线索，并强调他们对话语的预期解释。 在面对面的谈话中，眉毛和头部的表情动作特别普遍。 本项目从人类交流和计算机动画的双重角度研究这些面部对话信号，目标是在模拟面对面对话的口语对话界面中有效地实现它们。 研究策略是对面部会话信号进行分类和记录，对其含义和解释进行建模，实现生成和动画这些信号的计算系统，并评估这些系统对用户理解代理的贡献。这个特定项目适合于一个更广泛的计划，该计划使用动画代理来增强界面的灵活性和可访问性，通过提高对话系统的鲁棒性，增加用户和计算机之间的通信带宽，以及支持更多的协作交互风格。 该项目的成果，包括新的软件、数据和培训材料，有望降低进入这一研究领域的门槛，并增加其势头。