Collaborative Research: Dyadic Rapport within and across Cultures: Multimodal Assessment of Human-Human and Human-Computer Interaction

合作研究：文化内部和文化之间的二元关系：人与人以及人与计算机交互的多模式评估

• 批准号: 0729287
• 负责人: Jonathan Gratch
• 金额: $ 26.25万
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2008
• 资助国家: 美国
• 起止时间: 2008-01-15 至 2010-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0729287&HistoricalAwards=false
• 关键词: Collaborative; Research; Dyadic; Rapport; within

Members of different cultures may behave quite differently from one another when interacting face-to-face. Culture-specific aspects of speech and nonverbal behavior are signals that enable members of a culture to establish and maintain a sense of rapport with one another over intervals of interaction. Rapport, and the means by which conversation partners achieve it, is important to study systematically, because rapport is known to increase the likelihood of success of goal-directed interaction, and also to promote knowledge sharing and learning. Subtle cues signal engagement, endorsement, or appreciation. In the verbal channel, these include mirroring of word choices and of grammatical structures as well as vocal feedback. Similarly, many dimensions of nonverbal behavior such as posture, gaze, nods, and gesticulation, signal -- both to the conversation participants and to observers of them -- the extent to which the participants feel a sense of affiliation. A multidisciplinary team of psychologists, anthropologists, linguists, and computer scientists, will examine and compare such indices of rapport in natural interactions across members of three diverse language/cultural groups: Gulf/Iraqi Arabic-, Mexican Spanish-, and American English-speaking cultures. An integral part of this project is to further develop technologies that enable micro-analyses of synchronized gesture and speech, both within individuals and across conversation partners. These technologies include computer interfaces for visualization, annotation, and analysis of complex, multimodal behaviors. The project will develop techniques to automatically recognize states of rapport and the verbal and nonverbal signals that lead to its disruption. The results of these examinations of human-human interaction will then be used to program behavioral repertoires for 'Embodied Conversational Agents' (ECAs). These are computer-generated, two-dimensional figures, human in appearance and capable of a range of verbal and nonverbal behaviors characteristic of listeners in interactions. The team will study human research participants in interaction with the ECAs, manipulating, in the ECAs, aspects of behavior identified as related to establishment, maintenance, and disruption of rapport, so as to observe the effects on human participants. The cross-cultural dimension of this comparative study will make it possible to identify what aspects of behavior are crucial for scaffolding successful intercultural interaction and communication among people of different cultures.

不同文化的成员在面对面交流时，行为可能会大不相同。言语和非言语行为的文化特定方面是使文化成员能够在互动期间建立和保持相互关系的信号。融洽关系以及谈话伙伴实现融洽关系的方式对系统地研究很重要，因为融洽关系可以增加目标导向互动成功的可能性，也可以促进知识共享和学习。微妙的暗示意味着参与、认可或欣赏。在言语渠道中，这些包括词语选择和语法结构的镜像以及声音反馈。同样，非语言行为的许多方面，如姿势、凝视、凝视和手势，都向对话参与者和观察者发出信号，表明参与者感觉到归属感的程度。一个由心理学家、人类学家、语言学家和计算机科学家组成的多学科团队将研究和比较三个不同语言/文化群体成员之间自然互动中的融洽指数：海湾/伊拉克阿拉伯语、墨西哥西班牙语和美国英语文化。该项目的一个组成部分是进一步开发技术，使同步手势和语音的微观分析，无论是在个人和跨对话伙伴。这些技术包括用于可视化、注释和分析复杂多模态行为的计算机接口。该项目将开发自动识别融洽状态以及导致其中断的语言和非语言信号的技术。这些人与人之间互动的检查结果将被用来为“智能会话代理”（ECA）编程行为剧目。这些是计算机生成的二维图形，外表像人，能够进行一系列的语言和非语言行为，这些行为是听众在互动中的特征。该团队将研究人类研究参与者与ECA的互动，在ECA中操纵被确定为与建立，维持和破坏融洽关系有关的行为方面，以观察对人类参与者的影响。这种比较研究的跨文化维度将使我们有可能确定哪些行为方面对于不同文化的人之间成功的跨文化互动和沟通至关重要。