权益分类	功能权益	普通用户	{{item.name}}会员
{{category.name}}	{{benefitItem.name}}

Multimodal Signaling and Communication Analysis of World Leaders

世界领导人的多模态信号和通信分析

基本信息

批准号：
2117009
负责人：
Leah Windsor
金额：
$ 45万
依托单位：
University of Memphis
依托单位国家：
美国
项目类别：
Standard Grant
财政年份：
2021
资助国家：
美国
起止时间：
2021-09-01 至 2024-08-31
项目状态：
已结题

来源：
https://www.nsf.gov/awardsearch/showAward?AWD_ID=2117009&HistoricalAwards=false
关键词：
Multimodal Signaling Communication Analysis World

项目摘要

This project examines multimodal communication among world leaders from a multicultural, interdisciplinary perspective using the Embodied Cognition (EC) framework. This framework demonstrates how multimodal processes, such as discourse, the acoustic production of speech, and nonverbal signals such as gestures and facial expressions, are integrated into human communication. The EC approach will be especially beneficial for understanding politics in opaque environments, like authoritarian regimes, where it is difficult to observe true preferences and priorities of leaders. The PIs' proposed research represents a novel combination of computational linguistic analysis, multimodal signals derived from audio and video analysis, and biometric audience data. To date, multimodal analyses have not been deployed comprehensively on a representative international corpus and extant research relies primarily on corpora from the English-speaking world. Given seismic changes in the international system, this analysis provides a way for scholars to better understand problems like state stability, conflict processes, and regime transition. A multimodal approach to analyzing the international system will help us know more than what leaders’ words alone convey. This project facilitates the understanding of the importance of multimodal signals by providing a data set, pedagogical materials, and academic publications to translate the meaning of multimodal inputs through the Security and Preparedness program. Differences in culture and language may lead to misunderstandings that can escalate to security crises. By evaluating different communication channels, the PIs propose a clearer picture of countries’ motivations and deeper insight into their preferences and beliefs. Using biophysical indicators alongside language, this project substantially improves the scientific community’s understanding of how multimodal channels work in concert with language to convey meaning, especially in international and multicultural contexts. To accomplish this work the collaborators in this project prioritize hiring and training women and minorities in social and computational social sciences, and STEM fields.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该项目使用具身认知(EC)框架，从跨文化、跨学科的角度考察世界领导人之间的多模式交流。这一框架展示了多通道过程，如话语，语音的声音产生，以及非语言信号，如手势和面部表情，如何整合到人类交流中。EC方法对于理解不透明环境中的政治尤其有益，比如威权政权，在这些环境中，很难观察到领导人的真正偏好和优先事项。PIS提出的研究代表了计算语言分析、从音频和视频分析得出的多模式信号以及生物统计观众数据的新组合。到目前为止，多模式分析还没有在具有代表性的国际语料库上进行全面的部署，现有的研究主要依赖于来自英语世界的语料库。鉴于国际体系发生了翻天覆地的变化，这种分析为学者们提供了一种更好地理解国家稳定、冲突进程和政权过渡等问题的方法。以多模式的方法分析国际体系将帮助我们了解更多，而不仅仅是领导人的话所传达的信息。该项目通过提供数据集、教学材料和学术出版物来帮助理解多模式信号的重要性，以便通过安全和准备计划翻译多模式输入的含义。文化和语言的差异可能会导致误解，进而升级为安全危机。通过评估不同的沟通渠道，PI可以更清楚地了解各国的动机，并更深入地了解它们的偏好和信仰。该项目在使用语言的同时使用生物物理指标，大大提高了科学界对多模式渠道如何与语言协同工作以传达含义的理解，特别是在国际和多文化背景下。为了完成这项工作，该项目的合作者优先雇用和培训社会科学和计算社会科学以及STEM领域的妇女和少数民族。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。