GCR: Emotionally Responsive Computation and Communication

GCR：情感响应计算和通信

• 批准号: 1934968
• 负责人: Dan Rubenstein
• 金额: $ 80万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-10-01 至 2022-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1934968&HistoricalAwards=false
• 关键词: GCR; Emotionally; Responsive; Computation; Communication

The objective of this Growing Convergence Research project is to develop emotionally-responsive computing systems that can detect human emotions and automatically deploy resources or prioritize services to meet human needs in disaster or crises situations. This research is motivated by the need to more rapidly assess the massive data flows that occur during crisis events to better respond to the situations. Through the convergence of computer and computational sciences, neurotechnology, and psychological sciences, this project will develop technologies that can monitor humans' emotions and process the emotional states to strategically deploy resources to address human needs. Emotionally-responsive computing systems could be used by 911 call-centers to prioritize calls or by first-responders responding to a public threat.This exploratory research will a) develop and validate computational assessments of human behavior in controlled virtual reality simulation, b) develop an integrated physiological measurement package targeting electrodermal activity, heart rate, electroencephalography, and pupillometry, and c) assess whether systems that adapt to emotional states must be trained toward the individual or group types. Key research questions focus on understanding the timescale at which emotions can and should be sensed in reaction to situational changes and the diversity of human emotional responses and group dynamics.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这个日益融合研究项目的目标是开发情感响应计算系统，该系统可以检测人类的情感，并自动部署资源或优先考虑服务，以满足人类在灾难或危机情况下的需求。这项研究的动机是需要更快地评估危机事件期间发生的大量数据流，以更好地应对情况。通过计算机和计算科学、神经技术和心理科学的融合，该项目将开发能够监控人类情绪并处理情绪状态的技术，以战略性地部署资源来满足人类需求。情感响应计算系统可用于911呼叫中心，以确定呼叫的优先顺序，或用于应对公共威胁的第一响应者。这项探索性研究将a)开发并验证受控虚拟现实模拟中人类行为的计算评估，b)开发针对皮电活动、心率、脑电图和瞳孔测量的综合生理测量包，以及c)评估适应情绪状态的系统是否必须针对个人或群体类型进行训练。关键的研究问题集中在理解情绪可以和应该在对情境变化的反应中被感知的时间尺度，以及人类情绪反应和群体动态的多样性。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

项目成果

Multimodal Neurophysiological Transformer for Emotion Recognition

• DOI: 10.1109/embc48229.2022.9871421
• 发表时间: 2022-07
• 期刊: 2022 44th Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC)
• 作者: Sharath C. Koorathota;Zain Khan;Pawan Lapborisuth;P. Sajda