MRI: Development of an Interactive Immersive Environment that Senses and Responds to Humans

该项目旨在创建一个原型沉浸式人在回路系统，用于感知和响应人类的情绪和行为。它旨在开发一个原型系统，利用基于人体的测量，如心脏，皮肤温度和皮肤电反应，旨在了解一个人的感觉和行为。沉浸式环境用于各种环境，包括肢体缺失的物理治疗，儿童讲故事以及建筑专业人员的交互式建筑显示设计。情感计算研究人员利用沉浸式世界和生理数据来解释、理解和响应与医疗决策、儿童编程教学和敌意谈判培训相关的人类情感。这一努力利用了混合/虚拟现实耳机、交互式计算显示器和音频系统，其具体目标是在使用沉浸式环境时增加对手势、文字、面部表情和设计思维中涉及的其他行为的理解，提高本科生和研究生对使用沉浸式人在-该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project seeks to create a prototype immersive human-in-the loop system for sensing and responding to human emotions and behaviors. It aims to develop a prototype system that utilizes human-body based measures like heart, skin temperature, and galvanic skin response aiming to understand how a person is feeling and behaving. Immersive environments are used in various settings including physical therapy for missing limbs, storytelling for children, and design of interactive building displays for architecture professionals. Affective computing researchers have utilized immersive worlds and physiological data to interpret, understand and respond to human emotion related to healthcare decision-making, teaching programming to kids, and hostile negotiation training. This effort utilizes mixed/virtual reality headsets, interactive computing displays, and audio systems with the specific aims of increasing understanding about gestures, words, facial expressions, and other behaviors involved in design-thinking when using an immersive environment, and improving undergraduate and graduate knowledge on use of an immersive human-in-the-loop system.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.