MRI: Development of a Highly Integrated Instrumentation Setup for Affective Sensing Research

该项目开发了一个高度集成和模块化的情感感知研究系统，旨在设计，开发，验证和传播一种仪器设置，可用于感知，记录和识别与人机交互（HCI）相关的情感变化信号的生理变化。为了开发具有响应用户自主神经系统状态（包括用户情绪和影响，以及与锻炼和健康相关的状态）的能力的HCI，将集成大量的生物信号传感器。情感计算意味着计算机系统应该能够评估对象的情感状态，即，基于对用户情感状态的生理表达的实时监测来执行情感感测。在该监测过程中的非侵入性/非侵入性测量最终产生HCI的增强。在高度整合的感觉平台中，与情感转变相关的交感神经激活的生理表现可能会揭示出不明显但相关的特征，当孤立地观察信号时，这些特征可能会被忽视。这项工作涉及五组实验：-DSP的情感传感，-实时测量的眼睛注视跟踪，-运动和血容量之间的关系的分析，-脑电图作为一种方式来评估HCI的质量，和-自主神经系统监测作为一种方式来评估HCI。更广泛的影响：这种情感传感系统可以被用来作为一个评估平台，对下一代的人机界面，将改善残疾人的访问和功能能力的设计。该工具的开发将影响未来专业人员和研究人员的培训和激励。这项工作有助于制定新的举措，让学生进入一个为大量少数民族学生服务的机构;从而加强学生攻读研究生学位的渠道。

This project, developing a highly integrated and modular system for affective sensing research, aims at designing, developing, verifying, and disseminating an instrumentation setup that can be used to sense, record, and identify physiological changes that signal affective shifts relevant to human-computer interaction (HCI). A large number of biological signal sensors will be integrated for the purpose of developing HCI with the ability to respond to the state of the user's autonomic nervous system (including user emotion and affect, and states related to exercise and health). Affective computing implies that a computer system should be able to assess the emotional state of the subject, i.e., perform affective sensing based on real-time monitoring of the physiological expression of the user's affective state. Non-invasive/unobtrusive measurements in this monitoring process ultimately yield enhancements in HCI. Physiological manifestations of sympathetic activation associated with affective shifts in a highly integrated sensory platform may reveal inconspicuous but relevant features that could be overlooked when the signals are observed in isolation. The work involves five sets of experiments:-DSP for affective sensing,-Real-time measurement of eye gaze tracking,-Analysis of the relationship between exercise and blood volume, -EEG as a way to assess the quality of HCI, and-Autonomic nervous system monitoring as a way to assess HCI.Broader Impact: This affective sensing system can be used as an evaluation platform toward the design of the next generation of human computer interfaces that would improve access and functional capabilities of persons with disabilities. The development of the instrument will impact the training and motivation of future professionals and researchers. This work contributes in the creation of new initiatives to engage students in an institution serving a large number of minority students; thus strengthening the student pipeline towards graduate degrees.