A human-computer interaction neuro-cognitive state assessment tool based on eye-tracking and physiological measures

该研究的目的是开发一种通用工具，该工具使用眼动跟踪和生理测量来分析用户与计算机系统交互时的认知和情绪状态。该系统将根据注意力、兴趣、认知负荷来分析输入信号，这些信号与界面中的一系列区域和动作相关联。同时，它将评估从生理措施（压力，兴奋）的情绪反应。然后，所有这些都应该与任务结构相联系，在任务结构中指定区域和交互操作。 因此，来自交互的信息、眼动跟踪和生理测量将被解释，并且可以根据任务结构和界面元素的认知和情感反应来可视化。积累的数据及其分析将使人们能够评估接口和规定互动的质量，以及在此过程中出现的破坏性或首选因素。该系统将使研究可能影响互动的个人或背景因素的影响成为可能，如经验、疲劳、认知维度或偏好。

The objective of the research is to develop a generic tool that uses eyetracking and physiological measures to analyze the cognitive and emotional state of users as they interact with a computer system. The system will analyze the incoming signals in terms of attention, interest, cognitive load, linked to a series of zones and actions in the interface. In parallel it will assess the emotional reactions from the physiological measures (stress, excitement). All this should then be linked to a structure of tasks, where zones and interaction actions are specified. Thus the information from the interaction, the eye tracking and physiological measures, will be interpreted and could be visualized in terms of cognitive and emotional reactions following the structure of tasks and elements of the interfaces. The data accumulated and its analysis will make it possible to assess the quality of the interfaces and of the prescribed interaction, as well as elements, which appear disruptive or preferred along the way. The system will make it possible to study the impact of individual or contextual factors which may affect the interaction, like experience, fatigue, cognitive dimensions or preferences.