A human-computer interaction neuro-cognitive state assessment tool based on eye-tracking and physiological measures

这项研究的目的是开发一种通用工具，使用眼动和生理测量来分析用户与计算机系统交互时的认知和情感状态。该系统将从注意力、兴趣、认知负荷等方面分析传入的信号，并将其与界面中的一系列区域和动作联系起来。同时，它将评估生理指标(压力、兴奋)的情绪反应。然后，所有这些都应该链接到任务结构，其中指定了区域和交互操作。因此，来自交互、眼球跟踪和生理测量的信息将被解释，并可以根据任务的结构和界面的元素以认知和情感反应的形式可视化。积累的数据及其分析将有可能评估接口和规定互动的质量，以及在此过程中似乎具有破坏性或可取性的要素。该系统将使研究个人或背景因素的影响成为可能，这些因素可能会影响互动，如经验、疲劳、认知维度或偏好。

The objective of the research is to develop a generic tool that uses eyetracking and physiological measures to analyze the cognitive and emotional state of users as they interact with a computer system. The system will analyze the incoming signals in terms of attention, interest, cognitive load, linked to a series of zones and actions in the interface. In parallel it will assess the emotional reactions from the physiological measures (stress, excitement). All this should then be linked to a structure of tasks, where zones and interaction actions are specified. Thus the information from the interaction, the eye tracking and physiological measures, will be interpreted and could be visualized in terms of cognitive and emotional reactions following the structure of tasks and elements of the interfaces. The data accumulated and its analysis will make it possible to assess the quality of the interfaces and of the prescribed interaction, as well as elements, which appear disruptive or preferred along the way. The system will make it possible to study the impact of individual or contextual factors which may affect the interaction, like experience, fatigue, cognitive dimensions or preferences.