Eyegaze and facial expression analysis - an experimental tool for research on human-centered and affective systems

眼神和面部表情分析——研究以人为中心的情感系统的实验工具

• 批准号: 345988-2007
• 负责人: Zhang, Wenjun(Chris)
• 金额: $ 3.69万
• 依托单位: University of Saskatchewan
• 依托单位国家: 加拿大
• 项目类别: Research Tools and Instruments - Category 1 (<$150,000)
• 财政年份: 2006
• 资助国家: 加拿大
• 起止时间: 2006-01-01 至 2007-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=326277
• 关键词: Eyegaze; facial; expression; analysis; experimental

The equipment requested consists of a set of hardware and software which will allow for measurement and tracking of the eyegaze and facial expressions in real time and in a non-invasive manner. Further, the measurement and tracking are completed in a dynamic situation (e.g., moving vehicles and robots). The eye gaze and facial expressions help infer the human mental state (attention, workload, emotion) which will further affect our cognitive behavior. Therefore, this equipment can be used to support research in a multidisciplinary context, covering engineering, computer science, medicine, and education.     This equipment essentially provides an experimental base for theoretical study on quantification of the human mental state and its relationship with the human cognitive decision making ability and performance. In short term, this equipment will support several important research projects. One project is towards the understanding of the decision maker's emotion during a decision-making process, particularly in the case of disaster response management, as emotion considerably affects the human's decision making ability. The second project is to advance our understanding of driver's attention distraction, mental workload, emotion, and their relationship with the performance of the driver-vehicle system, which is related to traffic regulations and is significant to public safety. The third project is to understand the mental state of the human worker who assembles parts and works together with mobile robots, which can provide a scientific basis for determining task allocation between the human worker and the robot toward a more safe and error-free operation and workplace. The other projects are related to collaborative work, physical therapy, and visual perception of objects.     These studies have great significance to Canada in developing human-friendly, reliable and safe products. The long term significance also lies in the value created which is related to the safety and health of humans during their daily activities (e.g., driving).

所要求的设备包括一套硬件和软件，可用于以非侵入性方式真实的时间测量和跟踪注视和面部表情。此外，测量和跟踪是在动态情况下完成的（例如，移动车辆和机器人）。眼睛注视和面部表情有助于推断人类的精神状态（注意力，工作量，情绪），这将进一步影响我们的认知行为。因此，该设备可用于支持多学科背景下的研究，涵盖工程，计算机科学，医学和教育。 该装置为定量研究人的心理状态及其与人的认知决策能力和绩效的关系提供了实验基础。在短期内，该设备将支持几个重要的研究项目。一个项目是对决策过程中的决策者的情绪的理解，特别是在灾害响应管理的情况下，情绪相当大地影响人的决策能力。第二个项目是提高我们对驾驶员注意力分散、心理负荷、情绪及其与驾驶员-车辆系统性能之间关系的认识，这与交通规则有关，对公共安全具有重要意义。第三个项目是了解装配零件并与移动的机器人一起工作的人类工人的心理状态，这可以为确定人类工人和机器人之间的任务分配提供科学依据，以实现更安全和无差错的操作和工作场所。其他项目涉及协作工作，物理治疗和物体的视觉感知。 这些研究对加拿大开发人类友好、可靠和安全的产品具有重要意义。长期意义还在于所创造的价值，这些价值与人类在日常活动中的安全和健康有关（例如，驾驶）。