I-Corps: Real-Time Facial Tracking for Safety, Security and Medical applications

面部表情在我们的日常交流中扮演着重要的角色。然而，目前几乎没有准确、健壮和便携的表达检测和分析系统。该项目团队开发了一种实时跟踪和分析视频中人类面部特征的系统。该系统由软件和单个摄像头组成，可以在不同的光照条件下自动分析面部表情、检测眨眼并跟踪人类目标的头部方向。有了面部表情分析，自最早的机器发明以来，机器检测人类情感的障碍终于可以消除。这种可能性使研究团队不仅可以探索社会创新，例如基于表达的媒体评级或社会互动的情感，还可以通过非语言的间接交流探索人与机器的联系。通过自动化系统识别人类面部表情具有广泛的应用，例如：情绪反应测量、面部控制人机界面的开发以及通过向公众发布单独配置的输入映射的面部控制软件界面而带来的大量机会。面部表情分析的一些可能性可以包括基于用户认可的增强的搜索结果、由“困惑的”表情触发的自动词语定义以及在审阅文本或视频内容之后的一般和/或特定情绪。通过我们软件的疲劳检测功能，通过开发能够检测飞行员、司机和车辆操作员的警觉并将其与设备配对以提醒他们疲劳状态的系统，可以使运输行业变得更加安全。

Facial expressions play a significant role in our daily communication. However, few accurate, robust and portable expression detection and analysis systems currently exist. The project team has developed a system for real-time tracking and analyzing of the facial features of humans in video. The system, composed of software and a single camera can automatically analyze facial expressions, detect eye blinks and track the head orientation of a human target under varying conditions of illumination. With facial expression analysis, the barrier of machine detection of human emotion, which has existed since the invention of the earliest machines, could finally be lifted. This possibility allows the research team to explore not only the social innovations, such as expression based rating of media or sentiment of a social interaction, but the connection of human and machine through non-verbal, indirect communication. The recognition of human facial expressions through an automated system has extensive applications, such as; emotional reaction measurement, development of a facially controlled human-computer interface and a multitude of opportunities by releasing an individually configured input mapped facially controlled software interface to the public. Some of the possibilities of facial expression analysis could include enhanced search results based on the users approval, automatic word definition triggered by a "confused" expression and general and/or specific sentiment after the review of textual or video content. Through the fatigue detection capabilities of our software, the transportation industry can be made safer by the development of systems that can detect the alertness of pilots, drivers and vehicle operators at large and pair them with devices to alert them to their fatigued state.