Here's looking at you! Describing Spatio-Temporal Human Events

祝你健康!描述时空事件 当一个人看着另一个人时，他会专注于什么？答案是脸和身体。我的研究解决了视频中观察到的这两种活动，并基于对人类(I)行为和(Ii)情绪的自动解释，如他们的面部表情所示。这个过程被称为自动化的“视觉监控”。它专注于创建实时系统来监控自发的(不是摆出姿势或行动的)人类活动。这项研究的长期目标是能够同时解释(I)和(II)。 目前，在视觉监控的研究文献中，既没有强调实时，也没有强调自发。此外，文献表明，在动作或姿势数据库上训练的方法在应用于不受约束的视频时，性能下降了约50%。这项研究的实际目的是基于这样一个事实，即目前我们生活空间中有成千上万的室内和室外摄像机，但无法自动分析获得的无约束数据。挑战在于显著改进可用于自动视觉监视的分析和算法工具。

Here's looking at you! Describing Spatio-Temporal Events What does a person concentrate on when looking at another person? The answer is the face and the body. My research addresses both of these activities as observed in videos and based on automating the interpretation of human (i) behavior and (ii) emotions as indicated by their facial expressions. This process is referred to as automated "visual surveillance". It is concentrated on creating real-time systems for monitoring spontaneous (not posed or acted) human activities. The long-term goal of this research is to be able to simultaneously interpret both (i) and (ii). Neither real-time nor spontaneity are presently being emphasized in the research literature on visual surveillance. Furthermore, the literature shows that the performance of methods trained on acted or posed databases deteriorates by about 50% when applied to unconstrained videos. The practical objective of this research is based on the fact that currently there are thousands and thousands of indoor and outdoor video cameras in our living spaces, but no way to automatically analyze the obtained unconstrained data. The challenge is to significantly improve the available analytical and algorithmic tools for automated visual surveillance.