Here's looking at you! Describing Spatio-Temporal Human Events

这就是你！描述时空事件当一个人看着另一个人时，他的注意力集中在什么地方？答案是脸和身体。我的研究解决了视频中观察到的这两种活动，并基于对人类(i)行为和（ii）面部表情所表明的情绪的自动化解释。这个过程被称为自动化“视觉监视”。它的重点是创建实时系统来监测自发的（不是假装的或行动的）人类活动。本研究的长期目标是能够同时解释(i)和（ii）。目前在视觉监控的研究文献中，既不强调实时性，也不强调自发性。此外，文献表明，当应用于无约束视频时，在动作或姿势数据库上训练的方法的性能下降了约50%。本研究的实际目的是基于这样一个事实，即目前在我们的生活空间中有成千上万的室内和室外摄像机，但没有办法自动分析所获得的无约束数据。面临的挑战是显著改进现有的用于自动视觉监视的分析和算法工具。

Here's looking at you! Describing Spatio-Temporal EventsWhat does a person concentrate on when looking at another person? The answer is the face and the body. My research addresses both of these activities as observed in videos and based on automating the interpretation of human (i) behavior and (ii) emotions as indicated by their facial expressions. This process is referred to as automated "visual surveillance". It is concentrated on creating real-time systems for monitoring spontaneous (not posed or acted) human activities. The long-term goal of this research is to be able to simultaneously interpret both (i) and (ii).Neither real-time nor spontaneity are presently being emphasized in the research literature on visual surveillance. Furthermore, the literature shows that the performance of methods trained on acted or posed databases deteriorates by about 50% when applied to unconstrained videos. The practical objective of this research is based on the fact that currently there are thousands and thousands of indoor and outdoor video cameras in our living spaces, but no way to automatically analyze the obtained unconstrained data. The challenge is to significantly improve the available analytical and algorithmic tools for automated visual surveillance.