Depth Videos for the Classification of Micro-Expressions
Depth Videos for the Classification of Micro-Expressions
复制标题
DOI：
10.1109/icpr48806.2021.9412976
复制
发表时间：
2021-01
期刊：
影响因子：
--
通讯作者：
A. Kumar;B. Bhanu;Christopher Casey;S. Cheung;A. Seitz
中科院分区：
文献类型：
--
作者：
A. Kumar;B. Bhanu;Christopher Casey;S. Cheung;A. Seitz
面部微表情是面部短暂发生的自发、微妙、不自主的肌肉运动。由于行为微妙，这些表情的发现和识别很困难，而且这些表情的持续时间约为半秒，这使得人类很难识别它们。这些微表情在我们的日常生活中有很多应用，例如在线学习、玩游戏、测谎和治疗课程等领域。传统上，研究人员使用 RGB 图像/视频来发现和分类这些微表情，这带来了具有挑战性的问题，例如照明、隐私问题和姿势变化。深度视频的使用在一定程度上解决了这些问题，因为深度视频不易受到光照变化的影响。本文描述了第一个 RGB-D 数据集的收集，用于将面部微表情分类为 6 种通用表情：愤怒、快乐、悲伤、恐惧、厌恶和惊讶。本文展示了 RGB 和 Depth 视频在面部微表情分类方面的比较。此外，结果比较表明，仅使用深度视频就可以通过使用传统和深度学习方法在决策树结构中正确分类面部微表情，并且具有良好的分类精度。该数据集将于近期向公众发布。
Facial micro-expressions are spontaneous, subtle, involuntary muscle movements occurring briefly on the face. The spotting and recognition of these expressions are difficult due to the subtle behavior, and the time duration of these expressions is about half a second, which makes it difficult for humans to identify them. These micro-expressions have many applications in our daily life, such as in the field of online learning, game playing, lie detection, and therapy sessions. Traditionally, researchers use RGB images/videos to spot and classify these micro-expressions, which pose challenging problems, such as illumination, privacy concerns and pose variation. The use of depth videos solves these issues to some extent, as the depth videos are not susceptible to the variation in illumination. This paper describes the collection of a first RGB-D dataset for the classification of facial micro-expressions into 6 universal expressions: Anger, Happy, Sad, Fear, Disgust, and Surprise. This paper shows the comparison between the RGB and Depth videos for the classification of facial micro-expressions. Further, a comparison of results shows that depth videos alone can be used to classify facial micro-expressions correctly in a decision tree structure by using the traditional and deep learning approaches with good classification accuracy. The dataset will be released to the public in the near future.