Detecting Inner Emotions from Video Based Heart Rate Sensing
Detecting Inner Emotions from Video Based Heart Rate Sensing
复制标题
DOI：
10.1007/978-3-319-63315-2_5
复制
发表时间：
2017-08
期刊：
影响因子：
--
通讯作者：
Keya Das;Sarwar Ali;K. Otsu;Hisato Fukuda;Antony Lam;Yoshinori Kobayashi;Y. Kuno
中科院分区：
文献类型：
--
作者：
Keya Das;Sarwar Ali;K. Otsu;Hisato Fukuda;Antony Lam;Yoshinori Kobayashi;Y. Kuno
利用计算机视觉识别人类情感是一个有趣而富有挑战性的问题。尤其是对内心情感的解读，受到的关注有限。在这篇文章中，我们使用一种基于远程视频的心率传感技术来获得生理数据，这些数据提供了一个人的内心情感的指示。这种方法允许在受试者观看刺激情绪的视频片段时对心率数据进行非接触式估计。我们还与可穿戴的心率传感器进行了比较，以验证所提出的远程心率读取框架的有效性。我们发现，对受试者心率的读数有效地检测出受试者在观看滑稽和恐怖视频时的内心情绪反应--尽管有时几乎没有面部表情。与传统的可穿戴传感器相比，我们基于视觉的方法读取了40名受试者的心率，验证了这些发现。我们还发现，随着情感刺激内容的变化，心率的变化具有统计学意义，我们的遥控器与可穿戴式接触式传感器具有很好的相关性。
Recognizing human emotion by computer vision is an interesting and challenging problem. In particular, the reading of inner emotions, has received limited attention. In this paper, we use a remote video-based heart rate sensing technique to obtain physiological data that provides an indication of a person’s inner emotions. This method allows for contactless estimates of heart rate data while the subject is watching emotionally stimulating video clips. We also compare against a wearable heart rate sensor to validate the usefulness of the proposed remote heart rate reading framework. We found that the reading of heart rates of a subject effectively detects the inner emotional reactions of human subjects while they were watching funny and horror videos—despite little to no facial expressions at times. These findings are validated from the reading of heart rates for 40 subjects with our vision-based method compared against conventional wearable sensors. We also find that the change in heart rate along with emotionally stimulating content is statistically significant and our remote sensor is well correlated with the wearable contact sensor.