An Initial Analysis of Structured Video Interviews by Using Multimodal Emotion Detection
An Initial Analysis of Structured Video Interviews by Using Multimodal Emotion Detection
复制标题
使用多模态情感检测对结构化视频采访进行初步分析
DOI：
10.1145/2668056.2668057
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
Min Ma
中科院分区：
文献类型：
--
作者：
L. Chen;Su;C. W. Leong;Michelle P. Martín‐Raugh;Min Ma
最近，在线视频面试越来越多地用于就业过程。虽然已经出现了几种自动技术来分析采访视频，但到目前为止，只尝试了简单的情感分析，例如计算受访者脸上的微笑数量。在本文中，我们报告了我们的初步研究，采用先进的多模态情感检测方法的目的是测量性能的面试任务，elelelvent情绪。在我们创建的表演采访语料库中，我们使用基于语音的情感识别（SER）系统以及现成的面部表情分析工具包（FACET）进行了评估。虽然获得的结果表明，使用FACET的情感检测的承诺，采用SER的好处是有限的。
Recently online video interviews have been increasingly used in the employment process. Though several automatic techniques have emerged to analyze the interview videos, so far, only simple emotion analyses have been attempted, e.g. counting the number of smiles on the face of an interviewee. In this paper, we report our initial study of employing advanced multimodal emotion detection approaches for the purpose of measuring performance on an interview task that elicits emotion. On an acted interview corpus we created, we performed our evaluations using a Speech-based Emotion Recognition (SER) system, as well as an off-the-shelf facial expression analysis toolkit (FACET). While the results obtained suggest the promise of using FACET for emotion detection, the benefits of employing the SER are somewhat limited.