Facial Expression Recognition of a Speaker Using Front-view Face Judgment, Vowel Judgment and Thermal Image Processing
Facial Expression Recognition of a Speaker Using Front-view Face Judgment, Vowel Judgment and Thermal Image Processing
复制标题
基于前视人脸判断、元音判断和热图像处理的说话人面部表情识别
DOI：
10.1007/s10015-011-0967-z
复制
发表时间：
2011
期刊：
影响因子：
--
通讯作者：
M.Tabuse
中科院分区：
文献类型：
--
作者：
T.Fujimura;Y.Yoshitomi;T.Asada;M.Tabuse
对于面部表情识别，我们选择了三幅图像：(I)在说话之前，(Ii)说出第一个元音，(Iii)说出一个发声中的最后一个元音。在这项研究中，我们增加了一个判断函数，作为人脸表情识别的一个预处理模块，用于区分正视人脸。通过估计面部方向来选择动态图像中的前视图面的帧。该判断函数利用热像处理来测量四个特征参数，并根据训练的正视人脸热像选择在有限范围内具有所有特征参数值的热像。作为初步调查，我们采用了日语名称“太郎”的发音，它在语义上是中性的。6名被试自由变换人脸方向时，正面脸的平均判断正确率为99.5%。使用提出的方法，当六个受试者的面部表情表现出故意的“愤怒”、“高兴”、“中性”、“悲伤”和“惊讶”之一时，他们的面部表情识别准确率为84.0%。我们期望该方法能够适用于日常对话中的面部表情识别。
For facial expression recognition, we selected three images: (i) just before speaking, (ii) speaking the first vowel, and (iii) speaking the last vowel in an utterance. In this study, as a pre-processing module, we added a judgment function to distinguish a front-view face for facial expression recognition. A frame of the front-view face in a dynamic image is selected by estimating the face direction. The judgment function measures four feature parameters using thermal image processing, and selects the thermal images that have all the values of the feature parameters within limited ranges which were decided on the basis of training thermal images of front-view faces. As an initial investigation, we adopted the utterance of the Japanese name “Taro,” which is semantically neutral. The mean judgment accuracy of the front-view face was 99.5% for six subjects who changed their face direction freely. Using the proposed method, the facial expressions of six subjects were distinguishable with 84.0% accuracy when they exhibited one of the intentional facial expressions of “angry,” “happy,” “neutral,” “sad,” and “surprised.” We expect the proposed method to be applicable for recognizing facial expressions in daily conversation.