Acoustic and Lexical Representations for Affect Prediction in Spontaneous Conversations.
Acoustic and Lexical Representations for Affect Prediction in Spontaneous Conversations.
复制标题
DOI：
10.1016/j.csl.2014.04.002
复制
发表时间：
2015-01-01
影响因子：
4.3
通讯作者：
Nenkova, Ani
中科院分区：
文献类型：
--
作者：
Cao, Houwei;Savran, Arman;Verma, Ragini;Nenkova, Ani
In this article we investigate what representations of acoustics and word usage are most suitable for predicting dimensions of affect|AROUSAL, VALANCE, POWER and EXPECTANCY|in spontaneous interactions. Our experiments are based on the AVEC 2012 challenge dataset. For lexical representations, we compare corpus-independent features based on psychological word norms of emotional dimensions, as well as corpus-dependent representations. We find that corpus-dependent bag of words approach with mutual information between word and emotion dimensions is by far the best representation. For the analysis of acoustics, we zero in on the question of granularity. We confirm on our corpus that utterance-level features are more predictive than word-level features. Further, we study more detailed representations in which the utterance is divided into regions of interest (ROI), each with separate representation. We introduce two ROI representations, which significantly outperform less informed approaches. In addition we show that acoustic models of emotion can be improved considerably by taking into account annotator agreement and training the model on smaller but reliable dataset. Finally we discuss the potential for improving prediction by combining the lexical and acoustic modalities. Simple fusion methods do not lead to consistent improvements over lexical classifiers alone but improve over acoustic models.
登录
查看更多内容
影响因子：
11.2
作者：
McKeown, Gary;Valstar, Michel;Schroeder, Marc
通讯作者：
Schroeder, Marc
DOI：
10.1093/jee/39.2.269
发表时间：
1945-01-01
期刊：
BIOMETRICS BULLETIN
影响因子：
--
作者：
WILCOXON, F
通讯作者：
WILCOXON, F
影响因子：
3.2
作者：
Polzehl, Tim;Schmitt, Alexander;Wagner, Michael
通讯作者：
Wagner, Michael
影响因子：
8.2
作者：
Fontaine, Johnny R. J.;Scherer, Klaus R.;Ellsworth, Phoebe C.
通讯作者：
Ellsworth, Phoebe C.
影响因子：
5
作者：
Turney, Peter D.;Pantel, Patrick
通讯作者：
Pantel, Patrick