A Comparative Analysis of Modeling and Predicting Perceived and Induced Emotions in Sonification
A Comparative Analysis of Modeling and Predicting Perceived and Induced Emotions in Sonification
复制标题
DOI：
10.3390/electronics10202519
复制
发表时间：
2021-10
期刊：
影响因子：
2.9
通讯作者：
Faranak Abri;Luis Felipe Gutiérrez;Prerit Datta;David R. W. Sears;Akbar Siami Namin;Keith S. Jones
中科院分区：
文献类型：
--
作者：
Faranak Abri;Luis Felipe Gutiérrez;Prerit Datta;David R. W. Sears;Akbar Siami Namin;Keith S. Jones
发声是利用声音来传达有关数据或事件的信息。与声音相关的情绪有两种类型：(1)“感知”情绪，即听者识别声音所表达的情绪；(2)“诱导”情绪，即听者感受到由声音引起的情绪。尽管听者对某一特定声音的感知情绪可能有广泛的共识，但他们对某一特定声音的诱导情绪往往意见不一，因此很难对诱导情绪进行建模。本文描述了几种机器和深度学习模型的发展，这些模型预测与特定声音相关的感知和诱导情绪，并分析和比较了这些预测的准确性。结果表明，为预测感知情绪而建立的模型比为预测诱导情绪而建立的模型更准确。然而，通过优化机器和深度学习模型，可以大大缩小这些模型之间的预测能力差距。这项研究在物联网背景下的硬件设备自动配置及其与软件组件的集成方面有几个应用，对此安全至关重要。
Sonification is the utilization of sounds to convey information about data or events. There are two types of emotions associated with sounds: (1) “perceived” emotions, in which listeners recognize the emotions expressed by the sound, and (2) “induced” emotions, in which listeners feel emotions induced by the sound. Although listeners may widely agree on the perceived emotion for a given sound, they often do not agree about the induced emotion of a given sound, so it is difficult to model induced emotions. This paper describes the development of several machine and deep learning models that predict the perceived and induced emotions associated with certain sounds, and it analyzes and compares the accuracy of those predictions. The results revealed that models built for predicting perceived emotions are more accurate than ones built for predicting induced emotions. However, the gap in predictive power between such models can be narrowed substantially through the optimization of the machine and deep learning models. This research has several applications in automated configurations of hardware devices and their integration with software components in the context of the Internet of Things, for which security is of utmost importance.