Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures: Augmenting Consequential Sounds to Improve Non-verbal Robot Communication
Perceptual Evaluation of Blended Sonification of Mechanical Robot Sounds Produced by Emotionally Expressive Gestures: Augmenting Consequential Sounds to Improve Non-verbal Robot Communication
复制标题
对情感表达手势产生的机械机器人声音的混合可听化的感知评估：增强相应的声音以改善非语言机器人交流
DOI：
--
复制
发表时间：
2021
影响因子：
4.7
通讯作者：
R. Bresin
中科院分区：
文献类型：
--
作者：
Emma Frid;R. Bresin
本文介绍了两个实验，重点是对机器人运动产生的机械声音的感知和混合声音。在第一个实验中，31名参与者通过自由格式的文本描述来评估机器人声音所传达的情感。这些声音是由NAO机器人的运动产生的，并不是专门为交流目的而设计的。结果表明，手势的情感表达与听者如何感知这些动作所固有的声音之间没有很强的耦合；快乐的手势不一定会带来快乐的声音。无论表达手势的性质如何，在所有声音的文本描述中都反复出现的一个词是“重音”。在第二个实验中，我们使用混合声来增强和进一步阐明第一个实验中评估的机器人声音的情感表达。对30名参与者的定量评分分析显示，混合声效成功地增强了旨在传达沮丧和喜悦的声音模型的情感信息。我们的研究结果表明，在语音和音乐情感感知研究的指导下，混合超声可以成功地通过听觉条件下的机器人声音改善情感交流。
This paper presents two experiments focusing on perception of mechanical sounds produced by expressive robot movement and blended sonifications thereof. In the first experiment, 31 participants evaluated emotions conveyed by robot sounds through free-form text descriptions. The sounds were inherently produced by the movements of a NAO robot and were not specifically designed for communicative purposes. Results suggested no strong coupling between the emotional expression of gestures and how sounds inherent to these movements were perceived by listeners; joyful gestures did not necessarily result in joyful sounds. A word that reoccurred in text descriptions of all sounds, regardless of the nature of the expressive gesture, was “stress”. In the second experiment, blended sonification was used to enhance and further clarify the emotional expression of the robot sounds evaluated in the first experiment. Analysis of quantitative ratings of 30 participants revealed that the blended sonification successfully contributed to enhancement of the emotional message for sound models designed to convey frustration and joy. Our findings suggest that blended sonification guided by perceptual research on emotion in speech and music can successfully improve communication of emotions through robot sounds in auditory-only conditions.
机器人手势语音化，增强机器人状态感知和互动乐趣
DOI：
10.1109/ro-man47096.2020.9223452
发表时间：
2020
期刊：
29th IEEE International Conference on Robot & Human Interactive Communication
影响因子：
--
作者：
Zahray, L: Savery
通讯作者：
Zahray, L: Savery