A Large-Scale User Study of an Alexa Prize Chatbot: Effect of TTS Dynamism on Perceived Quality of Social Dialog
A Large-Scale User Study of an Alexa Prize Chatbot: Effect of TTS Dynamism on Perceived Quality of Social Dialog
复制标题
Alexa 奖聊天机器人的大规模用户研究：TTS 动态对社交对话感知质量的影响
DOI：
10.18653/v1/w19-5935
复制
发表时间：
2019
影响因子：
8.2
通讯作者：
Zhou Yu
中科院分区：
文献类型：
--
作者：
Michelle Cohn;Chun;Zhou Yu
这项研究测试了Alexa文本到语音（TTS）语音中的认知情感表达对社交对话系统用户体验的影响。我们系统地引入了表达情感的感叹词（例如，“哇！”）以及填充词（例如，“um”，“mhmm”）在亚马逊Alexa Prize社交机器人Gunrock中。我们在数千次真实的用户交互（n= 5，527）中测试了这些TTS操作是否提高了用户对其对话的评分。结果表明，感叹词和填充词都提高了用户的整体评分，如果系统同时使用这两种操作，这种提高会进一步提高。一个单独的感知实验证实了用户研究的结果，提高了社会评价的对话，包括感叹词，但是，没有观察到积极的影响，填充，这表明在对话中的作用，积极参与者或外部的评价者是一个重要因素，在评估社会对话。
This study tests the effect of cognitive-emotional expression in an Alexa text-to-speech (TTS) voice on users’ experience with a social dialog system. We systematically introduced emotionally expressive interjections (e.g., “Wow!”) and filler words (e.g., “um”, “mhmm”) in an Amazon Alexa Prize socialbot, Gunrock. We tested whether these TTS manipulations improved users’ ratings of their conversation across thousands of real user interactions (n=5,527). Results showed that interjections and fillers each improved users’ holistic ratings, an improvement that further increased if the system used both manipulations. A separate perception experiment corroborated the findings from the user study, with improved social ratings for conversations including interjections; however, no positive effect was observed for fillers, suggesting that the role of the rater in the conversation—as active participant or external listener—is an important factor in assessing social dialogs.
语音拟人化、对话者建模和对齐对人机对话句法选择的影响
影响因子：
5.4
作者：
Cowan B
通讯作者：
Cowan B