Rebo Junior: Analysis of Dialogue Structure Quality for a Reflection Guidance Chatbot
Rebo Junior: Analysis of Dialogue Structure Quality for a Reflection Guidance Chatbot
复制标题
DOI：
--
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
Irmtraud Wolfbauer;Viktoria Pammer-Schindler;C. Rosé
中科院分区：
文献类型：
--
作者：
Irmtraud Wolfbauer;Viktoria Pammer-Schindler;C. Rosé
． 会话式用户界面为反思指导开辟了新的机会。本文提出了一种以电脑为媒介的学习任务反思对话结构，Rebo Junior及其在学徒培训背景下的评价。我们回答三个研究问题。首先，学徒对小热波的反应；第二，小热波的对话结构是否容易引导徒弟进行反思性对话；第三，随着时间的推移，Rebo Junior的用户粘性是如何发展的。在三个月的时间里，17名学徒在培训工作坊中与Rebo Junior进行了153次反思对话，其中117次在研究的第一阶段，36次在研究的第二阶段（每个学徒5到13次互动）。为了一致性、反射率水平和用户参与度，我们手动编码交互。我们的研究结果表明，学徒对干预反应良好，对话结构在引导学徒通过不同层次的反思方面是成功的（153名学徒中有114名对学习经验表现出可观察的反思；153名学徒中有133名表达了对未来任务的学习或计划行为改变）。此外，学徒和小热博之间的互动导致了连贯的对话（153个中有149个是连贯的）。与预期相反，在这两个阶段，用户粘性并没有随着时间的推移而下降。因此，在本文中，我们发布了一个对话结构，用于反思学习任务，尽管会话界面没有适应性，但该结构运行得非常好。总的来说，我们认为我们的研究结果强调了对话代理中对话结构质量的重要性。
. Conversational user interfaces open up new opportunities for reflection guidance. This paper presents a computer-mediated dialogue structure for reflecting on learning tasks, Rebo Junior, and its evaluation in the context of ap-prenticeship training. We answer three research questions. Firstly, how appren-tices react to Rebo Junior; secondly, whether Rebo Junior’s dialogue structure is apt to lead apprentices in reflective conversations; and thirdly, how user engagement with Rebo Junior develops over time. During three months, 17 apprentices led 153 reflective conversations with Rebo Junior in the context of a training workshop, 117 in phase one and 36 in phase two of the study (five to thirteen interactions per apprentice). We coded interactions manually for coherence, level of reflectivity, and user engagement. Our results show that apprentices react well to the intervention and that the dialogue structure is successful in leading appren-tices through different levels of reflection (114 out of 153 showed observable reflection on the learning experience; 133 out of 153 expressed learning or planned behaviour change for future tasks). Furthermore, the interactions be-tween the apprentices and Rebo Junior result in coherent conversations (149 out of 153 were coherent). Contrary to expectations, engagement did not decrease over time in either phase. With the present paper, we therefore publish a dialogue structure for reflecting on learning tasks that has worked extremely well despite no adaptivity in the conversational interface. Overall, we interpret the results of our work as underscoring the importance of dialogue structure quality in conversational agents.