Annotation System for Dialogue Datasets of Older Adult’s with Photos and Storytelling
Annotation System for Dialogue Datasets of Older Adult’s with Photos and Storytelling
复制标题
老年人照片和故事对话数据集标注系统
DOI：
10.1007/978-3-031-21047-1_41
复制
发表时间：
2022
期刊：
影响因子：
--
通讯作者：
M.
中科院分区：
文献类型：
--
作者：
Tokunaga;S.;Takata;S.;Tamura;K.;Otake-Matsuura;M.
我们开发了一个最先进的“基于对话的照片和讲故事系统”（DBSPS）。当实验时间表准时时，系统自动运行，以减少繁琐的基于屏幕的操作（例如，tap）尽可能让老年人准备好在家里使用。在本文中，我们提出了一个原始的注释系统，旨在创建一个语料库，通过收集数据与我们的系统。沿着我们的实验条件，显示作为实验条件的图像和故事以及用户的问题，答案和反应是必不可少的。使用该系统，我们进行了三个注释任务（即，问题形式注释、自然性注释和相似性注释）。首先，问题形式标注是检查用户的话语是否是问题形式。第二个是自然性，旨在确定我们的系统如何自然地响应。第三，相似性标注的目的是检查我们的系统的准备数据集的覆盖率。五个注释者可以顺利地使用我们的系统，所有的任务都完成了，没有系统错误。因此，我们确定了改进对话系统的领域。
We have developed a state-of-the-art “Dialogue-Based System with Photo and Storytelling” (DBSPS). The system runs automatically when the experimental schedule is on time to reduce cumbersome screen-based operation (e.g., tap) as much as possible for older adults to be ready for home-based use. In this paper, we present an original annotation system that is designed to create a corpus by collecting data with our system. Along with our experimental conditions, it is essential to display the images and stories used as experimental conditions and the user’s questions, answers, and responses. Using the system, we conducted three annotations tasks (i.e.,question form annotation, naturalness annotation, and similarity annotation). First, question form annotation is checking whether the user’s utterance is a question form or not. The second is naturalness, which aims to identify how our system could respond naturally. Third, the similarity annotation is designed to check the coverage of our system’s prepared datasets. Five annotators could use our system smoothly, and all tasks were completed without system errors. As a result, we identified areas to improve our dialogue system.