The vernissage corpus: A conversational Human-Robot-Interaction dataset
The vernissage corpus: A conversational Human-Robot-Interaction dataset
复制标题
开幕语料库：对话式人机交互数据集
DOI：
--
复制
发表时间：
2013
期刊：
影响因子：
--
通讯作者：
D. Gática
中科院分区：
文献类型：
--
作者：
D. Jayagopi;Samira Sheikhi;David Klotz;Johannes Wienke;J. Odobez;S. Wrede;Vasil Khalidov;L. Nyugen;B. Wrede;D. Gática
我们引入了一个新的对话式人机交互（HRI）数据集，其中包含一个真实行为的机器人，该机器人诱导与人类以及人类之间的交互行为。我们的场景涉及一个人形机器人NAO 1在房间里解释绘画，然后询问参与者，他们是天真的用户。由于感知非语言线索，除了口语之外，在社交互动和社交互动机器人中起着重要作用，我们对数据集进行了广泛的注释。它已被记录和注释，以基准测试许多相关的感知任务，使机器人能够与多个人匡威，如扬声器定位和语音分割;跟踪，姿态估计，点头，视觉域中的视觉注意力集中估计;和视听任务，如收件人检测。NAO系统状态也可用。与使用静态相机完成的记录相比，该语料库涉及人形机器人的头部运动（由于凝视变化，点头），对视觉处理提出了挑战。此外，真实的HRI设置中存在的显著背景噪声使得听觉任务具有挑战性。
We introduce a new conversational Human-Robot-Interaction (HRI) dataset with a real-behaving robot inducing interactive behavior with and between humans. Our scenario involves a humanoid robot NAO1 explaining paintings in a room and then quizzing the participants, who are naive users. As perceiving nonverbal cues, apart from the spoken words, plays a major role in social interactions and socially-interactive robots, we have extensively annotated the dataset. It has been recorded and annotated to benchmark many relevant perceptual tasks, towards enabling a robot to converse with multiple humans, such as speaker localization and speech segmentation; tracking, pose estimation, nodding, visual focus of attention estimation in visual domain; and an audio-visual task such as addressee detection. NAO system states are also available. As compared to recordings done with a static camera, this corpus involves the head-movement of a humanoid robot (due to gaze change, nodding), posing challenges to visual processing. Also, the significant background noise present in a real HRI setting makes auditory tasks challenging.