How to Address Smart Homes with a Social Robot? A Multi-modal Corpus of User Interactions with an Intelligent Environment
How to Address Smart Homes with a Social Robot? A Multi-modal Corpus of User Interactions with an Intelligent Environment
复制标题
如何使用社交机器人解决智能家居问题？
DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
S. Wrede
中科院分区：
文献类型：
--
作者：
Patrick Holthaus;C. Leichsenring;Jasmin Bernotat;Viktor Richter;M. Pohling;Birte Carlmeyer;N. Köster;Sebastian Meyer zu Borgsen;René Zorn;Birte Schiffhauer;K. Engelmann;Florian Lier;Simon Schulz;P. Cimiano;F. Eyssel;T. Hermann;F. Kummert;David Schlangen;Sven Wachsmuth;P. Wagner;B. Wrede;S. Wrede
为了探索智能环境中直观的语言和非语言界面，我们记录了用户与智能公寓的交互。除了提供各种互动功能本身，公寓也居住着一个社交机器人，可作为一个人形界面。本文提出了一个多模态语料库，其中包含目标导向的行动，天真的用户试图解决一些预定义的任务。除了音频和视频记录外，我们的数据集还包括大量由环境及其交互组件提供的时间对齐的感觉数据和系统行为。非语言系统的反应，如光线或显示内容的变化，以及机器人和公寓的话语和手势，为以后的深入分析提供了丰富的基础。手动注释提供了关于Meta数据的进一步信息，如当前的学习过程和用户行为，包括合并的模态，所有文字话语，语言特征，情感表达，注意力焦点和收件人。
In order to explore intuitive verbal and non-verbal interfaces in smart environments we recorded user interactions with an intelligent apartment. Besides offering various interactive capabilities itself, the apartment is also inhabited by a social robot that is available as a humanoid interface. This paper presents a multi-modal corpus that contains goal-directed actions of naive users in attempts to solve a number of predefined tasks. Alongside audio and video recordings, our data-set consists of large amount of temporally aligned sensory data and system behavior provided by the environment and its interactive components. Non-verbal system responses such as changes in light or display contents, as well as robot and apartment utterances and gestures serve as a rich basis for later in-depth analysis. Manual annotations provide further information about meta data like the current course of study and user behavior including the incorporated modality, all literal utterances, language features, emotional expressions, foci of attention, and addressees.