Musically expressive doll in face-to-face communication
Musically expressive doll in face-to-face communication
复制标题
面对面交流时富有音乐表现力的娃娃
DOI：
10.1109/icmi.2002.1167031
复制
发表时间：
2002
期刊：
影响因子：
--
通讯作者：
K. Mase
中科院分区：
文献类型：
--
作者：
Tomoko Yonezawa;K. Mase
我们提出了一个应用程序，使用音乐作为一种多模态表达来激活和支持与传统对话并行的交流。我们研究了为音乐表达而设计的人格化娃娃形界面。为了将这些手势用于交流，我们采用了一个具有触觉互动的增强填充玩具作为音乐表达设备。我们用各种传感器构造了娃娃，用于用户上下文识别。该配置允许将交互转换为旋律语句。我们通过比较不同输入接口和输出声音的实验结果来证明娃娃对面对面对话的影响。因此，我们发现与玩偶的对话受到音乐输出、玩偶界面及其组合的积极影响。
We propose an application that uses music as a multimodal expression to activate and support communication that runs parallel with traditional conversation. We examine a personified doll-shaped interface designed for musical expression. To direct such gestures toward communication, we have adopted an augmented stuffed toy with tactile interaction as a musically expressive device. We constructed the doll with various sensors for user context recognition. This configuration enables translation of the interaction into melodic statements. We demonstrate the effect of the doll on face-to-face conversation by comparing the experimental results of different input interfaces and output sounds. Consequently, we have found that conversation with the doll was positively affected by the musical output, the doll interface, and their combination.