A musical robot that synchronizes with a co-player using non-verbal cues
A musical robot that synchronizes with a co-player using non-verbal cues
复制标题
使用非语言提示与同伴同步的音乐机器人
DOI：
10.1163/156855311x614626
复制
发表时间：
2012
影响因子：
2
通讯作者：
et al
中科院分区：
文献类型：
--
作者：
A.Lim;T.Mizumoto;et al
长期以来，音乐一直被用来加强人与人之间的联系。在我们的研究中，我们开发了音乐合作机器人，希望音乐也能改善人机共生。在本文中，我们强调了非语言，视觉沟通的重要性，在一个作品的开始，期间和结束的整体同步。我们提出了三种玩家之间交流的线索，并提出了一个自动演奏、唱歌的机器人，它可以检测到这些线索，并根据人类长笛手的演奏进行调整。对两名初学者的实验表明，该系统可以识别自然发生的长笛手手势，而不需要专门的用户培训。此外，我们展示了如何使用视听聚合可以让机器人快速适应节奏变化。
Music has long been used to strengthen bonds between humans. In our research, we develop musical coplayer robots with the hope that music may improve human–robot symbiosis as well. In this paper, we underline the importance of non-verbal, visual communication for ensemble synchronization at the start, during and end of a piece. We propose three cues for interplayer communication, and present a thereminplaying, singing robot that can detect them and adapt its play to a human flutist. Experiments with two naive flutists suggest that the system can recognize naturally occurring flutist gestures without requiring specialized user training. In addition, we show how the use of audio-visual aggregation can allow a robot to adapt to tempo changes quickly.