Musical-based interaction system for the Waseda Flutist Robot
Musical-based interaction system for the Waseda Flutist Robot
复制标题
早稻田长笛演奏机器人的音乐交互系统
DOI：
10.1007/s10514-010-9180-5
复制
发表时间：
2010
影响因子：
3.5
通讯作者：
A. Takanishi
中科院分区：
文献类型：
--
作者：
K. Petersen;J. Solis;A. Takanishi
自1990年以来，在早稻田大学，拟人化长笛演奏机器人的开发一直集中在机械复制长笛演奏过程中涉及的器官(即肺、嘴唇等)的生理上。以及培养基本的认知能力，与长笛初学者互动。到目前为止所做的研究工作的结果是，早稻田长笛机器人被认为演奏的长笛几乎与中等水平的人类演奏者的演奏相似。但是，我们认为，为了扩大长笛机器人与音乐伙伴的交互能力，还需要做进一步的研究工作。在本文中，我们提出了一个长期目标，使长笛机器人能够在爵士乐队的背景下更自然地与音乐伙伴互动。为此，提出了一种基于音乐的交互系统(MBIS)，使机器人能够处理贯穿于与音乐家交互的视觉和听觉线索。重点介绍了视觉跟踪模块在早稻田长笛机器人WF-4RIV上的具体实现。视觉跟踪模块由两个级别的交互组成：基本(基于控制虚拟按钮和衰减器的音乐家的可视界面)和高级(乐器跟踪系统，以便机器人可以实时处理音乐伙伴执行的动作手势，然后直接映射到机器人表演的音乐参数)。所进行的实验主要是为了验证所提议的互动级别的有效性和可用性。特别是，我们专注于确定我们的WF-4RIV在与人类玩家互动时动态改变音乐参数的程度。从实验结果可以看出，机器人的物理约束在交互过程中起着重要的作用。尽管应该做进一步的改进来克服这些限制，但我们预计交互体验可能会变得更加自然。
Since 1990, at Waseda University the development on the Anthropomorphic Flutist Robot has been focused on mechanically reproducing the physiology of the organs involved during the flute playing (i.e. lungs, lips, etc.) and implementing basic cognitive capabilities to interact with flutist beginners. As a results of the research efforts done until now, the Waseda Flutist Robot is considered to play the flute nearly similar to the performance of a intermediate human player. However, we consider that in order to extend the interaction capabilities of the flutist robot with musical partners, further research efforts should be done. In this paper, we propose as a long-term goal to enable the flutist robot to interact more naturally with musical partners on the context of a Jazz band. For this purpose a Musical-Based Interaction System (MbIS) is proposed to enable the robot the process both visual and aural cues coming throughout the interaction with musicians. In particular, in this paper, the details of the implementation of the visual tracking module on the Waseda Flutist Robot No. 4 Refined IV (WF-4RIV) is presented. The visual tracking module is composed by two levels of interaction: basic (visual interface for the musician based on controlling virtual buttons and faders) and advanced (instrument tracking system so that the robot can process motion gestures performed by the musical partner in real-time which are then directly mapped into musical parameters of the performance of the robot). The experiments carried out were focused in verifying the effectiveness and usability of the proposed levels of interaction. In particular, we focused on determining how well our the WF-4RIV dynamically changes musical parameters while interacting with a human player. From the experimental results we observed that the physical constraints of the robot play an important role during the interaction. Although further improvements should be done to overcome such constrains, we expect that the interaction experience may become more natural.
早稻田大学拟人化长笛演奏机器人的开发
DOI：
--
发表时间：
2006
期刊：
International Journal of Humanoid Robots (In Press)
影响因子：
--
作者：
Solis J.;Chida;K.;Suefuji;K.;Takanishi;A.
通讯作者：
A.
关于H.264/AVC中由于改变参考帧而导致嵌入信息量的增加
DOI：
--
发表时间：
2012
期刊：
影响因子：
--
作者：
李鵬;戚意強;呉海元;三浦浩一;瀧寛和;高木洋
通讯作者：
高木洋
影响因子：
4.7
作者：
Nummiaro, K;Koller-Meier, E;Van Gool, L
通讯作者：
Van Gool, L