Pilot: The Performer: An Interactive Music System for Live Performance

最近音乐和技术的一个令人兴奋的方向是交互式音乐表演，它需要先进的系统来感知、倾听和理解创造性的新的人机合作界面，实时系统的进步，以及音乐表演和合成的新模型。这个项目介绍了一个新的计算机音乐应用程序：一个虚拟表演者，可以填补一个有成就的音乐家表演流行音乐的角色。这部作品将为音乐创作建立一个新的框架，本质上是一种新的流派。这项工作的智力价值在于音乐和相关研究的科学研究，包括可靠的手势感应，信号分析，以及计算机如何支持协作任务的研究。研究结果将对音乐信息检索、人机交互以及复杂的感知和识别任务产生额外的影响。这项工作的更广泛的影响包括新的音乐技术，对数以百万计的音乐家，业余和专业人士都有用，为创造性的音乐实践，文化和经济提供了刺激。这种新的创造性实践也将促进计算素养，研究本身将激发新生对计算机科学和相关领域更广泛的兴趣。

One of the exciting recent directions for music and technology is interactive music performance, which requires advanced systems for sensing, listening, and understanding creative new human-computer cooperative interfaces, advances in real-time systems, and new models of music performance and synthesis. This project introduces a new computer music application: a virtual Performer that can fill the role of an accomplished musician performing popular music. This work will establish a new framework for music making, essentially a new genre.The intellectual merit of this work lies in the scientific study of music and related research including reliable gesture sensing, signal analysis, and the study of how computers can support cooperative tasks. Results will have additional implications for music information retrieval, human-computer interaction, and complex sensing and recognition tasks. The broader impacts of this work include new music technology useful to millions of musicians, amateur and professional alike, providing a stimulus to creative musical practice, culture, and the economy. This new creative practice will also promote computational literacy, and the research itself will motivate a broader interest in computer science and related fields among new students.