Pilot: The Performer: An Interactive Music System for Live Performance

最近音乐和技术的一个令人兴奋的方向是交互式音乐表演，这需要先进的系统来感知，聆听和理解创造性的新人机合作界面，实时系统的进步以及音乐表演和合成的新模型。这个项目介绍了一个新的计算机音乐应用程序：一个虚拟的表演者，可以填补一个有成就的音乐家表演流行音乐的角色。这项工作将建立一个新的音乐制作框架，本质上是一个新的流派。这项工作的智力价值在于音乐的科学研究和相关研究，包括可靠的手势传感，信号分析，以及计算机如何支持合作任务的研究。研究结果将对音乐信息检索、人机交互以及复杂的传感和识别任务产生额外的影响。这项工作的更广泛的影响包括新的音乐技术，对数百万音乐家，业余和专业的人都有用，为创造性的音乐实践，文化和经济提供了刺激。这种新的创造性实践还将促进计算素养，研究本身将激发新生对计算机科学及相关领域更广泛的兴趣。

One of the exciting recent directions for music and technology is interactive music performance, which requires advanced systems for sensing, listening, and understanding creative new human-computer cooperative interfaces, advances in real-time systems, and new models of music performance and synthesis. This project introduces a new computer music application: a virtual Performer that can fill the role of an accomplished musician performing popular music. This work will establish a new framework for music making, essentially a new genre.The intellectual merit of this work lies in the scientific study of music and related research including reliable gesture sensing, signal analysis, and the study of how computers can support cooperative tasks. Results will have additional implications for music information retrieval, human-computer interaction, and complex sensing and recognition tasks. The broader impacts of this work include new music technology useful to millions of musicians, amateur and professional alike, providing a stimulus to creative musical practice, culture, and the economy. This new creative practice will also promote computational literacy, and the research itself will motivate a broader interest in computer science and related fields among new students.