Autonomous and reactive objects for sound and light generation

这个项目的目标是探索设计和开发体现，反应，自主代理，创造声音，音乐和光的反应，彼此和他们的环境，包括其他代理和人。Tandem Interaction融合了艺术、设计和技术，创造了以人的参与为关键的感官装置。他们的工作挖掘了一些最基本的本能，在一个共享的空间里玩耍和探索。他们为公司、音乐团体、城市和博物馆提供品牌互动体验。拟议的项目是由他们已经开发的现有技术及其局限性。这项工作的新贡献将在三个领域：自主性，涌现的创造力和声音/音乐的产生。目前，Tandem Interaction部署的系统主要集中在视觉效果上，因此他们希望扩展到声音和音乐生成。由于需要有线或无线通信以及难以对多个组件进行编程，因此难以部署具有需要协调的多个组件的安装。我们将开发原型立方体，其中包含一个小因素嵌入式计算机，能够产生光模式和声音。这些简单的实体代理也将能够通过麦克风和摄像头感知他们的环境，包括其他代理和人。我们将使用多代理方法进行协调，其中每个代理独立于其他代理运行，但由其他代理通知，而无需任何中央协调。我们将展示如何有趣的行为可以从他们的相互作用，无论是在声音和音乐，以及光。Tzanetakis博士的研究小组在计算机音乐，音乐表达的新界面和音乐信息检索方面具有强大的国际影响力，所有这些都是将为该项目贡献想法，概念和算法的研究领域。两名在嵌入式系统/信号处理和手势识别/音乐生成方面具有丰富经验的博士生将通过该项目获得资助，并与Tandem Interactive的设计师和工程师合作。

The goal of this project is to explore the design and development of embodied, reactive, autonomous agents that create sound, music, and light in reaction to each other and their environment which includes other agents and people. Tangible Interaction blends art, design, and technology to create sensory installation where people participation is key. Their work taps into some of the most basic instincts, to play and explore in a shared space. They have produced branded interactive experiences for companies, music groups, cities, and museums. The proposed project is informed by existing technologies they have developed and their limitations. The novel contributions of this work will be in three areas: autonomy, emergent creativity, and sound/music generation. Currently the systems that Tangible Interaction deploys are mostly focused on visuals so they are looking to expand into sound and music generation. Installations with multiple components that require coordination are difficult to deploy due to the need for wired or wireless communication and the difficulty of programming multiple components. We will develop prototype cubes that contain a small factor embedded computer that are capable of generating light patterns and sound. These simple embodied agents will also be able to sense through microphones and cameras their environment includes other agents and people. We will use a multi-agent approach for coordination where each agent operates independently of the other agents but is informed by other agents without any central coordination. We will show how interesting behaviour can emerge from their interactions both in terms of sound and music as well as light. The research group of Dr. Tzanetakis has a strong international presence in Computer Music, New Interfaces of Music Expression and Music Information Retrieval all of which are research areas that will contribute ideas, concepts, and algorithms to the project. Two PhD students with complimentary experience in embedded systems/signal processing and gesture recognition/music generation will be funded through the project and work with the designers and engineers at Tangible Interactive.