A pervasive multi-user augmented space for mobile immersive interaction with sound and music

2.联合项目摘要我们寻求为位于任意规模的公共物理空间中的一组用户中的每个人提供令人信服的身临其境3D音频体验。与其他涉及3D音频空间的项目不同，我们的工作是通过用户的真实世界运动来支持连续的、建模的音频环境中的导航。这使我们能够超越纯粹虚拟世界的限制，转而支持与同一物理环境中的其他用户进行互动。在技术层面上，该项目要求集成位置和方向传感器、音频采集、空间声音渲染软件，以及强大的集中处理与移动设备相结合的混合计算架构。我们对这些技术的关注集中在它们以可扩展、不受束缚的方式对身临其境的音频应用和艺术表现的内在适宜性。通过这个项目，科学家库珀斯托克和艺术家塞特尔寻求在身临其境的环境中扩展他们的工作，以允许多个同时参与，同时提供以前只有单一用户才能获得的丰富的细节。合作者热衷于创造在大型和广阔的物理空间(例如室外和全球)中运行的应用程序和艺术表现形式，就像他们在隔离的实验室环境中所做的那样有效。为实现这些目标而进行的合作是显而易见的、明确的和及时的。使用通用系统和技术，Settel将为室内和室外操作的身临其境的声音和音乐作品创建新的形式，而库珀斯托克将扩展他的多模式共享沉浸式环境，为多个不受限制的移动参与者提供独立于用户的音频渲染。高度的转移和共生是隐含的。

2    Joint Project SummaryWe seek to provide a compelling experience of immersive 3D audio for each individual in a group of users, located in a common physical space of arbitrary scale. Unlike other projects involving 3D audio space, our work is unique in supporting navigation within a continuous, modeled audio environment through the real world motion of users. This permits us to move beyond the confines of a purely virtual world, and instead, support interaction with other users within the same physical environment.On a technical level, the project calls for the integration of position and orientation sensors, audio acquistion, spatial sound rendering software, and a hybrid computing architecture of powerful, centralized processing coupled with mobile devices. Our focus on these technologies is centered on their intrinsic suitability for immersive audio applications and artistic manifestations in a scalable, untethered manner.Through this project, scientist Cooperstock and artist Settel seek to expand their work in immersive environments to allow for multiple simultaneous participants, while providing for a richness of detail that was only previously available to a single user. The collaborators are keen to create applications and artistic manifestations that operate in large and expansive physical spaces (e.g. outdoor and global) as effectively as they do in an isolated laboratory setting. The collaboration toward achieving these ends is obvious, well-defined and timely. Using common systems and techniques, Settel will create new forms for immersive sound and music works that operate both indoors and outdoors, while Cooperstock will expand his multimodal shared immersive environments to provide user-independent audio rendering to multiple untethered, mobile participants. A high degree of transfer and symbiosis is implicit.