A pervasive multi-user augmented space for mobile immersive interaction with sound and music

点击翻译按钮获取中文摘要

2    Joint Project SummaryWe seek to provide a compelling experience of immersive 3D audio for each individual in a group of users, located in a common physical space of arbitrary scale. Unlike other projects involving 3D audio space, our work is unique in supporting navigation within a continuous, modeled audio environment through the real world motion of users. This permits us to move beyond the confines of a purely virtual world, and instead, support interaction with other users within the same physical environment.On a technical level, the project calls for the integration of position and orientation sensors, audio acquistion, spatial sound rendering software, and a hybrid computing architecture of powerful, centralized processing coupled with mobile devices. Our focus on these technologies is centered on their intrinsic suitability for immersive audio applications and artistic manifestations in a scalable, untethered manner.Through this project, scientist Cooperstock and artist Settel seek to expand their work in immersive environments to allow for multiple simultaneous participants, while providing for a richness of detail that was only previously available to a single user. The collaborators are keen to create applications and artistic manifestations that operate in large and expansive physical spaces (e.g. outdoor and global) as effectively as they do in an isolated laboratory setting. The collaboration toward achieving these ends is obvious, well-defined and timely. Using common systems and techniques, Settel will create new forms for immersive sound and music works that operate both indoors and outdoors, while Cooperstock will expand his multimodal shared immersive environments to provide user-independent audio rendering to multiple untethered, mobile participants. A high degree of transfer and symbiosis is implicit.