Acquisition of Equipment for Distributed Immersive Performance

该项目开发分布式沉浸式表演(DIP)技术，处理现场互动音乐表演，其中不同物理位置的参与者通过非常高保真的多声道音频和视频链路相互连接。DIP是对更广泛的身临其境技术的专门实现，它创造了完整的听觉和视觉氛围，将团队置于虚拟空间中，体验在远程地点发生的事件或不受地点限制的自然交流。组装的DIP实验系统将在南加州大学校园的不同位置有三个地点。这些网站将配备不同类型的设备，以测试视频和音频保真度对不同应用程序的易用性和功能的影响。其中两个项目将把高清晰度(HD)视频或数字视频(DV)质量的图像投影到宽屏墙壁显示器上，与身临其境的音频再现系统完全集成，以实现无缝、全三维的听觉环境，并为参与者提供正确的空间声音定位。该系统将能够存储和回放许多同步音频和视频数据流(沉浸式数据)，并将利用新的协议，通过局域网和广域网，如因特网，以低延迟、无缝、同步的方式实时传送沉浸式数据。该项目的合作伙伴包括迈阿密海滩的新世界交响乐团(NWS)、马里兰大学和佐治亚理工大学。后两者作为服务器站点贡献了Internet2基础设施。Enabled Research解决了以下挑战：低延迟连续媒体(CM)流传输、同步和数据丢失管理低延迟、实时视频和多声道沉浸式音频采集和渲染实时连续媒体流记录、存储、回放人为因素研究：心理物理、感知、艺术、性能评估将所有这些技术领域可靠地集成到无缝演示给参与者学生通过论文研究、指导研究项目和课堂工作参与使用DIP系统的组装、集成、测试和研究应用程序。我们邀请南加州大学和南加州大学工程专业的本科生参加，为学生提供在媒体系统工程方面接受跨学科教育的机会。

This project, developing the technology for Distributed Immersive Performance (DIP), deals with live, interactive musical performances in which participants in different physical locations are interconnected by very high fidelity multichannel audio and video links. DIP, a specialized realization of broader immersive technology, creates the complete aural and visual ambience that places a group in a virtual space to experience events occurring at a remote site or communicate naturally regardless of location. The assembled DIP experimental system will have three sites in different locations on the USC campus. The sites will have different types of equipment to test the effects of video and audio fidelity on the ease of use and functionality of different applications. Two will have high-definition (HD) video or digital video (DV) quality images projected onto wide screen wall displays completely integrated with an immersive audio reproduction system for a seamless, fully 3-dimensional aural environment with the correct spatial sound localization for participants. The system will be capable of storage and playback of the many streams of synchronized audio and video data (immersidata) and will utilize novel protocols for the low-latency, seamless, synchronized real-time delivery of immersidata over local-area and wide-area networks such as Internet. Partners in the project include New World Symphony (NWS) of Miami Beach, University of Maryland, and Georgia Tech. The latter two contribute the Internet2 infrastructure as server sites. The enabled research addresses the following challenges: Low latency continuous media (CM) stream transmission, synchronization and data loss management Low latency, real-time video and multichannel immersive audio acquisition and rendering Real-time continuous media stream recording, storage, playback Human factor studies: psychophysical, perceptual, artistic, performance evaluation Robust integration of all these technical areas into seamless presentation to participantsStudents participate in the assembly, integration, testing, and research applications using the DIP system via thesis research, directed research projects, and classroom work. Offering an opportunity for students to receive a broad cross-disciplinary education in media systems engineering, undergraduate engineering majors from USC and CSULA are invited to participate.