Acquisition of Equipment for Distributed Immersive Performance

该项目开发分布式沉浸式表演（DIP）技术，处理现场互动音乐表演，其中不同物理位置的参与者通过非常高保真的多通道音频和视频链接相互连接。DIP是一种更广泛的沉浸式技术的专业实现，它创造了完整的听觉和视觉氛围，将一群人置于虚拟空间中，体验远程站点发生的事件，或者无论位置如何都可以自然地进行交流。组装好的DIP实验系统将在南加州大学校园的不同位置有三个站点。这些站点将有不同类型的设备来测试视频和音频保真度对不同应用程序的易用性和功能的影响。其中两个将有高清晰度（HD）视频或数字视频（DV）质量的图像投影到宽屏幕墙壁显示器上，与沉浸式音频再现系统完全集成，为参与者提供无缝的、完全三维的听觉环境，并为参与者提供正确的空间声音定位。该系统将能够存储和播放许多同步音频和视频数据流（immersidata），并将利用新的协议，在局域网和广域网（如Internet）上实现低延迟、无缝、同步的实时传输immersidata数据。该项目的合作伙伴包括迈阿密海滩的新世界交响乐团（NWS）、马里兰大学和佐治亚理工学院。后两者作为服务器站点提供了Internet2的基础设施。该研究解决了以下挑战：低延迟连续媒体流传输、同步和数据丢失管理低延迟实时视频和多通道沉浸式音频采集和渲染实时连续媒体流记录、存储、播放人为因素研究将所有这些技术领域整合为无缝演示给参与者学生通过论文研究、指导研究项目和课堂作业参与DIP系统的组装、集成、测试和研究应用。为了让学生有机会接受广泛的跨学科媒体系统工程教育，我们邀请南加州大学和CSULA的本科工程专业学生参加。

This project, developing the technology for Distributed Immersive Performance (DIP), deals with live, interactive musical performances in which participants in different physical locations are interconnected by very high fidelity multichannel audio and video links. DIP, a specialized realization of broader immersive technology, creates the complete aural and visual ambience that places a group in a virtual space to experience events occurring at a remote site or communicate naturally regardless of location. The assembled DIP experimental system will have three sites in different locations on the USC campus. The sites will have different types of equipment to test the effects of video and audio fidelity on the ease of use and functionality of different applications. Two will have high-definition (HD) video or digital video (DV) quality images projected onto wide screen wall displays completely integrated with an immersive audio reproduction system for a seamless, fully 3-dimensional aural environment with the correct spatial sound localization for participants. The system will be capable of storage and playback of the many streams of synchronized audio and video data (immersidata) and will utilize novel protocols for the low-latency, seamless, synchronized real-time delivery of immersidata over local-area and wide-area networks such as Internet. Partners in the project include New World Symphony (NWS) of Miami Beach, University of Maryland, and Georgia Tech. The latter two contribute the Internet2 infrastructure as server sites. The enabled research addresses the following challenges: Low latency continuous media (CM) stream transmission, synchronization and data loss management Low latency, real-time video and multichannel immersive audio acquisition and rendering Real-time continuous media stream recording, storage, playback Human factor studies: psychophysical, perceptual, artistic, performance evaluation Robust integration of all these technical areas into seamless presentation to participantsStudents participate in the assembly, integration, testing, and research applications using the DIP system via thesis research, directed research projects, and classroom work. Offering an opportunity for students to receive a broad cross-disciplinary education in media systems engineering, undergraduate engineering majors from USC and CSULA are invited to participate.