Acquisition of Equipment for Distributed Immersive Performance

购买分布式沉浸式表演设备

• 批准号: 0321377
• 负责人: Alexander Sawchuk
• 金额: --
• 依托单位: University of Southern California
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2003
• 资助国家: 美国
• 起止时间: 2003-09-01 至 2008-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0321377&HistoricalAwards=false
• 关键词: Acquisition; Equipment; Distributed; Immersive; Performance

This project, developing the technology for Distributed Immersive Performance (DIP), deals with live, interactive musical performances in which participants in different physical locations are interconnected by very high fidelity multichannel audio and video links. DIP, a specialized realization of broader immersive technology, creates the complete aural and visual ambience that places a group in a virtual space to experience events occurring at a remote site or communicate naturally regardless of location. The assembled DIP experimental system will have three sites in different locations on the USC campus. The sites will have different types of equipment to test the effects of video and audio fidelity on the ease of use and functionality of different applications. Two will have high-definition (HD) video or digital video (DV) quality images projected onto wide screen wall displays completely integrated with an immersive audio reproduction system for a seamless, fully 3-dimensional aural environment with the correct spatial sound localization for participants. The system will be capable of storage and playback of the many streams of synchronized audio and video data (immersidata) and will utilize novel protocols for the low-latency, seamless, synchronized real-time delivery of immersidata over local-area and wide-area networks such as Internet. Partners in the project include New World Symphony (NWS) of Miami Beach, University of Maryland, and Georgia Tech. The latter two contribute the Internet2 infrastructure as server sites. The enabled research addresses the following challenges: Low latency continuous media (CM) stream transmission, synchronization and data loss management Low latency, real-time video and multichannel immersive audio acquisition and rendering Real-time continuous media stream recording, storage, playback Human factor studies: psychophysical, perceptual, artistic, performance evaluation Robust integration of all these technical areas into seamless presentation to participantsStudents participate in the assembly, integration, testing, and research applications using the DIP system via thesis research, directed research projects, and classroom work. Offering an opportunity for students to receive a broad cross-disciplinary education in media systems engineering, undergraduate engineering majors from USC and CSULA are invited to participate.

该项目开发了分布式沉浸式表演（DIP）技术，涉及现场互动音乐表演，其中不同物理位置的参与者通过非常高保真的多通道音频和视频链接相互连接。DIP是更广泛的沉浸式技术的专门实现，它创建了完整的听觉和视觉氛围，将一组人置于虚拟空间中，体验发生在远程站点的事件或自然地进行通信，而无论位置如何。组装好的DIP实验系统将在南加州大学校园的不同位置有三个站点。这些网站将有不同类型的设备来测试视频和音频保真度对不同应用程序的易用性和功能的影响。两个将有高清晰度（HD）视频或数字视频（DV）质量的图像投影到宽屏幕墙上显示器完全集成了沉浸式音频再现系统，为无缝，全三维听觉环境与正确的空间声音定位的参与者。该系统将能够存储和回放许多同步音频和视频数据流（沉浸式数据），并将利用新的协议，通过局域网和广域网（如互联网）进行沉浸式数据的低延迟、无缝、同步实时传输。该项目的合作伙伴包括迈阿密海滩的新世界交响乐团（NWS）、马里兰州大学和格鲁吉亚理工大学。后两者作为服务器站点贡献了Internet2基础设施。启用的研究解决了以下挑战：低延迟连续媒体（CM）流传输，同步和数据丢失管理低延迟，实时视频和多通道沉浸式音频采集和渲染实时连续媒体流记录，存储，回放人为因素研究：心理物理的，知觉的，艺术的，性能评估将所有这些技术领域稳健地集成为无缝演示给参与者学生参与组装、集成、测试，通过论文研究，指导研究项目和课堂作业使用DIP系统进行研究应用。为学生提供一个机会，接受媒体系统工程的广泛的跨学科教育，从南加州大学和CSULA本科工程专业被邀请参加。