SGER: Music Telepresence

SGER：音乐远程呈现

• 批准号: 0555457
• 负责人: Mark Bocko
• 金额: --
• 依托单位: University of Rochester
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2005
• 资助国家: 美国
• 起止时间: 2005-12-01 至 2007-05-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0555457&HistoricalAwards=false
• 关键词: SGER; Music; Telepresence

Internet mediated telepresence has the potential to transform society by eliminating the physical barriers to collaboration. However, it has yet to reach the ideal of providing a medium-transparent, immersive visual and audio link between remote locations. The goal of this project is to begin to address issues and tradeoffs between latency minimization and quality of service in the context of Internet mediated musical collaboration. Specifically, the PI will focus on real-time distributed musical rehearsal and performance, which is highly demanding in terms of both audio/video quality of service and communication latency. The technical challenge to be tackled in this project is related to the development of efficient and reliable multimedia Internet protocols linked with low-latency multimedia compression. The PI will employ and build upon the ITU-T developed H.323 open standards to address the interplay between, and joint optimization of, the compression methods and the transport protocols. The team, which includes researchers from the University of Rochester (including its Eastman School of Music), from the University of Miami (including its Frost School of Music), and from Wright State University, will develop a test-bed system linking the three sites that will be capable of supporting three-way musical collaboration. Because the ultimate success of this interdisciplinary project, which involves multimedia coding and immersive environments, depends upon the experience of the end-users (musicians), a key component of the work is involvement of musicians not only in final assessment of the technology, but also from the earliest stages in the technical developments. Broader Impacts: The impact of this research extends beyond its benefits to distance music collaboration and education. In addition to bringing music into the lives of members of underrepresented groups, the project also will enable individuals with physical limitations and those who are geographically isolated to participate in a range of essentially interpersonal activities from scientific and engineering collaboration to health care delivery and, of course, to joint artistic endeavors. The PI will seek to maximize the impact of the work by building upon existing widely accepted open videoconferencing standards.

以互联网为媒介的网真有可能通过消除协作的物理障碍来改变社会。 然而，它还没有达到在远程位置之间提供中等透明、沉浸式视觉和音频链接的理想。 这个项目的目标是开始，以解决问题和权衡之间的延迟最小化和服务质量的背景下，互联网介导的音乐合作。 具体来说，PI将专注于实时分布式音乐排练和表演，这在音频/视频服务质量和通信延迟方面都有很高的要求。 本项目所要解决的技术挑战涉及开发与低延迟多媒体压缩相联系的高效和可靠的多媒体因特网协议。 PI将采用ITU-T开发的H.323开放标准并以此为基础，以解决压缩方法和传输协议之间的相互作用和联合优化问题。 该团队包括来自罗切斯特大学（包括其伊斯曼音乐学院）、迈阿密大学（包括其弗罗斯特音乐学院）和赖特州立大学的研究人员，他们将开发一个连接三个站点的测试平台系统，该系统将能够支持三方音乐合作。 由于这个跨学科项目的最终成功，其中涉及多媒体编码和沉浸式环境，取决于最终用户（音乐家）的经验，工作的一个关键组成部分是音乐家的参与，不仅在技术的最终评估，而且从技术发展的最早阶段。 更广泛的影响：这项研究的影响超出了它对远程音乐合作和教育的好处。 除了将音乐带入代表性不足的群体成员的生活之外，该项目还将使身体受限的人和那些地理上孤立的人能够参与一系列基本上是人际交往的活动，从科学和工程合作到医疗保健服务，当然还有联合艺术活动。 PI将通过建立现有的广泛接受的开放式视频会议标准，寻求最大限度地发挥工作的影响。