CGV: Small: Interactive Sound Rendering for Large-Scale Virtual Environments

CGV：小型：大型虚拟环境的交互式声音渲染

• 批准号: 1320644
• 负责人: Ming Lin
• 金额: $ 50万
• 依托单位: University of North Carolina at Chapel Hill
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2013
• 资助国家: 美国
• 起止时间: 2013-08-01 至 2018-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1320644&HistoricalAwards=false
• 关键词: CGV; Small; Interactive; Sound; Rendering

Auditory experience is an integral part of our daily life. Our perception of sound affects how we interpret and respond to various events around us. Overall, interactive modeling and simulation of sound effects and auditory events can significantly enhance numerous scientific and engineering applications, and also support more intuitive human-computer interaction for desktop and mobile applications. It also offers an alternative means to visualize datasets with complex characteristics (multi-dimensional, abstract, conceptual, spatial-temporal, etc.). Yet despite the fact that hearing is one of our dominant senses, sound rendering has not received as much attention as visual rendering to better serve as an effective communication channel for human-computer systems, and interactive audio rendering still poses major computational challenges. In this project, the PI focuses on rendering of aural effects, with attention to a greater correlation between sound and visual rendering, to communicate information (events, spatial extent, physical setting, emotion, ambience, etc.) to a user in a virtual world and to thereby increase the user's sense of presence and spaciousness while improving his/her ability to locate sound sources. The PI's goal is to make radical advance in interactive sound rendering and application-specific auditory interaction techniques in order to achieve high-fidelity auditory interfaces for large-scale virtual reality. In particular, she will address the computational bottlenecks in example-guided, physics-based sound synthesis, develop new hybrid algorithms for creating realistic acoustic effects in complex, dynamic 3D virtual environments, demonstrate the techniques on acoustic walkthrough for a variety of applications, and evaluate the resulting auditory systems and their impact on target applications. The work will build upon the PI's prior accomplishments to make several major scientific advances that will significantly extend the state of the art in auditory displays and human-centric computing. Project outcomes will include new hybrid acoustic algorithms for realistic sound effects, novel example-guided physics-based sound synthesis, innovative applications of auditory displays, and better understanding of human auditory perception.Broader Impacts: Applications of interactive sound rendering enabled by this project will span a wide variety of domains, include assistive technology for the visually impaired, multimodal human-centric interfaces, immersive teleconferencing, rapid prototyping of acoustic spaces for urban planning, structural design, and noise control. Project outcomes, including scientific advances and software systems, will be disseminated through websites, publications, workshops, community outreach, and other professional contacts. In addition to acoustic simulation, this research will ultimately offer fundamental scientific foundations for solving wave/sound propagation problems in complex domains for seismology, geophysics, meteorology, engineering design, urban planning, etc.

听觉体验是我们日常生活中不可或缺的一部分。我们对声音的感知影响着我们对周围各种事件的解释和反应。总的来说，声音效果和听觉事件的交互式建模和仿真可以显著增强许多科学和工程应用，也支持桌面和移动应用更直观的人机交互。它还提供了另一种方法来可视化具有复杂特征（多维、抽象、概念、时空等）的数据集。然而，尽管听觉是我们的主要感官之一，但声音渲染并没有像视觉渲染那样受到重视，无法更好地作为人机系统的有效沟通渠道，交互式音频渲染仍然面临着重大的计算挑战。在这个项目中，PI专注于听觉效果的渲染，注重声音与视觉渲染之间更大的相关性，在虚拟世界中向用户传达信息（事件、空间范围、物理设置、情感、氛围等），从而增加用户的存在感和空间感，同时提高用户定位声源的能力。PI的目标是在交互式声音渲染和特定于应用程序的听觉交互技术方面取得突破性进展，以实现大规模虚拟现实的高保真听觉接口。特别是，她将解决实例引导，基于物理的声音合成中的计算瓶颈，开发新的混合算法，用于在复杂，动态的3D虚拟环境中创建逼真的声学效果，演示各种应用的声学演练技术，并评估所产生的听觉系统及其对目标应用的影响。这项工作将以PI先前的成就为基础，取得几项重大的科学进步，这将大大扩展听觉显示和以人为中心的计算的艺术状态。项目成果将包括用于逼真声音效果的新型混合声学算法、基于实例指导的新型物理声音合成、听觉显示的创新应用以及对人类听觉感知的更好理解。更广泛的影响：该项目支持的交互式声音渲染应用将跨越广泛的领域，包括为视障人士提供辅助技术、多模式以人为中心的界面、沉浸式电话会议、城市规划、结构设计和噪声控制的声学空间快速原型。项目成果，包括科学进展和软件系统，将通过网站、出版物、讲习班、社区外展和其他专业联系方式传播。除了声学模拟之外，本研究最终将为解决地震学、地球物理、气象学、工程设计、城市规划等复杂领域的波声传播问题提供基础科学依据。