Acoustic Holography for Multimodal 3D Display and Fabrication

该项目的目的是利用声学全息技术和高性能计算技术的最新进展来创建多模态交互应用程序，将计算制造与视觉、触觉、听觉、嗅觉和味觉体验动态地结合起来，所有这些都使用相同的全息原理。这个项目的目标是创建一个系统，使设计界能够在创建可以创建和操作数字和物理人工制品的应用程序时拥抱声全息术的力量。声全息技术已经显示出其作为混合现实（MR）显示器的能力，提供了五种模式，以及它作为一种新的计算制造技术的潜力，可以实现多材料和多分辨率的3D打印。然而，由于计算的限制，这样的努力被限制在一次单一的模态或一次性精心编排的组合示例，并且没有全息3D制造已经被证明。目前的方法有一个严重的限制，那就是不能实时计算考虑声散射的声场。这种限制阻碍了我们充分利用声全息术的力量来创造大量成熟的应用程序。在本提案中，我们将开发一个实时的形状因素无关的声场计算，并通过几个交互应用程序的原型探索最佳形状因素，以最大限度地提高用户的多模态体验。原型应用程序不仅将展示声全息术创造神奇体验的能力，还将为社区提供易于使用的工具，以便将此类系统集成到现实世界的应用程序中。我们将创建一个交互式应用程序，模糊显示器和3D打印之间的界限，用户可以即时3D打印物理原型，并将其集成在MR环境中，同时在3D打印和MR探索之间来回走动。

The aim of the project is to use recent advances in acoustic holography and high-performance computational techniques to create multimodal interactive applications that dynamically combine computational fabrication with visual, tactile, auditory, olfactory and gustatory experiences all using the same holography principles. The ambition of this project is to create systems that empower the design community to embrace the power of acoustic holography in creating applications that can create and manipulate both digitaland physical artefacts.Acoustic holography has shown its capability as Mixed-Reality (MR) displays in providing five modalities and its potential as a new computational fabrication technique that allows multi-material and multi-resolution 3D printing. However, due to computational limitations, such endeavours have been limited to one-modality at a time or one-off carefully orchestrated examples of combinations, and no holographic 3D fabrication has been demonstrated. A serious limitation in current approaches is in real-time computation of the sound fields that account for sound scatterings. This limitation is hindering our ability to make full use of the power of acoustic holography to create the plethora of applications that are ripe for exploitation.In this proposal, we will develop a real-time form-factor-agnostic sound field computation and explore optimum form factor to maximize users' multimodal experiences through several prototyping of interactive applications. The prototype applications will not only demonstrate the ability of acoustic holography to create magical experiences but will also provide easy-to-use tools for the community to integrate such systems in real-world applications. We will create an interactive application that blurs the boundary between displays and 3D printing where users can instantly 3D print physical prototypes and integrate them in an MR environment while going back-and-forth between 3D printing and MR-exploration.