Acoustic Holography for Multimodal 3D Display and Fabrication

该项目的目标是利用声全息术和高性能计算技术的最新进展来创建多模式交互应用程序，该应用程序动态地将计算制造与视觉、触觉、听觉、嗅觉和味觉体验结合在一起，所有这些都使用相同的全息原理。该项目的目标是创建系统，使设计界能够在创建和操作数字和物理人工制品的应用程序中拥抱声全息的力量。声全息显示了其作为混合现实(MR)显示的能力，提供了五种模式，并具有作为一种新的计算制造技术的潜力，允许进行多材料和多分辨率3D打印。然而，由于计算的限制，这种努力一直局限于一次一种模式或一次性精心编排的组合例子，还没有全息3D制造被证明。当前方法中的一个严重限制是在解释声音散射的声场的实时计算方面。这一限制阻碍了我们充分利用声全息的力量来创建大量成熟的应用程序。在这个建议中，我们将开发一种与形状因子无关的实时声场计算，并通过几个交互应用程序的原型来探索最佳形状因子以最大化用户的多模式体验。原型应用程序不仅将展示声全息技术创造神奇体验的能力，还将为社区提供易于使用的工具，将此类系统集成到现实世界的应用程序中。我们将创建一种交互式应用程序，模糊显示和3D打印之间的边界，用户可以立即3D打印物理原型，并将其集成到MR环境中，同时在3D打印和MR探索之间来回切换。

The aim of the project is to use recent advances in acoustic holography and high-performance computational techniques to create multimodal interactive applications that dynamically combine computational fabrication with visual, tactile, auditory, olfactory and gustatory experiences all using the same holography principles. The ambition of this project is to create systems that empower the design community to embrace the power of acoustic holography in creating applications that can create and manipulate both digitaland physical artefacts.Acoustic holography has shown its capability as Mixed-Reality (MR) displays in providing five modalities and its potential as a new computational fabrication technique that allows multi-material and multi-resolution 3D printing. However, due to computational limitations, such endeavours have been limited to one-modality at a time or one-off carefully orchestrated examples of combinations, and no holographic 3D fabrication has been demonstrated. A serious limitation in current approaches is in real-time computation of the sound fields that account for sound scatterings. This limitation is hindering our ability to make full use of the power of acoustic holography to create the plethora of applications that are ripe for exploitation.In this proposal, we will develop a real-time form-factor-agnostic sound field computation and explore optimum form factor to maximize users' multimodal experiences through several prototyping of interactive applications. The prototype applications will not only demonstrate the ability of acoustic holography to create magical experiences but will also provide easy-to-use tools for the community to integrate such systems in real-world applications. We will create an interactive application that blurs the boundary between displays and 3D printing where users can instantly 3D print physical prototypes and integrate them in an MR environment while going back-and-forth between 3D printing and MR-exploration.