CAREER: Precomputing Data-driven Deformable Systems for Multimodal Interactive Simulation

变形现象是我们生活中丰富而不可或缺的一部分；它影响我们的外表（如皮肤、头发）、我们发出的声音（如衣服、声带）、大自然的美（如风中的森林）和重要的决定（如医疗计划）。变形建模已经取得了巨大的进步，但我们仍然需要越来越现实的几何和动态复杂性水平。变形在虚拟环境的多模态反馈中也起着重要作用：使用触觉界面感受接触力，看到具有阴影和相互反射的真实变形外观，以及听到接触声音。不仅需要高速率的精确变形，而且现象也可能非常复杂。考虑到实时交互性和复杂大规模仿真的冲突需求，一种合乎逻辑的算法策略是尽可能提前完成更多的工作。利用大规模的预计算和数据驱动的制表很有吸引力，但如何做到这一点，以及在多大程度上做到这一点，对大多数非线性系统来说仍然是一个谜。尽管如此，初步证据表明，潜在的预计算速度很容易达到一百万倍。通过研究今天的预计算技术，我们可以在未来的超级计算机上利用百万倍的速度进行多模态模拟。我们的科学目标是了解如何系统地预计算，模拟和体验大规模非线性可变形系统的数据驱动模型。我们通过三种方式实现这些目标：(1)基于简化坐标表示的数据驱动可变形模型的预计算技术；(2)可变形的复杂运动数据库，用于实时“回放”；(3)交互仿真的多模态方面，包括接触力的触觉渲染、数据驱动的可变形声音模型和预先计算的可变形物体外观模型。我们的研究是由现实世界的应用驱动的，并将在交互式计算机动画，虚拟医学，机器人和制造以及大规模自然环境模拟的广泛背景下进行探索。

James, DougCarnegie Mellon UniversityCCF-0347740Deformation phenomena are a rich and integral part of our lives; it affects our appearance (e.g., skin, hair), the sounds we make (e.g., clothing, vocal cords), beauty in nature (e.g., a forest blowing in the wind), and important decisions (e.g., medical planning). Deformation modeling has made enormous progress, but we still desire increasingly realistic levels of geometric and dynamic complexity. Deformation also plays an important role in multimodal feedback for virtual environments: feeling contact forces using haptic interfaces, seeing realistic deformable appearances with shadows and interreflections, and hearing contact sounds. Not only are accurate deformations required at high rates, but the phenomena can also be extremely complex.Given the conflicting demands of real-time interactivity and complex large-scale simulation, one logical algorithmic strategy is to do as much work ahead of time as possible. Exploiting massive precomputation and data-driven tabulation is appealing, but how this can be done, and to what extent, remains a mystery for most nonlinear systems. Nevertheless, preliminary evidence suggests that potential precomputation speedups are easily a million-fold. By researching precomputation techniques today, we stand to exploit million-fold speedups for multimodal simulation on supercomputers of tomorrow.Our scientific objective is to understand how to systematically precompute, simulate and experience data-driven models of large-scale nonlinear deformable systems. We address these goals in three ways: (1) precomputation techniques for data-driven deformable models based on reduced coordinate representations; (2) deformable motion databases of complex motions for real-time ``playback;'' (3) multimodal aspects of interactive simulation, including haptic rendering of contact forces, data-driven deformable sound models, and precomputed deformable object appearance models. Our research is driven by real-world applications, and will be explored in the broad context of interactive computer animation, virtual medicine, robotics and manufacturing, and simulation of large-scale natural environments.