ITR/ASE: 3D Sketching for Conceptual Visualization, Simulation, and Learning

基于草图的界面在概念工程设计中的巨大潜力得到了广泛的认可和广泛的追求，但这些系统的实际应用仍然有限，因为它们是二维的，不体现功能。PI之前已经展示了基于统计机器学习的算法，该算法允许直接从2D徒手画中重建3D对象。通过将这项工作与最近的大众市场笔式硬件进行扩展和结合，PI将在该项目中为几何密集型领域的快速可视化、模拟和学习创造新的概念设计工具的基础。将探索一种新的写生形式，在交互时间中，素描本身在空间上被重构，然后可以进行物理模拟，PI称之为“现场素描”。PI的系统将使用户能够快速直观地构建复杂的3D模型，分析它们，在绘制草图时改变视点，并更容易地与其他设计师就空间概念进行沟通和协作。为此，PI将首先通过上下文敏感性和时间场景分割扩展他的重建算法，以便他们可以处理比目前可能的更复杂的几何形状，包括曲面。然后，这项工作将与各种学科的现有仿真和分析代码相结合，并将集成到一个原型平台中，允许通过连续的分段草图，重建和交互式仿真来构建3D模型。由此产生的工具将从根本上改变工程师与设计系统的交互方式，将传统的计算机辅助工程和仿真工具结合在一起，使它们能够在关键的初步设计阶段更早地发挥作用。更广泛的影响：该项目的结果将对任何需要预测空间几何行为的设计领域产生积极影响，包括机械，土木，MEMS和建筑CAD的许多应用领域。通过消除界面障碍，实时素描还将使非工程设计人员、学生和教师更容易使用建模和仿真的工程工具。此外，PI还将开发并在线提供用于结构和运动学教学的实时素描应用程序，这将允许学生和教师通过绘制结构草图，施加载荷，并在绘制草图时实时查看所产生的机构轨迹，夸张变形和各种形状的彩色应力集中，来探索和演示桁架和实体结构的运动学和结构分析。这个项目将以开放源码的形式在网上提供，以便其他人可以根据需要将其他类型的模拟纳入其中。

The enormous potential of sketch-based interfaces for conceptual engineering design is widely recognized and has been broadly pursued, but the practical application of these systems has remained limited because they are two-dimensional and do not embody functionality. The PI has previously demonstrated algorithms based on statistical machine learning that allow reconstruction of a 3D object from a 2D freehand drawing directly. By extending and combining this work with recent mass-market pen-based hardware, the PI will in this project create the basis of new conceptual design tools for rapid visualization, simulation and learning for geometry-intensive domains. A new form of freehand sketching will be explored, in which the sketch itself is spatially reconstructed in interactive time and then can be physically simulated, a process the PI calls "live sketching." The PI's system will enable users to construct complex 3D models quickly and intuitively, to analyze them, to change viewpoints while sketching, and to communicate and collaborate on spatial concepts with other designers more easily. To this end, the PI will first extend his reconstruction algorithms through context sensitivity and temporal scene segmentation so they can handle more complex geometries than is currently possible, including curved surfaces. This effort will then be combined with existing simulation and analysis codes of various disciplines and will be integrated into a prototypical platform allowing construction of 3D models by successive piece-wise sketching, reconstruction, and interactive simulation. The resulting tools will fundamentally alter the way engineers interact with design systems, bringing together traditional computer-aided engineering and simulation tools so they can play a role much earlier in the critical preliminary design stages. Broader Impacts: The outcomes of this project will positively impact any design domain where it is necessary to predict the behavior of spatial geometries, including many application areas of mechanical, civil, MEMS, and architectural CAD. Live sketching will also make engineering tools for modeling and simulation much more accessible to non-engineering designers, students and teachers, by removing interface barriers. The PI will in addition develop and make available online a live sketch application for teaching structure and kinematics, which will allow students and teachers to explore and demonstrate kinematics and structural analysis of trusses and solid structures by sketching structures, applying loads, and seeing the resulting mechanism trajectories, exaggerated deformations, and colored stress concentration for various shapes, in real time while sketching. This project will be made available on-line in open-source format, so that additional types of simulation can be integrated into it by others as required.