EAGER: Minimal 3D Modeling Methodology

建模与设计是计算机图形学和计算机视觉研究与应用的核心组成部分。传统的建模包括让设计师提供所需虚拟对象的详细（数字）规范或物理对象的足够照片，以实现多视图立体重建，尽管现代基于gui的工具可以帮助减少所需照片的数量。数字素描工具为对象建模提供了另一种机制，但是即使其中一些工具试图通过完成部分草图来帮助用户，仍然需要显着的努力来获得详细的结果。这个项目将探索解决以下问题的建模方法：我们至少可以设计出什么，并且仍然可以获得一个充分表达的系统？在一种极端情况下，数字建模工具支持高表达性，但需要很高的设计工作，而在另一种极端情况下，提供一组固定的模型模板，只需要很少的设计工作，但也会导致低模型表达性。最近的一些努力，比如PI从草图到程序建模的工作，就处于中间位置。当前研究的目标是确定设计和表达性之间的最佳平衡点，即足够的设计努力产生足够表达的模型。这项多学科工作的重点将放在计算考古学上，这是一个有趣的应用程序，只有碎片化的信息可用，因此，该方法在该领域的成功将意味着项目成果在其他领域的广泛推广。文献中已经证实，我们所感知到的只有一小部分足以让一个人在脑海中创造出一个物体的3D表征。考虑到这一观察结果，该项目将建立并扩展PI现有的照片到3D建模工具，通过添加新的极简主义机器学习基础，应用于城市和考古建模和设计，构建只需用户输入足够的软件，并能够为预期目标生成足够完整的3D模型。将探索各种降低输入细节和分析模型输出如何受到影响的方法，以确定最有希望保持和提高鲁棒性的方法。来自土耳其南部海岸达纳岛和博格萨克岛两个古代定居点考古遗址的大约1tb的图像和点云数据将作为测试平台。这些岛屿的结构使用当地采石场的材料建造，是古代城市景观的主要类型，但由于规模、复杂性、地形和不完整，难以研究。尽管如此，基于无人机的空中成像和激光雷达是可能的。该研究将调查在设计过程中必须指定多少，以区分可能的形式及其参数，以表达期望的输出。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Modeling and design are core components of computer graphics and computer vision research and applications. Traditional modeling consists of having the designer provide either a detailed (digital) specification of the desired virtual object or sufficient photographs of a physical object to enable a multi-view stereo reconstruction, although modern GUI-based tools can help reduce to a certain extent the number of photographs required. Digital sketching tools provide an alternative mechanism for modeling objects, but even though some of these try to assist the user by completing partial sketches a notable effort is still required to achieve detailed results. This project will explore a modeling methodology that addresses the following question: What is the least we can design and still obtain a sufficiently expressive system? At one extreme digital modeling tools support high expressivity but require high design effort, while at the other extreme providing a fixed set of model templates incurs very low design effort but results in low model expressivity as well. Some recent efforts, such as the PI's sketch-to-procedural-modeling work, fall somewhere in the middle. The goal of the current research is to determine the point of optimum balance between design and expressivity, that is just enough design effort to produce a sufficiently expressive model. The focus of this multi-disciplinary work will be on computational archaeology, an interesting application where only fragmented information is available, hence success of the approach in this domain will imply broad generalizability of project outcomes to other areas as well.It has been established in the literature that only a fraction of what we perceive suffices for a person to create a mental 3D representation of an object. With this observation in mind, the project will build upon and extend the PI's existing photograph-to-3D modeling tool by adding new minimalist machine learning underpinnings applied to urban and archaeological modeling and design, to build software that requests just enough input from the user and is able to produce 3D models of sufficient completeness for the intended goal. Various ways of degrading the input detail and analyzing how the model output is affected will be explored to identify the most promising for retention and improvement of robustness. About a terabyte of imagery and point cloud data from two archaeological sites of ancient settlements on the islands of Dana and Bogsak along the southern coast of Turkey will serve as a testbed. These islands have structures built using material from local stone quarries and are a main type of urban landscape to survive from antiquity but are difficult to study due to size, complexity, terrain, and incompleteness. Nonetheless, aerial drone-based imagery and LIDAR are possible. The research will investigate how much must be specified during design to differentiate among the possible forms and their parameters to express a desired output.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.