Mental Canvas: Exploring the Middle Ground Between Sketch and Object

心理画布：探索素描和物体之间的中间地带

• 批准号: 0738472
• 负责人: Julie Dorsey
• 金额: $ 7.53万
• 依托单位: Yale University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-07-01 至 2008-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0738472&HistoricalAwards=false
• 关键词: Mental; Canvas; Exploring; Middle; Ground

The goal of this project is to develop an alternative technique for designing new objects using sketches and photographs; the particular application to be explored is architectural design. Rather than a "top down" approach, defining large masses in 3D and refining and decorating these masses, designs will be developed from sketches and photographs of varying levels of detail arranged by the user in a 3D environment. Unlike any current design system, the sketches and images do not need to represent geometrically- consistent representations of the structure during the design phase. The designer can experiment with different variations in form and detail in a view without struggling with a system that automatically changes other views. This freedom is made possible by representing the design as strokes and pixels only. The system will allow the user to tour the 2D sketches and photographs in a manner that lets the model emerge by the fusion of images by the user's own visual system.After the design is refined by multiple iterations of sketches that converge to a nearly consistent representation, computer vision techniques could be used to extract a 3D model from the users input. The advantage of the approach is that the user works in a familiar 2D mode for defining details, without the limitations and time delays of a full 3D model being defined at each step in the process.Intellectual Merit: In exploring the middle ground between sketch and object, the proposed work addresses one of the "holy grail" problems in interactive 3D graphics how to move seamlessly between 2D and 3D. This investigation will advance the understanding of how humans conceive of and design geometric form (including the abstraction of form and simplification of complex problems), an activity that shapes most of the objects with which we live and work. This understanding includes not only a computer graphics perspective (algorithms and representations) but also an architectural perspective, where practitioners have a deep working knowledge of form creation but lack a computational or mathematical background to rigorously analyze and describe it.Broader Impacts: The proposed work will have a direct impact on the creative design process by offering a novel approach for creating and editing 3D form, and will also impact the communication of ideas, where 2D representation has largely dominated. This work crosses and links disciplines, not only computer graphics and architecture, but other research areas related to how humans think (such as computer vision, cognitive science, psychology) and build (industrial design, civil engineering, mechanical engineering). The PI's close relationship with faculty, students, and practitioners at the Yale School of Architecture will provide opportunity to explore and test the new approach through application to real design problems.

该项目的目标是开发一种替代技术，用于使用草图和照片设计新对象;要探索的特定应用是建筑设计。而不是一个“自上而下”的方法，定义在3D和精炼和装饰这些群众大质量，设计将开发从草图和照片的不同层次的细节，由用户在3D环境中安排。与任何当前的设计系统不同，草图和图像在设计阶段不需要表示结构的几何一致的表示。设计人员可以在视图中尝试不同的形式和细节变化，而不必费力于自动更改其他视图的系统。这种自由是通过将设计仅表示为笔划和像素来实现的。该系统将允许用户浏览2D草图和照片，让用户自己的视觉系统通过融合图像来呈现模型。在设计通过草图的多次迭代收敛到几乎一致的表示之后，可以使用计算机视觉技术从用户输入中提取3D模型。该方法的优点是，用户在一个熟悉的2D模式定义的细节，没有限制和时间延迟的一个完整的3D模型被定义在每一个步骤中的process.Intellectual优点：在探索之间的中间地带草图和对象，建议的工作解决了一个“圣杯”的问题，在交互式3D图形如何在2D和3D之间无缝移动。这项调查将促进对人类如何构思和设计几何形状（包括形式的抽象和复杂问题的简化）的理解，这一活动塑造了我们生活和工作的大多数物体。这种理解不仅包括计算机图形学的视角（算法和表示），但也是一个建筑的角度，其中从业者有深刻的工作知识的形式创造，但缺乏计算或数学背景，严格分析和描述它。拟议的工作将通过提供一种新的方法来创建和编辑3D形式，也将影响思想的交流，其中2D表示在很大程度上占主导地位。这项工作跨越和链接学科，不仅是计算机图形学和建筑学，还涉及与人类如何思考（如计算机视觉，认知科学，心理学）和构建（工业设计，土木工程，机械工程）相关的其他研究领域。PI与耶鲁大学建筑学院的教师、学生和实践者的密切关系将提供机会，通过应用于真实的设计问题来探索和测试新方法。