Foundations of digital sketch processing

数字草图处理基础

• 批准号: 571419-2021
• 负责人: Bessmeltsev, Mikhail
• 金额: $ 3.27万
• 依托单位: Université de Montréal
• 依托单位国家: 加拿大
• 项目类别: Alliance Grants
• 财政年份: 2021
• 资助国家: 加拿大
• 起止时间: 2021-01-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=728983
• 关键词: Foundations; digital; sketch; processing

Sketching, or drawing of curved strokes on a flat surface, is a natural way to communicate shapes. Experts and amateurs alike ubiquitously employ sketches to depict both real and virtual content, including characters, machinery, molecules, and abstract shapes. As such sketches serve as both an art form and a medium for inter-human shape communication, and offer an avenue to communicate shapes between human users and computer systems. Existing systems for sketch processing are not capable of processing complex, imprecise sketches instead typically targeting clean drawings.The long-term goal of our research is to develop digital sketch processing algorithms that will form the foundation of future robust sketch processing systems for 2D/3D content creation. In pursuing that goal, we will take a two-pronged approach serving two targets: We will create algorithms and systems viewing 1)Sketches as an Art Form, i.e. assisting humans in improving the quality of the sketches they draw, and 2) Sketches as Shape Representation, i.e. enabling humans to use sketches for human-computer communication. 1.Sketch As Art Form. In our first line of research, we will develop algorithms assisting humans to improve their sketches, creating digital art. We will algorithmically improve clarity, aesthetics, and expressivity of human drawn content,leveraging the perceptual principles from artistic literature and human perception theories,e.g. Gestalt psychology. In particular, we will create a style-independent sketch consolidation based on sub-stroke analysis and region extraction. We will develop algorithms to colorize and shade sketches. 2.Sketch As Shape Representation. In our second line of research, we will facilitate human-computer communication via sketches,i.e. using sketches to communicate 2D/3D shapes to content creation systems. We will address the fundamental causes of instabilities of modern systems using sketches, enabling more robust systems for 2D cartoon animation and 3D content modeling via sketches. We will develop the geometry processing toolkit viewing rough sketch as an approximate depiction of the underlying geometry, similar to how point clouds or meshes approximate an underlying surface. We'll use Boundary Element Methods to discretize Laplacian operator on sketches, enabling state-of-the-art Laplacian-based methods to deform or find correspondences between geometries for future morphing and inbetweening systems. We will analyse human inaccuracies when drawing sketches and create algortihms inferring drawing topology from a rough sketch. This will enable topology-sensitive systems (e.g sketch-based modeling) to correctly interpret complex natural sketches. We'll use sketches as etchings to convey textures/shading/shadows, fur/hair, to surfaces.The PIs are uniquely positioned for this research: it requires expertise of perception-based research and optimization (Prof.Sheffer), in mathematics/discrete differential geometry (Prof.Bessmeltsev), and in rendering,shading,texturing (Prof. Poulin). Both Profs.Sheffer and Bessmeltsev have an extensive publication record in sketch processing/modeling, including 5 shared publications, Profs.Sheffer and Poulin shared 1 paper on volume modeling.Tangible outcome will be algorithms and systems in the area of applications required by Canadian, in particular Quebec, film/animation/gaming and manufacturing industries, where content creation is one of the main time-consuming and laborious tasks. We will facilitate more robust and efficient content creation systems using sketches, allowing artists and designers to focus their time on creative tasks.

草图或在平面上绘制弯曲笔画是传达形状的自然方式。专家和业余爱好者都普遍使用草图来描绘真实和虚拟的内容，包括人物、机械、分子和抽象形状。因此，草图既是一种艺术形式，又是人际形状交流的媒介，并提供了人类用户和计算机系统之间交流形状的途径。现有的草图处理系统无法处理复杂、不精确的草图，而通常针对干净的绘图。我们研究的长期目标是开发数字草图处理算法，该算法将为未来用于 2D/3D 内容创建的强大草图处理系统奠定基础。为了实现这一目标，我们将采取双管齐下的方法来实现两个目标：我们将创建算法和系统，将草图视为一种艺术形式，即帮助人类提高其绘制草图的质量，以及 2) 将草图视为形状表示，即使人类能够使用草图进行人机通信。 1.素描作为艺术形式。在我们的第一线研究中，我们将开发算法来帮助人类改进他们的草图，创造数字艺术。我们将利用艺术文献和人类感知理论的感知原理，通过算法提高人类绘制内容的清晰度、美观性和表现力。格式塔心理学。特别是，我们将基于子笔划分析和区域提取创建与样式无关的草图合并。我们将开发算法来对草图进行着色和着色。 2.草图作为形状表示。在我们的第二个研究领域，我们将通过草图促进人机通信，即使用草图将 2D/3D 形状传达给内容创建系统。我们将使用草图解决现代系统不稳定的根本原因，从而为 2D 卡通动画和通过草图进行 3D 内容建模提供更强大的系统。我们将开发几何处理工具包，将粗略草图视为底层几何图形的近似描述，类似于点云或网格如何近似底层表面。我们将使用边界元方法来离散草图上的拉普拉斯算子，使最先进的基于拉普拉斯的方法能够变形或找到未来变形和中间系统的几何图形之间的对应关系。我们将分析绘制草图时人类的不准确性，并创建从草图推断绘图拓扑的算法。这将使拓扑敏感系统（例如基于草图的建模）能够正确解释复杂的自然草图。我们将使用草图作为蚀刻来将纹理/阴影/阴影、毛皮/头发传达到表面。PI 对于这项研究有着独特的定位：它需要基于感知的研究和优化（Sheffer 教授）、数学/离散微分几何（Bessmeltsev 教授）以及渲染、着色、纹理（Poulin 教授）方面的专业知识。 Sheffer教授和Bessmeltsev教授在草图处理/建模方面都有广泛的发表记录，包括5篇共享出版物，Sheffer教授和Poulin教授共享了1篇关于体积建模的论文。切实的成果将是加拿大，特别是魁北克省，电影/动画/游戏和制造业所需的应用领域的算法和系统，其中内容创建是主要耗时和费力的任务之一。我们将使用草图促进更强大、更高效的内容创建系统，使艺术家和设计师能够将时间集中在创意任务上。