A unified volumetric surface representation for 3D imaging and modeling towards efficient integration of geometry and appearance properties

我们对计算机视觉感兴趣，因为它是对物体的3D形状和外观的解释过程。从一组图像中，该过程构建3D模型，即对象表面的几何表示，其外观得到增强。与能够在连续过程中集成图像的人类类似，我们的研究旨在开发集成传感器，算法，特别是适合于表面特性增量恢复的表示的智能视觉系统。近年来，我们提出了一种新的基于矢量场的体表示来描述表面几何。建议探索的全部潜力，表示为整合这两个紧密耦合的几何和外观属性。 当几何形状不能被精确地恢复时，我们探索了一种新的方法，该方法基于光场，并根据旨在提高对象的视觉模拟质量的标准，在体积内调整估计的表面几何形状。该研究处于计算机视觉、近景摄影测量和计算机图形学之间的边界。 所产生的3D模型用于许多应用领域，包括工业设计、检测、快速原型制作、仿真、遗产文件、多媒体和艺术、生物统计学和安全等。拟议的研究将为准备下一次信息革命提供必要的工具：共享虚拟世界。加拿大目前是3D成像和建模技术的领先者之一。开发一种结合几何和外观的统一建模方法将加强加拿大的地位。

We are interested in computer vision as an interpretation process of the 3D shape and appearance of objects. From a set of images, the process builds a 3D model, i.e. a geometric representation of objects' surface augmented with its appearance. Similar to the human being who can integrate images in a continuous process, our research aims at developing intelligent vision systems integrating sensors, algorithms and especially, a representation that is suited to the incremental recovery of surface properties. In recent years, we have proposed a new volumetric representation based on vector fields to describe surface geometry. It is proposed to explore the full potential of that representation for integrating these two tightly coupled properties of geometry and appearance.    When geometry cannot be recovered precisely, we explore a new approach that is based on light fields and which adapts the estimated surface geometry within the volume, based on a criterion aiming at improving the quality of the visual simulation of an object. This research lies at the boundaries between computer vision, close-range photogrammetry and computer graphics.    The produced 3D models are used in numerous application fields including industrial design, inspection, rapid prototyping, simulation, heritage documentation, multimedia and arts, biometry and security to name a few. The proposed research will provide the necessary tools for preparing the next information revolution: sharing a virtualized world. Canada is currently among the top leaders in 3D imaging and modeling technologies. Developing a unified modeling approach combining geometry and appearance will reinforce Canada's position.