A unified volumetric surface representation for 3D imaging and modeling towards efficient integration of geometry and appearance properties

我们对计算机视觉感兴趣，因为它是对物体的3D形状和外观的解释过程。该过程从一组图像中构建3D模型，即物体表面的几何表示，并以其外观进行增强。与人类能够在连续的过程中集成图像一样，我们的研究目标是开发集成传感器、算法的智能视觉系统，特别是适合于表面属性的增量恢复的表示。近年来，我们提出了一种新的基于矢量场的体积表示法来描述曲面几何。建议探索该表示法的全部潜力，以集成几何和外观这两个紧密耦合的属性。在无法精确恢复几何图形的情况下，我们探索了一种新的方法，该方法基于光场，并基于旨在提高对象视觉模拟质量的标准，在体积内自适应估计的曲面几何图形。这项研究介于计算机视觉、近景摄影测量和计算机图形学之间。因此，生产的3D模型被用于许多应用领域，包括工业设计、检测、快速原型制作、模拟、遗产文献、多媒体和艺术、生物测量学和安全等。拟议的研究将为准备下一次信息革命提供必要的工具：共享虚拟世界。加拿大目前在3D成像和建模技术方面处于领先地位。开发一种结合几何和外观的统一建模方法将加强加拿大的地位。

We are interested in computer vision as an interpretation process of the 3D shape and appearance of objects. From a set of images, the process builds a 3D model, i.e. a geometric representation of objects' surface augmented with its appearance. Similar to the human being who can integrate images in a continuous process, our research aims at developing intelligent vision systems integrating sensors, algorithms and especially, a representation that is suited to the incremental recovery of surface properties. In recent years, we have proposed a new volumetric representation based on vector fields to describe surface geometry. It is proposed to explore the full potential of that representation for integrating these two tightly coupled properties of geometry and appearance.    When geometry cannot be recovered precisely, we explore a new approach that is based on light fields and which adapts the estimated surface geometry within the volume, based on a criterion aiming at improving the quality of the visual simulation of an object. This research lies at the boundaries between computer vision, close-range photogrammetry and computer graphics.    The produced 3D models are used in numerous application fields including industrial design, inspection, rapid prototyping, simulation, heritage documentation, multimedia and arts, biometry and security to name a few. The proposed research will provide the necessary tools for preparing the next information revolution: sharing a virtualized world. Canada is currently among the top leaders in 3D imaging and modeling technologies. Developing a unified modeling approach combining geometry and appearance will reinforce Canada's position.