Physics-based models for early vision by machine
Physics-based models for early vision by machine
复制标题
基于物理的机器早期视觉模型
DOI：
10.1117/12.19714
复制
发表时间：
1990
期刊：
影响因子：
--
通讯作者：
C. Novak
中科院分区：
文献类型：
--
作者：
S. Shafer;T. Kanade;G. Klinker;C. Novak
对机器和人类的早期（低级）视觉、牙齿的研究，
传统上是基于对理想化图像或图像块的研究，例如阶跃边缘、光栅、平场和蒙德里安。然而，真实的图像表现出更丰富和更复杂的结构，其性质由照明、反射和成像的物理和几何性质决定。通过理解这些物理关系，一种新的早期视力分析成为可能。在本文中，我们描述了成像物理模型的进展，提出了一个更复杂和现实的一组图像的关系比通常假设在早期的视觉研究。我们开始从二色反射模型开始，该模型描述了塑料和涂漆表面等电介质图像中高光和颜色的相关性。这就产生了颜色空间中的数学关系，以将高光与对象颜色分离。形状、表面粗糙度/纹理和照明颜色的感知很容易从这种分析中得出。接下来，我们将展示如何通过从基本模型导出局部颜色变化关系来将其扩展到多个对象的图像。所得到的彩色图像分析方法已成功地应用于我们实验室的机器视觉实验。另一个扩展是考虑多个对象之间的相互反射。
我们已经推导出一个简单的颜色互反射模型，解释了基本现象，并报告了这个模型以及我们如何应用它。一般来说，视觉照明的概念应该考虑整个“照明环境”，而不是局限于单个光源。这项工作表明，基本的物理关系产生了非常结构化的图像属性，这可能是一个更有效的基础，早期视觉比传统的理想化的图像模式。
Research in early (low-level) vision, tooth for machines and humans, has
traditionally been based on the study of idealized images or image patches such as step edges, gratings, flat fields, and Mondrians. Real images, however, exhibit much richer and more complex structure, whose nature is determined by the physical and geometric properties of illumination, reflection, and imaging. By understanding these physical relationships, a new kind of early vision analysis is made possible. In this paper, we describe a progression of models of imaging physics that present a much more complex and realistic set of image relationships than are commonly assumed in early vision research. We begin with the Dichromatic Reflection Model, which describes how highlights and color are related in images of dielectrics such as plastic and painted surfaces. This gives rise to a mathematical relationship in color space to separate highlights from object color. Perceptions of shape, surface roughness/texture, and illumination color are readily derived from this analysis. We next show how this can be extended to images of several objects, by deriving local color variation relationships from the basic model. The resulting method for color image analysis has been successfully applied in machine vision experiments in our laboratory. Yet another extension is to account for inter-reflection among multiple objects.
We have derived a simple model of color inter-reflection that accounts for the basic phenomena, and report on this model and how we are applying it. In general, the concept of illumination for vision should account for the entire "illumination environment", rather than being restricted to a single light source. This work shows that the basic physical relationships give rise to very structured image properties, which can be a more valid basis for early vision than the traditional idealized image patterns.