Representing and recognizing the visual appearance of materials using three-dimensional textons
Representing and recognizing the visual appearance of materials using three-dimensional textons
复制标题
DOI：
10.1023/a:1011126920638
复制
发表时间：
2001-01-01
影响因子：
19.5
通讯作者：
Malik, J
中科院分区：
文献类型：
--
作者：
Leung, T;Malik, J
我们研究基于纹理外观对由不同材料(如混凝土、地毯、大理石或皮革)制成的表面的识别。这种自然纹理产生于两个表面属性的空间变化：(1)反射率和(2)表面法线。在本文中，我们提供了一个统一的模型来处理自然纹理的这两个方面。其主要思想是构建一个具有相关局部几何和光度特性的原型微小曲面片的词汇表。我们称这些为3D文本。例子可以是脊、槽、斑点或条纹或它们的组合。与每个纹理相关联的是一个外观向量，它表征了不同光照和观察条件下的局部辐照度分布，表示为一组线性高斯导数滤波输出。给出一些(1到4)任何材料的图像，就可以使用这些文本来描述它。我们演示了该表示用于识别在新的照明和观察条件下观察到的材料。我们还说明了如何使用3D纹理模型来预测材料在新条件下的外观。
We study the recognition of surfaces made from different materials such as concrete, rug, marble, or leather on the basis of their textural appearance. Such natural textures arise from spatial variation of two surface attributes: (1) reflectance and (2) surface normal. In this paper, we provide a unified model to address both these aspects of natural texture. The main idea is to construct a vocabulary of prototype tiny surface patches with associated local geometric and photometric properties. We call these 3D textons. Examples might be ridges, grooves, spots or stripes or combinations thereof. Associated with each texton is an appearance vector, which characterizes the local irradiance distribution, represented as a set of linear Gaussian derivative filter outputs, under different lighting and viewing conditions.Given a large collection of images of different materials, a clustering approach is used to acquire a small (on the order of 100) 3D texton vocabulary. Given a few (1 to 4) images of any material, it can be characterized using these textons. We demonstrate the application of this representation for recognition of the material viewed under novel lighting and viewing conditions. We also illustrate how the 3D texton model can be used to predict the appearance of materials under novel conditions.