Perception of three-dimensional shape from texture is based on patterns of oriented energy
Perception of three-dimensional shape from texture is based on patterns of oriented energy
复制标题
DOI：
10.1016/s0042-6989(99)00169-8
复制
发表时间：
2000-01-01
期刊：
影响因子：
1.8
通讯作者：
Zaidi, Q
中科院分区：
文献类型：
--
作者：
Li, A;Zaidi, Q
本文提出了一种新的从单目纹理线索推断三维形状的观察者模型的经验支持。通过测量观察者从二维投影图像中估计沿纹理表面的相对三维曲率的能力，并同时检查不同纹理图案在投影图像中发生的局部光谱变化，我们发现沿对应于表面最大和最小曲率的直线的定向能量的相关变化对于传达表面的三维形状至关重要。沿这些最大和最小曲率线的能量可用于计算局部曲面片的方向。由简单和复杂的正弦栅格和格子组成的纹理图案以及过滤后的噪声被绘制到一个表面上，该表面围绕水平轴深度为正弦波纹，并在透视投影到图像平面上。在波纹的12个不同阶段，通过测量中心固定点周围的局部序数深度来重建感知的相对表面曲率。我们的结果表明：(1)为了提取表面的形状，识别单个纹理元素或纹理梯度既不必要也不充分；(2)一维调频不足以传输复杂的三维形状。(3)只有当投影图案包含沿与曲面最大曲率的投影线相对应的线的定向能量变化时，才能看到垂直有序深度。(4)对于沿水平轴深度为波纹的表面，这种定向能量图案来自于预波纹图案的全局傅里叶变换中沿垂直方向的能量。(5)跨最小曲率的线的局部方向变化对于传递形状也可能是至关重要的。(6)在平行投影中，这些沿最大曲率线和最小曲率线的相关取向变化完全消失。因此，如果图像是透视投影，则纹理是形状的有用提示。(7)只有某些自然纹理会提供足够的单目线索来支持真实的形状推断，这可以从它们的全局傅立叶变换中预测出来。(C)2000爱思唯尔科学有限公司。保留所有权利。
This paper presents empirical support for a new observer model of inferring three-dimensional shape from monocular texture cues. By measuring observers' abilities to estimate the relative three-dimensional curvature along a textured surface from two-dimensional projected images, and concurrently examining the local spectral changes occurring in the projected image for various texture patterns, we have found that correlated changes in oriented energy along lines corresponding to the lines of maximum and minimum curvature of the surface are crucial for conveying the three-dimensional shape of the surface. Energy along these lines of maximum and minimum curvature can be used to compute the orientation of local surface patches. Texture patterns consisting of simple and complex sinusoidal gratings and plaids, and filtered noise were drawn onto a surface that was corrugated sinusoidally in depth about the horizontal axis and projected in perspective onto an image plane. The perceived relative surface curvature was reconstructed from measurements of local ordinal depth around a central fixation point at 12 different phases of the corrugation. Our results show that: (1) it is neither necessary nor sufficient to identify individual texture elements or texture gradients in order to extract the shape of the surface; (2) one-dimensional frequency modulation is insufficient for conveying complex three-dimensional shape. (3) Veridical ordinal depth is seen only when the projected pattern contains changes in oriented energy along lines corresponding to projected lines of maximum curvature of the surface. (4) For a surface corrugated in depth about the horizontal axis, this pattern of oriented energy arises from energy along the vertical direction in the global Fourier transform of the pre-corrugated pattern. (5) Local orientation changes across lines of minimum curvature can be also critical for conveying shape. (6) These correlated orientation changes along lines of maximum and minimum curvature are entirely lost in parallel projection. Hence texture is a useful cue for shape if the image is a perspective projection. (7) Only some natural textures will provide sufficient monocular cues to support veridical shape inferences, and this can be predicted from their global Fourier transforms. (C) 2000 Elsevier Science Ltd. All rights reserved.