Material and shape perception based on two types of intensity gradient information.
Material and shape perception based on two types of intensity gradient information.
复制标题
DOI：
10.1371/journal.pcbi.1006061
复制
发表时间：
2018-04
影响因子：
4.3
通讯作者：
Nishida S
中科院分区：
文献类型：
--
作者：
Sawayama M;Nishida S
从单个图像中对物体的材料和形状进行视觉估计包括一个困难的病态计算问题。然而，在我们的日常生活中，我们觉得我们可以合理地估计两者。这种能力背后的神经计算仍然知之甚少。在这里，我们提出人类视觉系统使用物体图像的不同方面来分别估计材料和形状的贡献。其中，材料感知主要依赖于强度梯度大小信息，形状感知主要依赖于强度梯度顺序信息。对亮度直方图操作的观察为这一假设提供了线索，该操作改变了亮度梯度的大小，而不是亮度阶图，有效地改变了材料的外观，而不是物体的形状。与这一观察结果一致，我们发现模拟的物理材料变化对强度顺序信息没有显著影响。一系列的心理物理实验进一步表明，只要不干扰强度顺序信息，人类表面形状感知对强度操纵具有鲁棒性。此外，我们还证明了这两种梯度信息可以用于高光反照率变化的判别。这些发现表明，视觉系统依赖于这些诊断图像特征来估计远端世界的物理特性。我们视觉世界中的物体包含着各种各样的物质信息。虽然这些信息使我们能够体验到丰富的物质印象，但它可能会分散我们对其他物理特性的估计，如形状、反照率和光照。我们人类在日常情况下对这些特性的耦合估计是视觉神经科学的基本谜团之一。在这里，我们展示了材料和形状感知依赖于两种不同类型的强度梯度信息。具体而言，我们的图像分析和心理物理实验表明，人类的物质感知主要依赖于强度梯度大小信息，而形状感知主要依赖于强度梯度顺序信息。此外，我们还证明了强度顺序信息可以用于区分物体表面的反照率变化和其他物理性质（包括镜面高光）。
Visual estimation of the material and shape of an object from a single image includes a hard ill-posed computational problem. However, in our daily life we feel we can estimate both reasonably well. The neural computation underlying this ability remains poorly understood. Here we propose that the human visual system uses different aspects of object images to separately estimate the contributions of the material and shape. Specifically, material perception relies mainly on the intensity gradient magnitude information, while shape perception relies mainly on the intensity gradient order information. A clue to this hypothesis was provided by the observation that luminance-histogram manipulation, which changes luminance gradient magnitudes but not the luminance-order map, effectively alters the material appearance but not the shape of an object. In agreement with this observation, we found that the simulated physical material changes do not significantly affect the intensity order information. A series of psychophysical experiments further indicate that human surface shape perception is robust against intensity manipulations provided they do not disturb the intensity order information. In addition, we show that the two types of gradient information can be utilized for the discrimination of albedo changes from highlights. These findings suggest that the visual system relies on these diagnostic image features to estimate physical properties in a distal world. Objects in our visual world contain a variety of material information. Although such information enables us to experience rich material impressions, it can be a distraction for the estimation of other physical properties such as shapes, albedos, and illuminations. The coupled estimation of these properties we humans perform in daily situations is one of the fundamental mysteries in visual neuroscience. Here, we show that material and shape perception depend on two different types of intensity gradient information. Specifically, our image analyses and psychophysical experiments show that a human’s material perception relies mainly on the intensity gradient magnitude information, while shape perception relies mainly on the intensity gradient order information. In addition, we show that the intensity order information can be utilized for discriminating albedo changes on an object surface from other physical properties including specular highlights.
登录
查看更多内容
影响因子：
6.2
作者：
Bell, Sean;Bala, Kavita;Snavely, Noah
通讯作者：
Snavely, Noah
影响因子：
1.8
作者：
Debevec, P
通讯作者：
Debevec, P
影响因子：
19.5
作者：
Belhumeur, PN;Kriegman, DJ;Yuille, AL
通讯作者：
Yuille, AL
影响因子：
1.8
作者：
Fleming, RW;Torralba, A;Adelson, EH
通讯作者：
Adelson, EH
影响因子：
1.9
作者：
Koenderink J;van Doorn A;Wagemans J
通讯作者：
Wagemans J