RI: Toward Shape from Specular Reflections under Real-world Illumination

RI：现实世界照明下镜面反射的形状

• 批准号: 0712956
• 负责人: Todd Zickler
• 金额: $ 38万
• 依托单位: Harvard University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-09-01 至 2011-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0712956&HistoricalAwards=false
• 关键词: RI; Toward; Shape; Specular; Reflections

Proposal 0712956 PI: Todd ZicklerInstitution: Harvard UniversityTitle: RI: Toward Shape from Specular Reflections under Real-world IlluminationAbstract:The recovery of shape information from image data is a central problem in computer vision, and decades of research have led to the development of computational tools for inferring shape from a variety of visual cues, including shading, texture, color, and shadows. An important visual cue for shape is specular reflection. Specular(mirror-like) surfaces are abundant in both natural and man-made environments. Metal, glass, the wavy surface of a pond, and glazed ceramics are a few examples. Specular surfaces reflect incident light toward an observer without attenuation, and when they are curved, they present a distorted version of their illumination environment that contains very rich information about their shape. While perceptual studies suggest that humans make use of this visual cue, the underlying mechanisms are not yet known, and computational tools for inferring shape from specular reflections under real-world illumination do not yet exist. Instead, due to the complexity of the relationship between a specular shape and its images, previous analysis has been limited to controlled, unnatural environments and/or very limited types of surfaces. This proposal moves in a fundamentally different direction by specifically considering arbitrary smooth surfaces in uncontrolled, real-world illumination conditions. This seemingly difficult task is made manageable by a novel approach with two key components: 1) the consideration of far-field illumination environments in which the environment-surface distance is large relative to the relief of the surface; and 2) the analysis of ``specular flow''---the dense motion field on the image plane that is induced by the relative movement between a specular surface and its environment. This approach provides a unique balance between tractability and practical validity, and it may be a pivotal step in furthering our understanding of a powerful visual cue.Progress reports for this project will be regularly updated at http:\\www.eecs.harvard.edu\~zickler

摘要：从图像数据中恢复形状信息是计算机视觉中的一个核心问题，几十年的研究已经导致了从各种视觉线索（包括阴影、纹理、颜色和阴影）推断形状的计算工具的发展。形状的一个重要视觉线索是镜面反射。镜面（镜面）表面在自然和人造环境中都很丰富。金属、玻璃、池塘的波浪形表面和釉面陶瓷就是其中的几个例子。镜面将入射光反射到观察者身上而没有衰减，当它们弯曲时，它们呈现出一种扭曲的照明环境，其中包含有关其形状的非常丰富的信息。虽然知觉研究表明人类利用这种视觉线索，但潜在的机制尚不清楚，并且在现实世界照明下从镜面反射推断形状的计算工具尚不存在。相反，由于镜面形状与其图像之间关系的复杂性，先前的分析仅限于受控的、非自然的环境和/或非常有限类型的表面。这个提议在一个完全不同的方向上移动，特别考虑了在不受控制的现实世界照明条件下的任意光滑表面。这一看似困难的任务通过一种具有两个关键组成部分的新方法变得易于管理：1)考虑远场照明环境，其中环境-表面距离相对于表面的起伏较大；2)“镜面流”的分析——镜面与环境之间的相对运动引起的像面上的密集运动场。这种方法在可处理性和实际有效性之间提供了一种独特的平衡，它可能是进一步加深我们对强大视觉线索的理解的关键一步。该项目的进度报告将定期更新在http:\\www.eecs.harvard.edu\~zickler