Computational Vision in Bad Weather

恶劣天气下的计算视觉

• 批准号: 9987979
• 负责人: Shree Nayar
• 金额: $ 33.57万
• 依托单位: Columbia University
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2000
• 资助国家: 美国
• 起止时间: 2000-07-01 至 2004-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=9987979&HistoricalAwards=false
• 关键词: Computational; Vision; Bad; Weather

Computational vision has made significant strides in the development of sensors and algorithms that recover scene properties from images. However, virtually all work in vision is based on the assumption that the observer is immersed in a transparent medium (air)and that the objects of interest are opaque. It is assumed that light rays reflected by the objects travel to the observer without attenuation or alteration. Therefore, existing vision sensors and algorithms have been created only to deal with clear weather. In practice, however, a vision system must reckon with the entire spectrum of atmospheric conditions commonly known as bad weather. It must continue to perform in the presence of a variety of conditions,including, haze, fog, rain, hail and snow.This proposal outlines a comprehensive research program geared towards the development of models and methods that can aid vision in bad weather. The first step is to understand the visual manifestations of different types of weather conditions. For this, we will draw on what is already known about the optics of the atmosphere. Since the atmosphere modulates the information carried from a scene point to the observer, it can be viewed as a mechanism of visual information coding. We propose the development of a general computational framework that exploits the brightness and color changes that are induced by bad weather. Based on this framework, we will develop models and methods for recovering pertinent scene properties such as true (clear weather) color and three-dimensional structure, from images taken under different (unknown) weather conditions. Such models and methods have obvious applications in scene understanding, autonomous navigation and video surveillance. In addition, we wish to create an extensive image/video database that captures the wide range of visual effects caused by weather. We believe that such a database will make it easier for researchers to study this important area of computational vision.

计算视觉在从图像中恢复场景属性的传感器和算法的开发方面取得了重大进展。然而，几乎所有的视觉工作都是基于这样的假设，即观察者沉浸在透明的介质(空气)中，而感兴趣的对象是不透明的。假设被物体反射的光线在没有衰减或改变的情况下传播到观察者。因此，现有的视觉传感器和算法仅用于应对晴朗的天气。然而，在实践中，视觉系统必须考虑到通常所说的恶劣天气的整个大气条件范围。它必须继续在各种条件下运行，包括雾霾、雾、雨、冰雹和雪。这项提案概述了一个全面的研究计划，旨在开发能够在恶劣天气下帮助视力的模型和方法。第一步是了解不同类型天气条件的视觉表现。为此，我们将利用已知的大气光学知识。由于大气对从场景点到观察者的信息进行调制，因此可以将其视为视觉信息编码的机制。我们建议开发一个通用的计算框架，该框架利用恶劣天气引起的亮度和颜色变化。基于这个框架，我们将开发模型和方法，从不同(未知)天气条件下拍摄的图像中恢复相关的场景属性，如真(晴朗天气)颜色和三维结构。这些模型和方法在场景理解、自主导航和视频监控等方面有着明显的应用。此外，我们希望创建一个广泛的图像/视频数据库，以捕捉天气造成的各种视觉效果。我们相信，这样的数据库将使研究人员更容易研究这一重要的计算视觉领域。