Single-Sensor RGB-NIR Imaging: High-Quality System Design and Prototype Implementation
Single-Sensor RGB-NIR Imaging: High-Quality System Design and Prototype Implementation
复制标题
DOI：
10.1109/jsen.2018.2876774
复制
发表时间：
2019-01-15
影响因子：
4.3
通讯作者：
Okutomi, Masatoshi
中科院分区：
文献类型：
--
作者：
Monno, Yusuke;Teranaka, Hayato;Okutomi, Masatoshi
近年来，已经提出了使用一组红-绿-蓝（RGB）和近红外（NIR）图像（也称为RGB-NIR图像）的许多应用。然而，RGB-NIR成像，即，RGB和NIR图像的同时采集仍然是一项费力的任务，因为现有的采集系统通常需要两个传感器或镜头。相比之下，使用由RGB和NIR像素的马赛克组成的RGB-NIR传感器的单传感器RGB-NIR成像提供了一种实用且低成本的单次RGB-NIR图像采集方式。在本文中，我们研究高品质的系统设计，单传感器RGB-NIR成像。我们首先提出了一个系统评估框架，使用一个新的高光谱图像数据集，我们构建。与现有的工作不同，我们的框架既考虑了RGB-NIR传感器的特性，又考虑了RGB-NIR成像管道。基于评价框架，我们设计了影响RGB-NIR成像质量的每个成像因素，并提出了性能最佳的系统设计。最后，我们提出了我们开发的原型RGB-NIR相机，这是基于最佳的系统设计实现的配置，并使用原型演示了几个潜在的应用。
In recent years, many applications using a set of red-green-blue (RGB) and near-infrared (NIR) images, also called an RGB-NIR image, have been proposed. However, RGB-NIR imaging, i.e., simultaneous acquisition of RGB and NIR images, is still a laborious task because existing acquisition systems typically require two sensors or shots. In contrast, single-sensor RGB-NIR imaging using an RGB-NIR sensor, which is composed of a mosaic of RGB and NIR pixels, provides a practical and lowcost way of one-shot RGB-NIR image acquisition. In this paper, we investigate high-quality system designs for single-sensor RGB-NIR imaging. We first present a system evaluation framework using a new hyperspectral image data set we constructed. Different from existing work, our framework takes both the RGB-NIR sensor characteristics and the RGB-NIR imaging pipeline into account. Based on the evaluation framework, we then design each imaging factor that affects the RGB-NIR imaging quality and propose the best-performed system design. We finally present the configuration of our developed prototype RGB-NIR camera, which was implemented based on the best system design, and demonstrate several potential applications using the prototype.