Hyperspectral Reconstruction with Redundant Camera Spectral Sensitivity Functions
Hyperspectral Reconstruction with Redundant Camera Spectral Sensitivity Functions
复制标题
DOI：
10.1145/3386313
复制
发表时间：
2020-05
期刊：
影响因子：
--
通讯作者：
Xianhua Han;Yinqiang Zheng;Jiande Sun;Yenwei Chen
中科院分区：
文献类型：
--
作者：
Xianhua Han;Yinqiang Zheng;Jiande Sun;Yenwei Chen
近年来，高分辨率高光谱（HS）图像重建技术取得了很大的进展，其中基于同一场景的RGB图像和HS图像融合的方法较单独进行光谱或空间增强的方法具有更好的重建性能。众所周知，HS图像只能通过昂贵的超光谱传感器获得，而RGB图像可以由低价格的RGB相机提供，并且RGB相机的光谱灵敏度（SS）函数通常是不同的。因此，本研究提出了一种HS重建，它只融合了两个RGB图像与冗余的光谱响应。在这项工作中，我们设计了一个新的RGB相机，通过移动现有的RGB相机的SS，它可以提供类似的光谱响应强度与SS的不同光谱中心，并融合新实现的彩色图像与现有的RGB图像通过深ResNet。实验证明，两幅RGB图像的融合可以提供令人满意的HS重建性能，而将模拟SS的彩色图像与RGB图像融合可以进一步提高HS重建性能。
High-resolution hyperspectral (HS) reconstruction has recently achieved significantly progress, among which the method based on the fusion of the RGB and HS images of the same scene can greatly improve the reconstruction performance compared with those based on the individually spectral or spatial enhancement. It is well known that the HS image is obtained only via the costly hypersoectral sensor, whereas the RGB images can be provided by low-price RGB cameras and the spectral sensitivity (SS) functions of RGB cameras are usually different. Thus, this study proposes a HS reconstruction, which fuses merely two RGB images with redundant spectral responses. In this work, we design a new RGB camera via shifting the SS of an existed RGB camera, which can provide similar strength of spectral response with different spectral centers of SS, and fuse the new achieved color image with an existed RGB image by a deep ResNet. Experiments validate that fusion of two existed RGB images can provide impressive HS reconstruction performance and further improvement can be achieved by integrating the color image of the simulated SS with the RGB image.