Infrared and visible images fusion using visual saliency and optimized spiking cortical model in non-subsampled shearlet transform domain
Infrared and visible images fusion using visual saliency and optimized spiking cortical model in non-subsampled shearlet transform domain
复制标题
在非下采样剪切波变换域中使用视觉显着性和优化的尖峰皮质模型进行红外和可见光图像融合
DOI：
10.1007/s11042-018-6099-x
复制
发表时间：
2019-10-01
影响因子：
3.6
通讯作者：
Liu, Dong
中科院分区：
文献类型：
--
作者：
Hou, Ruichao;Nie, Rencan;Liu, Dong
针对现有红外与可见光图像融合方法存在的边缘模糊、对比度低、细节丢失等问题，提出一种基于非下采样剪切波变换（NSST）、视觉显着性和多目标人工蜂群（MOABC）优化尖峰皮质模式（SCM）的融合方案。 NSST具有多尺度特征、稀疏表示等诸多优点。而且，视觉显着图可以改进低频融合策略，并且SCM具有耦合和脉冲同步特性。首先，利用NSST将源图像分解为低频子带和一系列高频子带。其次，通过SCM融合低频子带，其中SCM由源图像低频子带的边缘显着性图激励，然后高频子带也通过SCM融合，其中源图像高频子带的修改空间频率被采用作为SCM的输入激励，通过新颖的多目标人工蜂群技术来优化SCM的参数。最后，通过逆NSST重建融合图像。实验结果表明，该方案表现良好，无论是主观视觉性能还是客观指标都比目前其他典型方案具有明显的优越性。
Aiming at some problems in existing infrared and visible image fusion methods such as edge blurring, low contrast, loss of details, a novel fusion scheme based on non-subsampled shearlet transform (NSST), visual saliency and multi-objective artificial bee colony (MOABC) optimizing spiking cortical mode (SCM) is proposed. NSST has many advantages such as multi-scale features and sparse representation. Moreover, the visual saliency map can improve the low frequency fusion strategy, and SCM has coupling and pulse synchronization properties. Firstly, NSST is utilized to decompose the source image into a low-frequency subband and a series of high-frequency subbands. Secondly, the low-frequency subband is fused by SCM, where SCM is motivated by the edge saliency map of the low-frequency subband of the source image, and then the high-frequency subbands are also fused by SCM, where the modified spatial frequency of the high-frequency subbands of the source image is adopted as the input stimulus of SCM, the parameters of SCM are optimized by the novel multi-objective artificial bee colony technique. Finally, the fused image is reconstructed by inverse NSST. Experimental results indicate that the proposed scheme performs well and has obvious superiorities over other current typical ones in both subjective visual performance and objective criteria.