JCS-Net: Joint Classification and Super-Resolution Network for Small-Scale Pedestrian Detection in Surveillance Images
JCS-Net: Joint Classification and Super-Resolution Network for Small-Scale Pedestrian Detection in Surveillance Images
复制标题
JCS-Net：用于监控图像中小规模行人检测的联合分类和超分辨率网络
DOI：
10.1109/tifs.2019.2916592
复制
发表时间：
2019-12-01
影响因子：
6.8
通讯作者：
Han, Jungong
中科院分区：
文献类型：
--
作者：
Pang, Yanwei;Cao, Jiale;Han, Jungong
虽然基于卷积神经网络（CNN）的行人检测方法已被证明在各种应用中是成功的，但从监控图像中检测小规模行人仍然具有挑战性。主要原因是相对于大规模的行人，小规模行人缺乏更多的详细信息。为了解决这一问题，我们提出利用大规模行人与相应的小规模行人之间的关系来帮助恢复小规模行人的详细信息，从而提高小规模行人的检测性能。具体而言，提出了一种将分类任务和超分辨率任务整合在一个统一框架内的小尺度行人检测统一网络JCS-Net。因此，超分辨率和分类充分结合，超分辨率子网络可以恢复一些有用的详细信息，为后续分类提供依据。基于HOG+LUV和JCS-Net，构建多层通道特征（MCF）来训练检测器。在加州理工学院行人数据集和KITTI基准上的实验结果证明了该方法的有效性。为了进一步提高检测能力，提出了基于JCS-Net的多尺度MCF行人检测方法，达到了最先进的检测性能。
While convolutional neural network (CNN)-based pedestrian detection methods have proven to be successful in various applications, detecting small-scale pedestrians from surveillance images is still challenging. The major reason is that the small-scale pedestrians lack much detailed information compared to the large-scale pedestrians. To solve this problem, we propose to utilize the relationship between the large-scale pedestrians and the corresponding small-scale pedestrians to help recover the detailed information of the small-scale pedestrians, thus improving the performance of detecting small-scale pedestrians. Specifically, a unified network (called JCS-Net) is proposed for small-scale pedestrian detection, which integrates the classification task and the super-resolution task in a unified framework. As a result, the super-resolution and classification are fully engaged, and the super-resolution sub-network can recover some useful detailed information for the subsequent classification. Based on HOG+LUV and JCS-Net, multi-layer channel features (MCF) are constructed to train the detector. The experimental results on the Caltech pedestrian dataset and the KITTI benchmark demonstrate the effectiveness of the proposed method. To further enhance the detection, multi-scale MCF based on JCS-Net for pedestrian detection is also proposed, which achieves the state-of-the-art performance.