One-pixel Signature: Characterizing CNN Models for Backdoor Detection
One-pixel Signature: Characterizing CNN Models for Backdoor Detection
复制标题
DOI:
10.1007/978-3-030-58583-9_20
复制
发表时间:
2020-08
期刊:
影响因子:
--
通讯作者:
Shanjiaoyang Huang;Weiqi Peng;Zhiwei Jia;Z. Tu
中科院分区:
文献类型:
--
作者:
Shanjiaoyang Huang;Weiqi Peng;Zhiwei Jia;Z. Tu
We tackle the convolution neural networks (CNNs) backdoor detection problem by proposing a new representation called one-pixel signature. Our task is to detect/classify if a CNN model has been maliciously inserted with an unknown Trojan trigger or not. We design the one-pixel signature representation to reveal the characteristics of both clean and backdoored CNN models. Here, each CNN model is associated with a signature that is created by generating, pixel-by-pixel, an adversarial value that is the result of the largest change to the class prediction. The one-pixel signature is agnostic to the design choice of CNN architectures, and how they were trained. It can be computed efficiently for a black-box CNN model without accessing the network parameters. Our proposed one-pixel signature demonstrates a substantial improvement (by around 30% in the absolute detection accuracy) over the existing competing methods for backdoored CNN detection/classification. One-pixel signature is a general representation that can be used to characterize CNN models beyond backdoor detection.