Computation of CNN’s Sensitivity to Input Perturbation

Lin Xiang, Xiaoqin Zeng, Shengli Wu, Yanjun Liu, Baohua Yuan

Research output: Contribution to journalArticlepeer-review

Abstract

Although ConvolutionalNeural Networks(CNNs) are consideredas being "approximately invariant" to nuisance perturbations such as imagetransformation,shift, scaling, and other small deformations,someexisting studies show that intense noises can cause noticeable variation to CNNs’ outputs. This paper focuses on exploring a method of measuring sensitivity by observing corresponding output variation to input perturbation on CNNs. The sensitivity is statistically defined in a bottom-up way from neuron to layer, and finally to the entire CNN network. An iterative algorithm is proposed for approximating the defined sensitivity. On the basic architecture of CNNs, the theoretically computed sensitivity is verified on the MNIST database with four types of commonly used noise distributions: Gaussian, Uniform, Salt & Pepper, and Rayleigh. Experimental results show the theoretical sensitivity is on the one hand in agreement with the actual output variation what on the maps, layers or entire networks are, and on the other hand an applicable quantitative measure for robust network selection.
Original languageEnglish
Number of pages23
JournalNeural Processing Letters
Publication statusAccepted/In press - 23 Dec 2020

Keywords

  • Convolutional Neural Network, Sensitivity, Additive Noise, Input Perturbation

Fingerprint Dive into the research topics of 'Computation of CNN’s Sensitivity to Input Perturbation'. Together they form a unique fingerprint.

Cite this