arrow
Return

AdjointBackMap: Reconstructing effective decision hypersurfaces from CNN layers using adjoint operators

delete2022-10-01
delete2
delete
OA
AI
万青 cover
万青 (Wan, Qing) *
Y
Yoonsuck Choe
DOI:10.1016/j.neunet.2022.06.037delete
deleteOriginal
deleteShare
deleteSave
View PDF
Abstract

Abstract

En 中文
There are several methods in the exploration of Convolutional Neural Networks' (CNNs') inner workings. However, in general, finding the inverse of the function performed by CNNs as a whole is an ill-posed problem. In this paper, we propose a method based on adjoint operators to reconstruct, given an arbitrary unit in the CNN (except for the first convolutional layer), its effective hypersurface in the input space. Since the reconstructed hyperplane (each point on the hypersurface) resides in the input space, we can easily visualize it. Our results show that the reconstructed hyperplane, when multiplied by the original input image, would give nearly the exact output value of that unit. We find that the CNN unit's decision process is largely conditioned on the input, and the corresponding reconstructed hypersurfaces are highly sensitive to adversarial noise, thus providing insights on why CNNs are susceptible to adversarial attack. (C) 2022 Elsevier Ltd. All rights reserved.
Keywords:
Adjoint operator
Theory of Neural Networks
Computer vision
AI Summary

AI Summary

Key information extracted from the uploaded paper, including a brief overview, abstract, background, key highlights, visual analysis, and future outlook.

Journal

Neural Networks cover
Neural Networks
IF:
6.3
Papers:
7.8K
Citations:
3.0W

Organization

T
Texas A&M University System
Scholars:
4.4W
Papers: 4.0W
Citations: 4.0K