Recurrent Attention Model with Log-Polar Mapping is Robust against Adversarial Attacks
Abstract
Convolutional neural networks are vulnerable to small $\ell^p$ adversarial attacks, while the human visual system is not. Inspired by neural networks in the eye and the brain, we developed a novel artificial neural network model that recurrently collects data with a log-polar field of view that is controlled by attention. We demonstrate the effectiveness of this design as a defense against SPSA and PGD adversarial attacks. It also has beneficial properties observed in the animal visual system, such as reflex-like pathways for low-latency inference, fixed amount of computation independent of image size, and rotation and scale invariance. The code for experiments is available at https://gitlab.com/exwzd-public/kiritani_ono_2020.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2020
- DOI:
- 10.48550/arXiv.2002.05388
- arXiv:
- arXiv:2002.05388
- Bibcode:
- 2020arXiv200205388K
- Keywords:
-
- Computer Science - Computer Vision and Pattern Recognition
- E-Print:
- 11 pages, 4 figures