Two Instances of Interpretable Neural Network for Universal Approximations
Abstract
This paper proposes two bottom-up interpretable neural network (NN) constructions for universal approximation, namely Triangularly-constructed NN (TNN) and Semi-Quantized Activation NN (SQANN). Further notable properties are (1) resistance to catastrophic forgetting (2) existence of proof for arbitrarily high accuracies (3) the ability to identify samples that are out-of-distribution through interpretable activation "fingerprints".
- Publication:
-
arXiv e-prints
- Pub Date:
- December 2021
- DOI:
- 10.48550/arXiv.2112.15026
- arXiv:
- arXiv:2112.15026
- Bibcode:
- 2021arXiv211215026T
- Keywords:
-
- Computer Science - Machine Learning;
- Computer Science - Artificial Intelligence