Multi-Level Error-Resilient Neural Networks with Learning
Abstract
The problem of neural network association is to retrieve a previously memorized pattern from its noisy version using a network of neurons. An ideal neural network should include three components simultaneously: a learning algorithm, a large pattern retrieval capacity and resilience against noise. Prior works in this area usually improve one or two aspects at the cost of the third. Our work takes a step forward in closing this gap. More specifically, we show that by forcing natural constraints on the set of learning patterns, we can drastically improve the retrieval capacity of our neural network. Moreover, we devise a learning algorithm whose role is to learn those patterns satisfying the above mentioned constraints. Finally we show that our neural network can cope with a fair amount of noise.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2012
- DOI:
- arXiv:
- arXiv:1202.2770
- Bibcode:
- 2012arXiv1202.2770H
- Keywords:
-
- Computer Science - Neural and Evolutionary Computing;
- Computer Science - Artificial Intelligence;
- Computer Science - Information Theory
- E-Print:
- Part of this draft has been submitted to International Symposium on Information Theory (ISIT) 2012