Probing the basins of attraction of a recurrent neural network
Abstract
A recurrent neural network is considered that can retrieve a collection of patterns, as well as slightly perturbed versions of this `pure' set of patterns via fixed points of its dynamics. By replacing the set of dynamical constraints, i.e. the fixed point equations, by an extended collection of fixed-point-like equations, analytical expressions are found for the weights wij (b ) of the net, which depend on a certain parameter b . This so-called basin parameter b is such that for b = 0 there are, a priori , no perturbed patterns to be recognized by the net. It is shown by a numerical study, via probing sets, that a net constructed to recognize perturbed patterns, i.e. with values of the connections wij (b ) with bicons/Journals/Common/ne" ALT="ne" ALIGN="TOP"/> 0, possesses larger basins of attraction than a net made with the help of a pure set of patterns, i.e. with connections wij (b = 0). The mathematical results obtained can, in principle, be realized by an actual, biological neural net.
- Publication:
-
Journal of Physics A Mathematical General
- Pub Date:
- March 2000
- DOI:
- arXiv:
- arXiv:cond-mat/0002358
- Bibcode:
- 2000JPhA...33.1765H
- Keywords:
-
- Condensed Matter - Disordered Systems and Neural Networks;
- Quantitative Biology
- E-Print:
- 17 pages, LaTeX, 2 figures