Phase transitions of neural networks
Abstract
The cooperative behaviour of interacting neurons and synapses is studied using models and methods from statistical physics. The competition between training error and entropy may lead to discontinuous properties of the neural network. This is demonstrated for a few examples: Perceptron, associative memory, learning from examples, generalization, multilayer networks, structure recognition, Bayesian estimate, on-line training, noise estimation and time series generation.
- Publication:
-
Philosophical Magazine, Part B
- Pub Date:
- May 1998
- DOI:
- 10.1080/13642819808205038
- arXiv:
- arXiv:cond-mat/9704098
- Bibcode:
- 1998PMagB..77.1455K
- Keywords:
-
- Condensed Matter - Disordered Systems and Neural Networks;
- Quantitative Biology
- E-Print:
- Plenary talk for MINERVA workshop on mesoscopics, fractals and neural networks, Eilat, March 1997 Postscript File