Learning and generation of long-range correlated sequences
Abstract
We study the capability to learn and to generate long-range, power-law correlated sequences by a fully connected asymmetric network. The focus is set on the ability of neural networks to extract statistical features from a sequence. We demonstrate that the average power-law behavior is learnable, namely, the sequence generated by the trained network obeys the same statistical behavior. The interplay between a correlated weight matrix and the sequence generated by such a network is explored. A weight matrix with a power-law correlation function along the vertical direction, gives rise to a sequence with a similar statistical behavior.
- Publication:
-
Physical Review E
- Pub Date:
- August 2000
- DOI:
- 10.1103/PhysRevE.62.1617
- arXiv:
- arXiv:cond-mat/0007075
- Bibcode:
- 2000PhRvE..62.1617P
- Keywords:
-
- 84.35.+i;
- 05.10.-a;
- Neural networks;
- Computational methods in statistical physics and nonlinear dynamics;
- Condensed Matter - Disordered Systems and Neural Networks;
- Condensed Matter - Statistical Mechanics;
- Physics - Computational Physics;
- Physics - Data Analysis;
- Statistics and Probability;
- Quantitative Biology
- E-Print:
- 5 pages, 3 figures, accepted for publication in Physical Review E