Statistical physics of independent component analysis
Abstract
Statistical physics is used to investigate independent component analysis with polynomial contrast functions. While the replica method fails, an adapted cavity approach yields valid results. The learning curves, obtained in a suitable thermodynamic limit, display a first-order phase transition from poor to perfect generalization.
- Publication:
-
EPL (Europhysics Letters)
- Pub Date:
- November 2003
- DOI:
- 10.1209/epl/i2003-00611-3
- arXiv:
- arXiv:cond-mat/0309484
- Bibcode:
- 2003EL.....64..564U
- Keywords:
-
- 89.75.Fb;
- 84.35.+i;
- 64.60.Cn;
- Structures and organization in complex systems;
- Neural networks;
- Order-disorder transformations;
- statistical mechanics of model systems;
- Condensed Matter - Disordered Systems and Neural Networks
- E-Print:
- 7 pages, 1 figure, to appear in Europhys. Letts