Statistical mechanics of learning in the presence of outliers
Abstract
Using methods of statistical mechanics, we analyse the effect of outliers on the supervised learning of a classification problem. The learning strategy aims at selecting informative examples and discarding outliers. We compare two algorithms which perform the selection either in a soft or a hard way. When the fraction of outliers grows large, the estimation errors undergo a first-order phase transition.
- Publication:
-
Journal of Physics A Mathematical General
- Pub Date:
- November 1998
- DOI:
- 10.1088/0305-4470/31/46/005
- arXiv:
- arXiv:cond-mat/9803316
- Bibcode:
- 1998JPhA...31.9131D
- Keywords:
-
- Condensed Matter - Disordered Systems and Neural Networks
- E-Print:
- 24 pages, 7 figures (minor extensions added)