Bounds on the Bayes Error Given Moments
Abstract
We show how to compute lower bounds for the supremum Bayes error if the class-conditional distributions must satisfy moment constraints, where the supremum is with respect to the unknown class-conditional distributions. Our approach makes use of Curto and Fialkow's solutions for the truncated moment problem. The lower bound shows that the popular Gaussian assumption is not robust in this regard. We also construct an upper bound for the supremum Bayes error by constraining the decision boundary to be linear.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2011
- DOI:
- 10.48550/arXiv.1105.2952
- arXiv:
- arXiv:1105.2952
- Bibcode:
- 2011arXiv1105.2952F
- Keywords:
-
- Statistics - Machine Learning;
- Computer Science - Information Theory
- E-Print:
- 10 pages, 2 figures, to appear in IEEE Transactions on Information Theory