Sharper lower bounds on the performance of the empirical risk minimization algorithm
Abstract
We present an argument based on the multidimensional and the uniform central limit theorems, proving that, under some geometrical assumptions between the target function $T$ and the learning class $F$, the excess risk of the empirical risk minimization algorithm is lower bounded by \[\frac{\mathbb{E}\sup_{q\in Q}G_q}{\sqrt{n}}\delta,\] where $(G_q)_{q\in Q}$ is a canonical Gaussian process associated with $Q$ (a well chosen subset of $F$) and $\delta$ is a parameter governing the oscillations of the empirical excess risk function over a small ball in $F$.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2011
- DOI:
- 10.48550/arXiv.1102.4983
- arXiv:
- arXiv:1102.4983
- Bibcode:
- 2011arXiv1102.4983L
- Keywords:
-
- Mathematics - Statistics Theory
- E-Print:
- Published in at http://dx.doi.org/10.3150/09-BEJ225 the Bernoulli (http://isi.cbs.nl/bernoulli/) by the International Statistical Institute/Bernoulli Society (http://isi.cbs.nl/BS/bshome.htm)