A constrained risk inequality for general losses
Abstract
We provide a general constrained risk inequality that applies to arbitrary non-decreasing losses, extending a result of Brown and Low [Ann. Stat. 1996]. Given two distributions $P_0$ and $P_1$, we find a lower bound for the risk of estimating a parameter $\theta(P_1)$ under $P_1$ given an upper bound on the risk of estimating the parameter $\theta(P_0)$ under $P_0$. The inequality is a useful pedagogical tool, as its proof relies only on the Cauchy-Schwartz inequality, it applies to general losses, and it transparently gives risk lower bounds on super-efficient and adaptive estimators.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2018
- DOI:
- 10.48550/arXiv.1804.08116
- arXiv:
- arXiv:1804.08116
- Bibcode:
- 2018arXiv180408116D
- Keywords:
-
- Mathematics - Statistics Theory
- E-Print:
- 10 pages. This version (v2) adds applications to efficient nonparametric estimation and some pedagogical comments