Which statistical hypotheses are afflicted with false confidence?
Abstract
The false confidence theorem establishes that, for any data-driven, precise-probabilistic method for uncertainty quantification, there exists (non-trivial) false hypotheses to which the method tends to assign high confidence. This raises concerns about the reliability of these widely-used methods, and shines new light on the consonant belief function-based methods that are provably immune to false confidence. But an existence result alone is insufficient. Towards a partial answer to the title question, I show that, roughly, complements of convex hypotheses are afflicted by false confidence.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2024
- DOI:
- 10.48550/arXiv.2404.16228
- arXiv:
- arXiv:2404.16228
- Bibcode:
- 2024arXiv240416228M
- Keywords:
-
- Mathematics - Statistics Theory
- E-Print:
- 8-page conference paper. Comments welcome at https://researchers.one/articles/24.04.00004