On hypothesis testing, trials factor, hypertests and the BumpHunter
Abstract
A detailed presentation of hypothesis testing is given. The "look elsewhere" effect is illustrated, and a treatment of the trials factor is proposed with the introduction of hypothesis hypertests. An example of such a hypertest is presented, named BumpHunter, which is used in the recent ATLAS dijet resonance search, and in an earlier version in the CDF Global Search, to look for exotic phenomena in high energy physics. As a demonstration, the BumpHunter is used to address Problem 1 of the Banff Challenge.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2011
- arXiv:
- arXiv:1101.0390
- Bibcode:
- 2011arXiv1101.0390C
- Keywords:
-
- Physics - Data Analysis;
- Statistics and Probability;
- High Energy Physics - Experiment;
- 65Z05;
- 62G10;
- 62-02
- E-Print:
- 34 pages, 91 figures, prepared for PHYSTAT2011