Getting the model right: an information criterion for spectroscopy
Abstract
Robust model-fitting to spectroscopic transitions is a requirement across many fields of science. The corrected Akaike and Bayesian information criteria (AICc and BIC) are most frequently used to select the optimal number of fitting parameters. In general, AICc modelling is thought to overfit (too many model parameters) and BIC underfits. For spectroscopic modelling, both AICc and BIC lack in two important respects: (a) no penalty distinction is made according to line strength such that parameters of weak lines close to the detection threshold are treated with equal importance as strong lines and (b) no account is taken of the way in which a narrow spectral line impacts only on a very small section of the overall data. In this paper, we introduce a new information criterion that addresses these shortcomings, the Spectral Information Criterion (SpIC). Spectral simulations are used to compare performances. The main findings are (i) SpIC clearly outperforms AICc for high signal-to-noise data, (ii) SpIC and AICc work equally well for lower signal-to-noise data, although SpIC achieves this with fewer parameters, and (iii) BIC does not perform well (for this application) and should be avoided. The new method should be of broader applicability (beyond spectroscopy), wherever different model parameters influence separated small ranges within a larger data set and/or have widely varying sensitivities.
- Publication:
-
Monthly Notices of the Royal Astronomical Society
- Pub Date:
- February 2021
- DOI:
- 10.1093/mnras/staa3551
- arXiv:
- arXiv:2009.08336
- Bibcode:
- 2021MNRAS.501.2268W
- Keywords:
-
- line: profiles;
- methods: data analysis;
- methods: numerical;
- methods: statistical;
- techniques: spectroscopic;
- quasars: absorption lines;
- cosmological parameters;
- Astrophysics - Instrumentation and Methods for Astrophysics;
- Astrophysics - Astrophysics of Galaxies;
- Physics - Data Analysis;
- Statistics and Probability
- E-Print:
- 13 pages, 7 figures