Density Estimation on Small Data Sets
Abstract
How might a smooth probability distribution be estimated with accurately quantified uncertainty from a limited amount of sampled data? Here we describe a field-theoretic approach that addresses this problem remarkably well in one dimension, providing an exact nonparametric Bayesian posterior without relying on tunable parameters or large-data approximations. Strong non-Gaussian constraints, which require a nonperturbative treatment, are found to play a major role in reducing distribution uncertainty. A software implementation of this method is provided.
- Publication:
-
Physical Review Letters
- Pub Date:
- October 2018
- DOI:
- 10.1103/PhysRevLett.121.160605
- arXiv:
- arXiv:1804.01932
- Bibcode:
- 2018PhRvL.121p0605C
- Keywords:
-
- Physics - Data Analysis;
- Statistics and Probability;
- Computer Science - Numerical Analysis;
- Physics - Computational Physics;
- Quantitative Biology - Quantitative Methods;
- Statistics - Methodology
- E-Print:
- Includes main text (5 pages, 3 figures) and Supplemental Information (10 pages, 4 figures). Same as version 3 but with Feynman diagrams properly rendered