Yes, but Did It Work?: Evaluating Variational Inference
Abstract
While it's always possible to compute a variational approximation to a posterior distribution, it can be difficult to discover problems with this approximation. We propose two diagnostic algorithms to alleviate this problem. The Pareto-smoothed importance sampling (PSIS) diagnostic gives a goodness of fit measurement for joint distributions, while simultaneously improving the error in the estimate. The variational simulation-based calibration (VSBC) assesses the average performance of point estimates.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2018
- DOI:
- 10.48550/arXiv.1802.02538
- arXiv:
- arXiv:1802.02538
- Bibcode:
- 2018arXiv180202538Y
- Keywords:
-
- Statistics - Machine Learning;
- Statistics - Computation
- E-Print:
- Appearing at International Conference on Machine Learning 2018