Information Geometry and Classical Cramér-Rao Type Inequalities
Abstract
We examine the role of information geometry in the context of classical Cramér-Rao (CR) type inequalities. In particular, we focus on Eguchi's theory of obtaining dualistic geometric structures from a divergence function and then applying Amari-Nagoaka's theory to obtain a CR type inequality. The classical deterministic CR inequality is derived from Kullback-Leibler (KL)-divergence. We show that this framework could be generalized to other CR type inequalities through four examples: $\alpha$-version of CR inequality, generalized CR inequality, Bayesian CR inequality, and Bayesian $\alpha$-CR inequality. These are obtained from, respectively, $I_\alpha$-divergence (or relative $\alpha$-entropy), generalized Csiszár divergence, Bayesian KL divergence, and Bayesian $I_\alpha$-divergence.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2021
- DOI:
- 10.48550/arXiv.2104.01061
- arXiv:
- arXiv:2104.01061
- Bibcode:
- 2021arXiv210401061V
- Keywords:
-
- Computer Science - Information Theory;
- Computer Science - Machine Learning;
- Electrical Engineering and Systems Science - Signal Processing;
- Mathematics - Differential Geometry;
- Statistics - Machine Learning
- E-Print:
- 34 pages, 2 figures, 1 table, book chapter. arXiv admin note: text overlap with arXiv:2001.04769