Rényi entropy and variance comparison for symmetric log-concave random variables
Abstract
We show that for any $\alpha>0$ the Rényi entropy of order $\alpha$ is minimized, among all symmetric log-concave random variables with fixed variance, either for a uniform distribution or for a two sided exponential distribution. The first case occurs for $\alpha \in (0,\alpha^*]$ and the second case for $\alpha \in [\alpha^*,\infty)$, where $\alpha^*$ satisfies the equation $\frac{1}{\alpha^*-1}\log \alpha^*= \frac12 \log 6$, that is $\alpha^* \approx 1.241$. Using those results, we prove that one-sided exponential distribution minimizes Rényi entropy of order $\alpha \geq 2$ among all log-concave random variables with fixed variance.
- Publication:
-
arXiv e-prints
- Pub Date:
- August 2021
- DOI:
- arXiv:
- arXiv:2108.10100
- Bibcode:
- 2021arXiv210810100B
- Keywords:
-
- Computer Science - Information Theory;
- Mathematics - Probability