Using Monte Carlo Tree Search to Calculate Mutual Information in High Dimensions
Abstract
Mutual information is an important measure of the dependence among variables. It has become widely used in statistics, machine learning, biology, etc. However, the standard techniques for estimating it often perform poorly in higher dimensions or with noisy variables. Here we significantly improve one of the standard methods for calculating mutual information by combining it with a modified Monte Carlo Tree Search. We present results which show that our method gives accurate results where the standard methods fail. We also describe the software implementation of our method and give details on the publicly-available code.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2023
- DOI:
- 10.48550/arXiv.2309.08516
- arXiv:
- arXiv:2309.08516
- Bibcode:
- 2023arXiv230908516C
- Keywords:
-
- Physics - Data Analysis;
- Statistics and Probability;
- High Energy Physics - Experiment