High-Dimensional Brain in a High-Dimensional World: Blessing of Dimensionality
Abstract
High-dimensional data and high-dimensional representations of reality are inherent features of modern Artificial Intelligence systems and applications of machine learning. The well-known phenomenon of the "curse of dimensionality" states: many problems become exponentially difficult in high dimensions. Recently, the other side of the coin, the "blessing of dimensionality", has attracted much attention. It turns out that generic high-dimensional datasets exhibit fairly simple geometric properties. Thus, there is a fundamental tradeoff between complexity and simplicity in high dimensional spaces. Here we present a brief explanatory review of recent ideas, results and hypotheses about the blessing of dimensionality and related simplifying effects relevant to machine learning and neuroscience.
- Publication:
-
Entropy
- Pub Date:
- January 2020
- DOI:
- 10.3390/e22010082
- arXiv:
- arXiv:2001.04959
- Bibcode:
- 2020Entrp..22...82G
- Keywords:
-
- artificial intelligence;
- mistake correction;
- concentration of measure;
- discriminant;
- data mining;
- geometry;
- Computer Science - Machine Learning;
- Computer Science - Artificial Intelligence;
- Statistics - Machine Learning
- E-Print:
- 18 pages, 5 figures