A measure concentration effect for matrices of high, higher, and even higher dimension
Abstract
Let $n>m$, and let $A$ be an $(m\times n)$-matrix of full rank. Then obviously the estimate $\|Ax\|\leq\|A\|\|x\|$ holds for the euclidean norm of $x$ and $Ax$ and the spectral norm as the assigned matrix norm. We study the sets of all $x$ for which, for fixed $\delta<1$, conversely $\|Ax\|\geq\delta\,\|A\|\|x\|$ holds. It turns out that these sets fill, in the high-dimensional case, almost the complete space once $\delta$ falls below a bound that depends on the extremal singular values of $A$ and on the ratio of the dimensions. This effect has much to do with the random projection theorem, which plays an important role in the data sciences. As a byproduct, we calculate the probabilities this theorem deals with exactly.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2020
- DOI:
- 10.48550/arXiv.2010.13505
- arXiv:
- arXiv:2010.13505
- Bibcode:
- 2020arXiv201013505Y
- Keywords:
-
- Mathematics - Rings and Algebras;
- Mathematics - Numerical Analysis;
- 15A99;
- 15B52;
- 60B20
- E-Print:
- to appear in SIAM Journal on Matrix Analysis and Applications