Concentration of a high dimensional sub-gaussian vector
Abstract
This note describes the concentration phenomenon for a high dimensional sub-gaussian vector \( X \). In the Gaussian case, for any linear operator \( Q \), it holds \( P\bigl( \| Q X \|^{2} - tr (B) > 2 \sqrt{x\, tr(B^{2})} + 2 \| B \| x \bigr) \leq e^{-x} \) and \( P\bigl( \| Q X \|^{2} - tr (B) < - 2 \sqrt{x \, tr(B^{2})} \bigr) \leq e^{-x} \) with \( B = Q \, Var(X) Q^{T} \); see \cite{laurentmassart2000}. This implies concentration of the squared norm \( \| Q X \|^{2} \) around its expectation \( E \| Q X \|^{2} = tr (B) \) provided that \( tr(B)/\| B \| \) is sufficiently large. An extension of this result to a non-gaussian case is a nontrivial task even under sub-gaussian behavior of \( X \), especially if the entries of \( X \) cannot be assumed independent and Hanson-Wright type bounds do not apply. The results of this paper extend the Gaussian deviation bounds and support the concentration phenomenon for \( \| Q X \|^{2} \) using recent advances in Laplace approximation from \cite{SpLaplace2022} and \cite{katsevich2023tight}. The results are specified to the case of i.i.d. sums.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2023
- DOI:
- 10.48550/arXiv.2305.07885
- arXiv:
- arXiv:2305.07885
- Bibcode:
- 2023arXiv230507885S
- Keywords:
-
- Mathematics - Probability;
- 62E15 (Primary) 62E10 (Secondary)
- E-Print:
- arXiv admin note: text overlap with arXiv:2201.06327