Binarized Johnson-Lindenstrauss embeddings
Abstract
We consider the problem of encoding a set of vectors into a minimal number of bits while preserving information on their Euclidean geometry. We show that this task can be accomplished by applying a Johnson-Lindenstrauss embedding and subsequently binarizing each vector by comparing each entry of the vector to a uniformly random threshold. Using this simple construction we produce two encodings of a dataset such that one can query Euclidean information for a pair of points using a small number of bit operations up to a desired additive error - Euclidean distances in the first case and inner products and squared Euclidean distances in the second. In the latter case, each point is encoded in near-linear time. The number of bits required for these encodings is quantified in terms of two natural complexity parameters of the dataset - its covering numbers and localized Gaussian complexity - and shown to be near-optimal.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2020
- DOI:
- 10.48550/arXiv.2009.08320
- arXiv:
- arXiv:2009.08320
- Bibcode:
- 2020arXiv200908320D
- Keywords:
-
- Computer Science - Information Theory;
- Computer Science - Data Structures and Algorithms;
- Mathematics - Metric Geometry
- E-Print:
- The results of this preprint have been strongly improved and expanded. The current preprint is no longer intended for publication and has been replaced by two new preprints, posted as arXiv:2201.05204 and arXiv:2204.04109