Orthonormal Sketches for Secure Coded Regression
Abstract
In this work, we propose a method for speeding up linear regression distributively, while ensuring security. We leverage randomized sketching techniques, and improve straggler resilience in asynchronous systems. Specifically, we apply a random orthonormal matrix and then subsample in \textit{blocks}, to simultaneously secure the information and reduce the dimension of the regression problem. In our setup, the transformation corresponds to an encoded encryption in an \textit{approximate} gradient coding scheme, and the subsampling corresponds to the responses of the non-straggling workers; in a centralized coded computing network. We focus on the special case of the \textit{Subsampled Randomized Hadamard Transform}, which we generalize to block sampling; and discuss how it can be used to secure the data. We illustrate the performance through numerical experiments.
- Publication:
-
arXiv e-prints
- Pub Date:
- January 2022
- DOI:
- 10.48550/arXiv.2201.08522
- arXiv:
- arXiv:2201.08522
- Bibcode:
- 2022arXiv220108522C
- Keywords:
-
- Computer Science - Information Theory;
- Computer Science - Cryptography and Security;
- Electrical Engineering and Systems Science - Signal Processing;
- Mathematics - Numerical Analysis;
- 65F10;
- 65F45;
- 68W15;
- 68W20;
- 68W25;
- 68P27;
- 68P30;
- E.3;
- E.4;
- G.1.2;
- G.1.3
- E-Print:
- 3 figures, 5 pages excluding appendices