Parallel algorithms in linear algebra
Abstract
This report provides an introduction to algorithms for fundamental linear algebra problems on various parallel computer architectures, with the emphasis on distributed-memory MIMD machines. To illustrate the basic concepts and key issues, we consider the problem of parallel solution of a nonsingular linear system by Gaussian elimination with partial pivoting. This problem has come to be regarded as a benchmark for the performance of parallel machines. We consider its appropriateness as a benchmark, its communication requirements, and schemes for data distribution to facilitate communication and load balancing. In addition, we describe some parallel algorithms for orthogonal (QR) factorization and the singular value decomposition (SVD).
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2010
- DOI:
- 10.48550/arXiv.1004.5437
- arXiv:
- arXiv:1004.5437
- Bibcode:
- 2010arXiv1004.5437B
- Keywords:
-
- Computer Science - Data Structures and Algorithms;
- Computer Science - Numerical Analysis;
- Mathematics - Numerical Analysis;
- 65-01 (Primary) 65-02;
- 65F05;
- 65F15;
- 68-01;
- 68-02 (Secondary);
- C.1.2;
- C.1.4;
- D.1.3;
- G.1.0;
- G.4
- E-Print:
- 17 pages. An old Technical Report, submitted for archival purposes. For further details see http://wwwmaths.anu.edu.au/~brent/pub/pub128.html