Learning the Markov Decision Process in the Sparse Gaussian Elimination
Abstract
We propose a learning-based approach for the sparse Gaussian Elimination. There are many hard combinatorial optimization problems in modern sparse solver. These NP-hard problems could be handled in the framework of Markov Decision Process, especially the Q-Learning technique. We proposed some Q-Learning algorithms for the main modules of sparse solver: minimum degree ordering, task scheduling and adaptive pivoting. Finally, we recast the sparse solver into the framework of Q-Learning. Our study is the first step to connect these two classical mathematical models: Gaussian Elimination and Markov Decision Process. Our learning-based algorithm could help improve the performance of sparse solver, which has been verified in some numerical experiments.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2021
- DOI:
- 10.48550/arXiv.2109.14929
- arXiv:
- arXiv:2109.14929
- Bibcode:
- 2021arXiv210914929C
- Keywords:
-
- Mathematics - Numerical Analysis;
- Computer Science - Machine Learning;
- Computer Science - Mathematical Software
- E-Print:
- 13 pages,2 figures