TROPHY: Trust Region Optimization Using a Precision Hierarchy
Abstract
We present an algorithm to perform trust-region-based optimization for nonlinear unconstrained problems. The method selectively uses function and gradient evaluations at different floating-point precisions to reduce the overall energy consumption, storage, and communication costs; these capabilities are increasingly important in the era of exascale computing. In particular, we are motivated by a desire to improve computational efficiency for massive climate models. We employ our method on two examples: the CUTEst test set and a large-scale data assimilation problem to recover wind fields from radar returns. Although this paper is primarily a proof of concept, we show that if implemented on appropriate hardware, the use of mixed-precision can significantly reduce the computational load compared with fixed-precision solvers.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2022
- DOI:
- 10.48550/arXiv.2202.08387
- arXiv:
- arXiv:2202.08387
- Bibcode:
- 2022arXiv220208387C
- Keywords:
-
- Mathematics - Optimization and Control;
- 90-08;
- G.1.6
- E-Print:
- 14 pages, 2 figures, 2 tables