Rieoptax: Riemannian Optimization in JAX
Abstract
We present Rieoptax, an open source Python library for Riemannian optimization in JAX. We show that many differential geometric primitives, such as Riemannian exponential and logarithm maps, are usually faster in Rieoptax than existing frameworks in Python, both on CPU and GPU. We support various range of basic and advanced stochastic optimization solvers like Riemannian stochastic gradient, stochastic variance reduction, and adaptive gradient methods. A distinguishing feature of the proposed toolbox is that we also support differentially private optimization on Riemannian manifolds.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2022
- DOI:
- 10.48550/arXiv.2210.04840
- arXiv:
- arXiv:2210.04840
- Bibcode:
- 2022arXiv221004840U
- Keywords:
-
- Mathematics - Optimization and Control;
- Computer Science - Machine Learning;
- Computer Science - Mathematical Software