Piecewise Polynomial Regression of Tame Functions via Integer Programming
Abstract
Tame functions are a class of nonsmooth, nonconvex functions, which feature in a wide range of applications: functions encountered in the training of deep neural networks with all common activations, value functions of mixed-integer programs, or wave functions of small molecules. We consider approximating tame functions with piecewise polynomial functions. We bound the quality of approximation of a tame function by a piecewise polynomial function with a given number of segments on any full-dimensional cube. We also present the first mixed-integer programming formulation of piecewise polynomial regression. Together, these can be used to estimate tame functions. We demonstrate promising computational results.
- Publication:
-
arXiv e-prints
- Pub Date:
- November 2023
- DOI:
- 10.48550/arXiv.2311.13544
- arXiv:
- arXiv:2311.13544
- Bibcode:
- 2023arXiv231113544B
- Keywords:
-
- Mathematics - Optimization and Control;
- Computer Science - Artificial Intelligence;
- Computer Science - Machine Learning;
- Mathematics - Statistics Theory