Deterministic particle flows for constraining SDEs
Abstract
Devising optimal interventions for diffusive systems often requires the solution of the Hamilton-Jacobi-Bellman (HJB) equation, a nonlinear backward partial differential equation (PDE), that is, in general, nontrivial to solve. Existing control methods either tackle the HJB directly with grid-based PDE solvers, or resort to iterative stochastic path sampling to obtain the necessary controls. Here, we present a framework that interpolates between these two approaches. By reformulating the optimal interventions in terms of logarithmic gradients ( scores ) of two forward probability flows, and by employing deterministic particle methods for solving Fokker-Planck equations, we introduce a novel fully deterministic framework that computes the required optimal interventions in one shot.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2021
- DOI:
- 10.48550/arXiv.2110.13020
- arXiv:
- arXiv:2110.13020
- Bibcode:
- 2021arXiv211013020M
- Keywords:
-
- Condensed Matter - Statistical Mechanics;
- Mathematics - Optimization and Control;
- Mathematics - Probability;
- Physics - Data Analysis;
- Statistics and Probability;
- Statistics - Methodology;
- 82C80;
- 37M05;
- 37H05;
- 60H35;
- 65C35;
- 65N75;
- 37N35;
- 93B52;
- 93E03
- E-Print:
- 4+3 pages, 2 figures -- workshop paper -- Machine Learning and the Physical Sciences, Workshop at the 35th Conference on Neural Information Processing Systems (NeurIPS 2021) The related journal paper is published here: https://link.aps.org/doi/10.1103/PhysRevResearch.4.043035