Optimal control of branching diffusion processes: a finite horizon problem
Abstract
In this paper, we aim to develop the theory of optimal stochastic control for branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem of minimizing a criterion that is expressed as the expected value of the product of individual costs penalizing the final position of each particle. In this setting, we show that the value function is the unique viscosity solution of a nonlinear parabolic PDE, that is, the Hamilton-Jacobi-Bellman equation corresponding to the problem. To this end, we extend the dynamic programming approach initiated by Nisio to deal with the lack of independence between the particles as well as between the reproduction and the movement of each particle. In particular, we exploit the particular form of the optimization criterion to recover a weak form of the branching property. In addition, we provide a precise formulation and a detailed justification of the adequate dynamic programming principle.
- Publication:
-
arXiv e-prints
- Pub Date:
- November 2015
- DOI:
- 10.48550/arXiv.1511.06809
- arXiv:
- arXiv:1511.06809
- Bibcode:
- 2015arXiv151106809C
- Keywords:
-
- Mathematics - Probability;
- Mathematics - Optimization and Control;
- Primary 93E20;
- 60J60;
- 60J80;
- secondary 49L20;
- 49L25;
- 60J70;
- 60J85