Sequential tracking of an unobservable two-state Markov process under Brownian noise
Abstract
We consider an optimal control problem, where a Brownian motion with drift is sequentially observed, and the sign of the drift coefficient changes at jump times of a symmetric two-state Markov process. The Markov process itself is not observable, and the problem consist in finding a {-1,1}-valued process that tracks the unobservable process as close as possible. We present an explicit construction of such a process.
- Publication:
-
arXiv e-prints
- Pub Date:
- August 2019
- DOI:
- 10.48550/arXiv.1908.01162
- arXiv:
- arXiv:1908.01162
- Bibcode:
- 2019arXiv190801162M
- Keywords:
-
- Mathematics - Probability;
- Mathematics - Statistics Theory;
- 62L10;
- 62L15;
- 60G40
- E-Print:
- 18 pages