Quantitative model-checking of controlled discrete-time Markov processes
Abstract
This paper focuses on optimizing probabilities of events of interest defined over general controlled discrete-time Markov processes. It is shown that the optimization over a wide class of $\omega$-regular properties can be reduced to the solution of one of two fundamental problems: reachability and repeated reachability. We provide a comprehensive study of the former problem and an initial characterisation of the (much more involved) latter problem. A case study elucidates concepts and techniques.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2014
- DOI:
- 10.48550/arXiv.1407.5449
- arXiv:
- arXiv:1407.5449
- Bibcode:
- 2014arXiv1407.5449T
- Keywords:
-
- Mathematics - Probability;
- Computer Science - Formal Languages and Automata Theory;
- Computer Science - Systems and Control;
- Mathematics - Optimization and Control