An Overview for Markov Decision Processes in Queues and Networks
Abstract
Markov decision processes (MDPs) in queues and networks have been an interesting topic in many practical areas since the 1960s. This paper provides a detailed overview on this topic and tracks the evolution of many basic results. Also, this paper summarizes several interesting directions in the future research. We hope that this overview can shed light to MDPs in queues and networks, and also to their extensive applications in various practical areas.
- Publication:
-
arXiv e-prints
- Pub Date:
- July 2019
- DOI:
- 10.48550/arXiv.1907.10243
- arXiv:
- arXiv:1907.10243
- Bibcode:
- 2019arXiv190710243L
- Keywords:
-
- Mathematics - Optimization and Control;
- Computer Science - Networking and Internet Architecture;
- 60K20;
- 60K25;
- 68M20;
- 90B05;
- 90B18;
- 90B22;
- 90C40
- E-Print:
- 42 pages