Approximate Dynamic Programming for a Mean-field Game of Traffic Flow: Existence and Uniqueness
Abstract
Highway vehicular traffic is an inherently multi-agent problem. Traffic jams can appear and disappear mysteriously. We develop a method for traffic flow control that is applied at the vehicular level via mean-field games. We begin this work with a microscopic model of vehicles subject to control input, disturbances, noise, and a speed limit. We formulate a discounted-cost infinite-horizon robust mean-field game on the vehicles, and obtain the associated dynamic programming (DP) PDE system. We then perform approximate dynamic programming (ADP) using these equations to obtain a sub-optimal control for the traffic density adaptively. The sub-optimal controls are subject to an ODE-PDE system. We show that the ADP ODE-PDE system has a unique weak solution in a suitable Hilbert space using semigroup and successive approximation methods. We additionally give a numerical simulation, and interpret the results.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2023
- DOI:
- 10.48550/arXiv.2302.05416
- arXiv:
- arXiv:2302.05416
- Bibcode:
- 2023arXiv230205416T
- Keywords:
-
- Mathematics - Optimization and Control;
- Electrical Engineering and Systems Science - Systems and Control
- E-Print:
- 42 pages, 5 figures