CoSLight: Co-optimizing Collaborator Selection and Decision-making to Enhance Traffic Signal Control
Abstract
Effective multi-intersection collaboration is pivotal for reinforcement-learning-based traffic signal control to alleviate congestion. Existing work mainly chooses neighboring intersections as collaborators. However, quite an amount of congestion, even some wide-range congestion, is caused by non-neighbors failing to collaborate. To address these issues, we propose to separate the collaborator selection as a second policy to be learned, concurrently being updated with the original signal-controlling policy. Specifically, the selection policy in real-time adaptively selects the best teammates according to phase- and intersection-level features. Empirical results on both synthetic and real-world datasets provide robust validation for the superiority of our approach, offering significant improvements over existing state-of-the-art methods. The code is available at https://github.com/bonaldli/CoSLight.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 2024
- DOI:
- 10.48550/arXiv.2405.17152
- arXiv:
- arXiv:2405.17152
- Bibcode:
- 2024arXiv240517152R
- Keywords:
-
- Computer Science - Multiagent Systems;
- Computer Science - Artificial Intelligence
- E-Print:
- Accepted by KDD 2024