Open AccessCooperative decision making for connected automated vehicles in multiple driving scenarios
Author(s) -
Wang Jinzhu,
Ma Zhixiong,
Zhu Xichan,
Bai Jie,
Huang Libo
Publication year - 2023
Publication title -
iet intelligent transport systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.579
H-Index - 45
eISSN - 1751-9578
pISSN - 1751-956X
DOI - 10.1049/itr2.12309
Subject(s) - reinforcement learning , robustness (evolution) , computer science , set (abstract data type) , range (aeronautics) , engineering , operations research , artificial intelligence , biochemistry , chemistry , gene , programming language , aerospace engineering
To improve the application range of decision‐making systems for connected automated vehicles, this paper proposes a cooperative decision‐making approach for multiple driving scenarios based on the combination of multi‐agent reinforcement learning with centralized planning. Specifically, the authors derived driving tasks from driving scenarios and computed the policy functions for different driving scenarios as linear combinations of policy functions for a set of specific driving tasks. Then, the authors classified vehicle coalitions according to the relationships between vehicles and used centralized planning methods to determine the optimal combination of actions for each coalition. Finally, the authors conducted tests in two driving scenarios considering different traffic densities to evaluate the performance of the developed approach. Simulation results demonstrate that the proposed approach exhibits good robustness in multiple driving scenarios while enabling cooperative decision making for connected automated vehicles, thereby ensuring safe and rational decision making.