Open AccessSpeed harmonisation and merge control using connected automated vehicles on a highway lane closure: a reinforcement learning approach
Author(s) -
Ko Byungjin,
Ryu Seunghan,
Park Byungkyu Brian,
Son Sang Hyuk
Publication year - 2020
Publication title -
iet intelligent transport systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.579
H-Index - 45
eISSN - 1751-9578
pISSN - 1751-956X
DOI - 10.1049/iet-its.2019.0709
Subject(s) - merge (version control) , bottleneck , computer science , fuel efficiency , reinforcement learning , traffic congestion , traffic congestion reconstruction with kerner's three phase theory , real time computing , simulation , automotive engineering , transport engineering , artificial intelligence , engineering , embedded system , information retrieval
A lane closure bottleneck usually leads to traffic congestion and a waste of fuel consumption on highways. In mixed traffic that consists of human‐driven vehicles and connected automated vehicles (CAVs), the CAVs can be used for traffic control to improve the traffic flow. The authors propose speed harmonisation and merge control, taking advantage of CAVs to alleviate traffic congestion at a highway bottleneck area. To this end, they apply a reinforcement learning algorithm called deep Q network to train behaviours of CAVs. By training the merge control Q‐network, CAVs learn a merge mechanism to improve the mixed traffic flow at the bottleneck area. Similarly, speed harmonisation Q‐network learns speed harmonisation to reduce fuel consumption and alleviate traffic congestion by controlling the speed of following vehicles. After training two Q‐networks of the merge mechanism and speed harmonisation, they evaluate the trained Q‐networks under various conditions in terms of vehicle arrival rates and CAV market penetration rates. The simulation results indicate that the proposed approach improves the mixed traffic flow by increasing the throughput up to 30% and reducing the fuel consumption up to 20%, when compared to the late merge control without speed harmonisation.