Premium
Reinforcement learning‐based bird‐view automated vehicle control to avoid crossing traffic
Author(s) -
Wang Yipei,
Hou Shuaikun,
Wang Xin
Publication year - 2021
Publication title -
computer‐aided civil and infrastructure engineering
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 2.773
H-Index - 82
eISSN - 1467-8667
pISSN - 1093-9687
DOI - 10.1111/mice.12572
Subject(s) - reinforcement learning , control (management) , computer science , string (physics) , vehicle information and communication system , transport engineering , real time computing , engineering , road traffic , artificial intelligence , physics , quantum mechanics
Abstract This paper presents an innovative bird‐view control framework for connected automated vehicles (CAV). Most recently tested automated vehicles are based on sensing systems equipped on the car body, which require the self‐driving policy to be robust and adaptive to various environmental uncertainties. Inspired by the vehicle to infrastructure technologies, the self‐driving technology can also be achieved through the communication between road infrastructure and the vehicle, where sensors are mainly installed on the road in a high position, which can collect traffic information from a bird‐view. To this end, we developed a fusion‐based Q‐learning method to yield an optimal bird‐view control policy for a CAV on a multi‐lane road. With our control policy, the CAV can drive smartly under complicated traffic environment, interacting with leading vehicles and crossing traffic simultaneously. A series of case studies show our CAV control policy is string stable and can avoid collisions under various scenarios.