Open AccessTraffic network micro‐simulation model and control algorithm based on approximate dynamic programming
Author(s) -
Yin Biao,
Dridi Mahjoub,
El Moudni Abdellah
Publication year - 2016
Publication title -
iet intelligent transport systems
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.579
H-Index - 45
eISSN - 1751-9578
pISSN - 1751-956X
DOI - 10.1049/iet-its.2015.0108
Subject(s) - intersection (aeronautics) , traffic generation model , computer science , queue , dynamic programming , network traffic simulation , reinforcement learning , traffic simulation , representation (politics) , state (computer science) , signal (programming language) , algorithm , real time computing , network traffic control , engineering , artificial intelligence , computer network , network packet , politics , law , political science , programming language , aerospace engineering
This study presents the adaptive traffic signal control algorithm in a distributed traffic network system. The proposed algorithm is based on a micro‐simulation model and a reinforcement learning method, namely approximate dynamic programming (ADP). By considering traffic environment in discrete time, the microscopic traffic dynamic model is built. In particular, the authors explore a vehicle‐following model using cellular automata theory. This vehicle‐following model theoretically contributes to traffic network loading environment in an accessible way. To make the network coordinated, tunable state with weights of queue length and vehicles on lane is considered. The intersection can share information with each other in this state representation and make a joint action for intersection coordination. Moreover, the traffic signal control algorithm based on ADP method performs quite well in different performance measures witnessed by simulations. By comparing with other control methods, experimental results present that the proposed algorithm could be a potential candidate in an application of traffic network control system.