Traffic signal phase control at urban isolated intersections: an adaptive strategy utilizing the improved D3QN algorithm

The intelligent control of traffic signals at urban single intersections has emerged as an effective approach to mitigating urban traffic congestion. However, the existing fixed phase control strategy of traffic signal lights lacks capability to dynamically adjust signal phase switching based on real-time traffic conditions leading to traffic congestion. In this paper, an adaptive real-time control method employed by the traffic signal phase at a single intersection is considered based on the improved double dueling deep Q network (I-D3QN) algorithm. Firstly, the traffic signal phase control problem is modeled as a Markov decision process, with its state, action, and reward defined. Subsequently, to enhance the convergence speed and learning performance of the D3QN algorithm, attenuation action selection strategy and priority experience playback technology based on tree summation structure are introduced. Then, traffic flow data from various traffic scenarios are utilized to train the traffic signal control model based on the I-D3QN to obtain the optimal signal phase switch strategy. Finally, the effectiveness and optimal performance of the I-D3QN-based traffic signal control strategy are validated across diverse traffic scenarios. The simulation results show that, compared with the control strategy based on actuated control, deep Q network, double deep Q network, D3QN, and C-D3QN algorithms, the cumulative reward of the proposed I-D3QN strategy is increased by at least 6.57%, and the average queue length and average waiting time are reduced by at least 9.64% and 7.61%, which can effectively reduce the congestion at isolated intersections and significantly improve traffic efficiency.