Search

Recently, with increasing urban traffic congestion, there has been an upsurge in studies on reinforcement learning for traffic signal control (RL-TSC), which enables efficient traffic management. However, most existing RL-TSC research relies on simulation, and instances of real-world application are relatively scarce. Furthermore, existing RL-TSC methods employ a step-based approach, controlling traffic signals every short step. This approach can be inefficient in oversaturated traffic conditions, where large deviations in traffic demand between movements prevent traffic signals from being effectively managed based on the overall traffic situation. In this study, we aim to transform simulation-based RL-TSC into a more practical and applicable model. We have developed a RL-TSC method capable of responding to oversaturated traffic conditions, designing an action space that enables the agent to derive an optimal signal set for every cycle length, thereby understanding the traffic situation across all movements. During each cycle length, our proposed model conducts traffic signal optimization and identifies the optimal signal through an iterative exploration. To facilitate a fast and accurate strategy search process, we developed a kinematic wave-based mesoscopic model. This model estimates the density across the entire link, based on collected traffic data and derives the state and reward values. We have validated the field applicability of the proposed RL-TSC method through a real-world demonstration at a congested intersection in Seoul, Korea. The results indicated a significant improvement in traffic congestion, with the average queue length at the intersection reduced by up to 11.4%. [ABSTRACT FROM AUTHOR]

Congestion is a kind of expression of instability of traffic network. Traffic signal control keeping traffic network stable can reduce the congestion of urban traffic. In order to improve the efficiency of urban traffic network, this study proposes a decentralized traffic signal control strategy based on backpressure algorithm used in Wi-Fi mesh networks for packets routing. Backpressure based traffic signal control algorithm can stabilize urban traffic network and achieve maximum throughput. Based on original backpressure algorithm, the variant parameter and penalty function are considered to balance the queue differential and capacity of downstream links in urban traffic network. For each traffic phase of intersections, phase weight is computed using queue differential and capacity of downstream links, which fixed the deficiency of infinite queue capacity in original backpressure algorithm. It is proved that the extended backpressure traffic signal control algorithm can maintain stability of urban traffic network, and also can prevent queue spillback, so as to improve performance of whole traffic network. Simulations are carried out in Vissim using Vissim COM programming interface and Visual Studio development tools. Evaluation results illuminate that it can get better performance than the backpressure algorithm just based on queue length differential in average queue length and delay of traffic network. [ABSTRACT FROM AUTHOR]

Signal control strategies for congested urban road networks designed in a centralized framework require many communication links, serious processing power, and infrastructure for the centralized coordination. As a result, strategies based on a centralized framework are not scalable. The use of decentralized signal control strategies for large-scale urban traffic networks is a solution to this problem, since it allows for the implementation of such strategies on networks whose centralized solution is not easily scalable. This paper addresses the problem of designing a decentralized traffic-responsive signal control solution, proposing two methods based on different formulations of the store-and-forward model: (i) the Decentralized Traffic-responsive Urban Control (DTUC) method; and (ii) the Decentralized Decoupled Traffic-responsive Urban Control (D2TUC). The decentralized configuration is such that each intersection is associated with one computational unit, with limited computational power and memory, which controls the traffic signals of the incoming links. Sufficient conditions for the controllability of the considered store-and-forward models are also presented. Both methods are validated resorting to numerical simulations of the urban traffic network of Chania, Greece, for two demand scenarios, and their performance is compared with the performance of the Traffic-responsive Urban Control (TUC) centralized strategy. One of the proposed decentralized methods, D2TUC, is shown to match the performance of TUC. • Design of decentralized signal control solutions based on the store-and-forward model. • Sufficient controllability conditions for the store-and-forward model are presented. • Two decentralized solutions are synthesized considering the network globally. • Validation resorting to numerical simulations of the traffic network of Chania. • One of the proposed decentralized solutions, D2TUC, matches the performance of TUC. [ABSTRACT FROM AUTHOR]

Due to the limitations of data transfer technologies, existing studies on urban traffic control mainly focused on isolated dimension control such as traffic signal control or vehicle route guidance to alleviate traffic congestion. However, in real traffic, the distribution of traffic flow is the result of multiple dimensions whose future state is influenced by each dimension's decisions. Presently, the development of the Internet of Vehicles enables an integrated intelligent transportation system. This paper proposes an integrated intelligent transportation model that can optimize predictive traffic signal control and predictive vehicle route guidance simultaneously to alleviate traffic congestion based on their feedback regulation relationship. The challenges of this model lie in that the formulation of the nonlinear feedback relationship between various dimensions is hard to describe and the design of a corresponding solving algorithm that can obtain Pareto optimality for multi-dimension control is complex. In the integrated model, we introduce two medium variables—predictive traffic flow and the predictive waiting time—to two-way link the traffic signal control and vehicle route guidance. Inspired by game theory, an asymmetric information exchange framework-based updating distributed algorithm is designed to solve the integrated model. Finally, an experimental study in two typical traffic scenarios shows that more than 73.33% of the considered cases adopting the integrated model achieve Pareto optimality. [ABSTRACT FROM AUTHOR]