Search

One of the focal points in the field of intelligent transportation is the intelligent control of traffic signals (TS), aimed at enhancing the efficiency of urban road networks through specific algorithms. Deep Reinforcement Learning (DRL) algorithms have become mainstream, yet they suffer from inefficient training sample selection, leading to slow convergence. Additionally, enhancing model robustness is crucial for adapting to diverse traffic conditions. Hence, this paper proposes an enhanced method for traffic signal control (TSC) based on DRL. This approach utilizes dueling network and double q-learning to alleviate the overestimation issue of DRL. Additionally, it introduces a priority sampling mechanism to enhance the utilization efficiency of samples in memory. Moreover, noise parameters are integrated into the neural network model during training to bolster its robustness. By representing high-dimensional real-time traffic information as matrices, and employing a phase-cycled action space to guide the decision-making of intelligent agents. Additionally, utilizing a reward function that closely mirrors real-world scenarios to guide model training. Experimental results demonstrate faster convergence and optimal performance in metrics such as queue length and waiting time. Testing experiments further validate the method's robustness across different traffic flow scenarios. [ABSTRACT FROM AUTHOR]

Trajectory data from connected vehicles (CVs) provide a continuous and reliable means of obtaining information that can be leveraged to optimize traffic signals. This paper proposes a real‐time traffic signal control method using CV trajectory data as the sole input. The primary goal of the proposed signal control method is to prevent queue spillover, which may significantly decrease the traffic efficiency on urban networks and induce high delays to the travelers. The proposed method formulates the signal control problem via a linear quadratic optimization model, considering the constraints related to the duration and variability of green lights in practical traffic signal control systems. Compared to conventional max‐pressure‐based methods, the optimization model offers enhanced efficiency in handling these constraints, making it highly suitable for real‐life implementation. The proposed method has undergone testing in both simulated environments and real‐world applications. In the simulation experiments, the proposed method has been demonstrated to effectively reduce spillover risks and outperform a conventional max‐pressure‐based approach even when the CV penetration rate is as low as 5%. In the real‐world experiment, the proposed method had been tested in a traffic network around the Beijing Capital International Airport for several months. The severity of spillovers, which was represented by two performance indicators, had been significantly reduced after implementing the proposed method. [ABSTRACT FROM AUTHOR]

Urbanization has led to accelerated traffic congestion, posing a significant obstacle to urban development. Traditional traffic signal scheduling methods are often inefficient and cumbersome, resulting in unnecessary waiting times for vehicles and pedestrians, exacerbating the traffic situation. To address this issue, this article proposes a dynamic traffic signal scheduling system based on an improved greedy algorithm. Unlike conventional approaches, we introduce a reward function and a cost model to ensure fair scheduling plans. A constraint function is also established, and the traffic signal scheduling is iterated through the feasible matrix using the greedy algorithm to simplify the decision-making process and enhance solution efficiency. Moreover, an emergency module is integrated to prioritize special emergency vehicles, reducing their response time during emergencies. To validate the effectiveness of our dynamic traffic signal scheduling system, we conducted simulation experiments using the Simulation of Urban Mobility (SUMO) traffic simulation suite and the SUMO traffic control interface Traci. The results indicate that our system significantly improves intersection throughput and adapts well to various traffic conditions, effectively resolving urban traffic congestion while ensuring fair scheduling plans. [ABSTRACT FROM AUTHOR]

The real-time vehicular traffic system is an integral part of the urban vehicular traffic system, which provides effective traffic signal control for a large multifaceted traffic network and is a highly challenging distributed control problem. Coordinating vehicular traffic enables the network model to deliver an efficient service flow. Consider that there are four lanes of vehicular traffic in this situation, allowing parallel vehicle movements to occur without causing an accident. In this instance, the vehicular system's control parameters are time and vehicle volume. In this work, vehicular traffic flow is examined, and an algorithm to estimate vehicle waiting time in each direction is estimated. The effectiveness of the proposed vehicle traffic signal distribution control system by comparing the experimental results with a real-time vehicular traffic system is verified. This is also illustrated numerically. [ABSTRACT FROM AUTHOR]

The transportation control infrastructure serves as the foundation for regional traffic signal control. However, in practice, this infrastructure is often imperfect and complex, characterized by factors such as heterogeneity and uncertainty, which pose significant challenges to existing methods and systems. Therefore, this paper proposes a novel approach to coordinated traffic signal control that emphasizes flexibility. To achieve this flexibility, we combine the flexible model of complex networks with robust fuzzy control methods. This approach enables us to overcome the complexity of the transportation control infrastructure and ensure efficient management of traffic signals. Additionally, to ensure long-term operational ease, we develop a regional traffic signal control system using steam computing technology, which provides high scalability and compatibility. Finally, computational experiments are performed to validate adaptability and performance of our proposed approach. [ABSTRACT FROM AUTHOR]

We studied the ability of deep reinforcement learning and self-organizing approaches to adapt to dynamic complex systems, using the applied example of traffic signal control in a simulated urban environment. We highlight the general limitations of deep learning for control in complex systems, even when employing state-of-the-art meta-learning methods, and contrast it with self-organization-based methods. Accordingly, we argue that complex systems are a good and challenging study environment for developing and improving meta-learning approaches. At the same time, we point to the importance of baselines to which meta-learning methods can be compared and present a self-organizing analytic traffic signal control that outperforms state-of-the-art meta-learning in some scenarios. We also show that meta-learning methods outperform classical learning methods in our simulated environment (around 1.5–2× improvement, in most scenarios). Our conclusions are that, in order to develop effective meta-learning methods that are able to adapt to a variety of conditions, it is necessary to test them in demanding, complex settings (such as, for example, urban traffic control) and compare them against established methods. [ABSTRACT FROM AUTHOR]

Cooperative control of vehicle trajectories and traffic signal phases is a promising approach to improving the efficiency and safety of transportation systems. This type of traffic flow control refers to the coordination and optimization of vehicle trajectories and traffic signal phases to reduce congestion, travel time, and fuel consumption. In this paper, we propose a cooperative control method that combines a model predictive control algorithm for adaptive traffic signal control and a trajectory construction algorithm. For traffic signal phase selection, the proposed modification of the adaptive traffic signal control algorithm combines the travel time obtained using either the vehicle trajectory or a deep neural network model and stop delays. The vehicle trajectory construction algorithm takes into account the predicted traffic signal phase to achieve cooperative control. To evaluate the method performance, numerical experiments have been conducted for three real-world scenarios in the SUMO simulation package. The experimental results show that the proposed cooperative control method can reduce the average fuel consumption by 1% to 4.2%, the average travel time by 1% to 5.3%, and the average stop delays to 27% for different simulation scenarios compared to the baseline methods. [ABSTRACT FROM AUTHOR]

An optimization model for traffic light control in an urban network of intersections is derived. The model is based on store-and-forward analytic relations, which account for the length of the queue of waiting vehicles in front of the traffic light intersection. The model is complicated with probabilistic relations that formalize the requirements for maintaining short queues of vehicles. Probabilistic inequalities apply to each intersection of the city network. Approximations of probability inequalities are given in the article. Quadratic deterministic inequalities, which are part of the set of the traffic flow control optimization problem, are derived. Numerical simulations are performed, applying mean estimated data for real traffic in an urban area of Sofia. The model predictive approach is applied to traffic light optimization and control. Empirical results give advantages of the obtained model compared to the classical store-and-forward optimization model for the total number of vehicles waiting in the considered urban network. [ABSTRACT FROM AUTHOR]

Observability and controllability are two critical requirements for a partially observable transportation system. This paper proposes a stepwise signal optimization framework with connected vehicle (CV) data as input to solve both challenges. First, a Bayesian deduction method based on low‐penetration CV data is established to estimate the traffic volume. Thereafter, an offline signal optimization model is constructed to simultaneously optimize the flexible lane settings and signal timings, which are set as the prior information for the third step. In the third step, an online deep recurrent Q‐learning (DRQN) signal optimization model dynamically adjusts signal settings based on real‐time traffic information. Numerical experiments demonstrate that the model outperforms the actuated control, the online DQRN model without offline filter, and the back‐pressure model by 9%–66% and 7%–29% in two networks. This study innovatively combines traffic state estimation and traffic signal control as an integrated process. It contributes to an improved understanding of traffic control in a CV environment and lays a solid foundation for future traffic control strategies. [ABSTRACT FROM AUTHOR]

This paper presents an analysis on the convergence to a steady state for the traffic dynamics in a network of signalized intersections. The links carrying the traffic from one intersection to another in the network are partitioned into a series of cells whose dynamics is modelled as a nonlinear cell transmission model. A microscopic convergence analysis is presented for the network where the traffic lights at the intersections are controlled by pre-timed control in which the average flow rate along each link is assumed to be known accurately. A macroscopic convergence analysis is applied to the traffic network where the traffic lights are controlled by coordinated model predictive control. In coordinated model predictive control, each local agent optimizes the switching times of traffic light at one intersection online with sampled local traffic state around this intersection and exchanged information from neighbouring intersections. A unique periodic function for the microscopic steady state is proved to exist under pre-timed control while a unique macroscopic steady state is achieved under coordinated model predictive control for the traffic lights. This paper validates by simulations that the ability of coordinated model predictive control to stabilize the traffic demand is not worse than pre-timed control even though the average flow rate along each link is not assumed to be known and further no explicit cycle time for the traffic light is suggested. Moreover, the incurred delay from the steady state is lower on the average under coordinated model predictive control compared to pre-timed control. • Presenting microscopic convergence analysis on pre-timed control • Proposing distributed model predictive control for traffic signals. • Presenting macroscopic convergence analysis on distributed control. • Validating claims on convergence of traffic signal control by simulations. [ABSTRACT FROM AUTHOR]

In order to improve the traffic capacity of the intersection and shorten the traffic delay, a new urban intelligent traffic signal coordination control system based on machine learning is proposed in this paper. The hardware of the system is designed, including annunciator, vehicle detection module, traffic flow statistics module and signal control module. The reinforcement learning algorithm in machine learning is used to train and learn the traffic vehicle data, so as to extract the spatial characteristics of the traffic environment state. Under the constraint of the minimum loss function, the training objective is solved and the output result of the optimal coordinated control of traffic signals is output. The experimental results show that compared with the traditional control system, the maximum traffic capacity of the intersection under the control of this system is 2400 vehicles/hour, and the maximum traffic delay is no more than 30s. [ABSTRACT FROM AUTHOR]

As our cities become more complex and traffic demand grows, managing such traffic efficiently becomes challenging. Hence, solutions that allow building upon the current traffic light systems and that can be readily deployed are of global interest. In this work, we address the challenge of improving traffic light management at intersections. We propose an agent-based traffic light control system where an agent, one per intersection, dynamically regulates the light's phase cycle depending on the current traffic conditions. To this end, we will rely on Deep Networks to adequately train agents to make good decisions. Simulation results in a realistic scenario using SUMO show that our proposed approach can significantly reduce waiting times, improving transit times by 44% compared to the standard fixed-timing method. Additionally, to assess the effectiveness and reliability of our control algorithm, we introduce new performance metrics. [Display omitted] • A distributed neural network-based agent system optimizes traffic in superblocks. • Every agent manages one intersection using deep Q-learning with experience replay. • Each agent optimizes its intersection and reduces vehicle waiting times. • Compared with fixed time, our algorithm achieves a 44% reduction in waiting times. • Thanks to deep Q-networks, changes in agents' actions allow traffic light adaptation. [ABSTRACT FROM AUTHOR]

A distributed method for concurrent traffic signal and routing control of traffic networks is proposed. The method is based on the multi-commodity store-and-forward model, in which the destinations are the commodities. The system benefits from the communication between vehicles and infrastructure, providing optimal signal timings to intersections and routes to vehicles on a link-by-link basis. Using the augmented Lagrangian to model the constraints into the objective, the baseline centralized problem is decomposed into a set of objective-coupled subproblems, one for each intersection, enabling the solution to be computed by a distributed-gradient projection algorithm. The intersection agents only need to communicate and coordinate with neighboring intersections to ensure convergence to the optimal solution while tolerating suboptimal iterations that offer more flexibility, unlike other distributed approaches. Through microsimulation, we demonstrate the effectiveness of the proposed algorithm in traffic networks with time-varying demand. Computational analysis shows that the distributed problem is suitable for real-time applications. A robustness analysis show that the distributed formulation enables a graceful degradation of the system in case of failure. • A multi-commodity traffic flow model cast into a linear dynamic network. • A distributed algorithm for linear dynamic networks and in particular applicable to multi-commodity urban signal traffic control and routing in a connected vehicle environment. • Demonstration of the real-time applicability and robustness to failure of the proposed algorithm and model. • Comparison through microscopic simulation with the corresponding centralized approach, with a decentralized backpressure algorithm, and with fixed-time. [ABSTRACT FROM AUTHOR]

Adaptive traffic signal control (ATSC) is an effective method to reduce traffic congestion in modern urban areas. Many studies adopted various approaches to adjust traffic signal plans according to real-time traffic in response to demand fluctuations to improve urban network performance (e.g., minimise delay). Recently, learning-based methods such as reinforcement learning (RL) have achieved promising results in signal plan optimisation. However, adopting these self-learning techniques in future traffic environments in the presence of connected and automated vehicles (CAVs) remains largely an open challenge. This study develops a real-time RL-based adaptive traffic signal control that optimises a signal plan to minimise the total queue length while allowing the CAVs to adjust their speed based on a fixed timing strategy to decrease total stop delays. The highlight of this work is combining a speed guidance system with a reinforcement learning-based traffic signal control. Two different performance measures are implemented to minimise total queue length and total stop delays. Results indicate that the proposed method outperforms a fixed timing plan (with optimal speed advisory in a CAV environment) and traditional actuated control, in terms of average stop delay of vehicle and queue length, particularly under saturated and oversaturated conditions. [ABSTRACT FROM AUTHOR]

Due to the nonlinearity and dynamics of transportation systems, traffic signal control (TSC) in urban traffic networks has always been an important challenge. In recent years, model predictive control (MPC) has shown extraordinary potential in TSC due to its outstanding ability to model dynamic systems. However, the relatively complex online computing, lack of reasonable setpoints for target solving, and uncertainty of traffic network hinder MPC from being further applied. To address these problems, we propose a hierarchical, distributed, and robust model predictive control (HD-RMPC) framework for urban TSC. At the slow-update layer, the road network is dynamically divided into several subareas according to regional attributes and real-time traffic demand. Meanwhile, the volume is coordinated in a robust way for the purpose of traffic equilibrium and overflow prevention. Then, the set-point matrix of each subarea is calculated to equalize the flow in the subarea. This distributed framework guarantees the real-time performance of MPC in urban traffic networks. At the fast-update layer, we adopt an improved prediction model by explicit modeling of the disturbance and reduce the prediction error. Finally, the objective function is reconstructed and solved at the control layer to obtain the optimal control law. Through continuous and asynchronous optimization of the set point and prediction model, the framework significantly improves the control effect. Simulation evaluation based on a real-world road network demonstrates that the proposed HD-RMPC method outperforms all baselines and maintains excellent real-time performance. [ABSTRACT FROM AUTHOR]

Following major hazards and incidents, it is crucial to mitigate the congestion at intersections of urban traffic systems with disruptions; maximize the evacuation, rescue, and recovery efficiency; and prevent a hazard from turning into a disaster. An optimized traffic signal design strategy can effectively contribute to maintaining an efficient traffic system operation despite various disruptions. Most of the existing studies focused on static and generic congestion scenarios during the recovery stage, rather than realistic time-progressive scenarios covering the whole process following a disruption. An adaptive traffic signal control strategy in response to traffic disruptions at a single intersection is proposed by covering both the incident and recovery stages. Dynamic phase selection (DPS) technology is applied to adjust the traffic signal control plan adaptively during the incident stage, while the queue length dissipation (QLD) algorithm is adopted to carry out optimal green time calculation during the recovery stage. The proposed methodology is demonstrated by considering disruptions caused by several typical vehicle crashes at intersections. The proposed DPS+QLD traffic signal strategy is found to improve the resiliency of a typical intersection against disruptions by clearing queues faster, reducing overall traffic loss time, and maintaining stable mobility with superior performance over conventional fixed and actuated traffic signal plans. DOI: 10.1061/JTEPBS.0000671. [ABSTRACT FROM AUTHOR]

Traffic congestion is becoming a serious problem with the large number of vehicle on the roads. In the traditional traffic control system, the timing of the green light is adjusted regardless of the average traffic rate at the junction. Many strategies have been introduced to solve and improve vehicle management. However, in order to handle road traffic issues, an intelligent traffic management solution is required. This article represents a self adaptive real-time traffic light control algorithm based on the traffic flow. We present a machine learning approach coupled with image processing to manage the traffic clearance at the signal junction. The proposed system utilizes single image processing via neural network and You Only Look Once (YOLOv3) framework to establish traffic clearance at the signal. We employed YOLO architectures because it is accurate in terms of mean average precision (mAP), interaction over union (IOU) values and fast in object detection tasks as well. It runs significantly faster than other detection methods with comparable performance. The average processing time of single image was estimated to be 1.3 s. Further based on the input from YOLO we estimated the 'on' time period green light for effective traffic clearance. Several real time parameters like number of vehicles (two wheelers, four wheelers), road width and junction crossing time are considered to estimate the 'on'time of green light. Moreover, we used the real traffic images to test the performance and trained the system with different dataset. Our experiments investigation reveals that the predicted vehicle counts were well matched with the actual vehicle count and proposed method apprehended an average accuracy of 81.1%. The reported strategy is self adaptive, highly accurate, fast and has the potential to be implemented in the traffic clearance at the junctions. [ABSTRACT FROM AUTHOR]

Urban traffic control (UTC) is inherently multiscale in both temporal and spatial domains. With the wide deployment of connected and automated vehicles (CAVs), data is increasingly available to help reveal this multiscale nature of UTC and the inter-dynamics among different scales. This paper applies the multiscale UTC framework we proposed earlier and extends it to UTC on a network of traffic signals with a mixed flow of CAVs and human-driven vehicles (HDVs). We adopt distributed control as the basic scheme for network-wide control and use information sharing to achieve cooperation among different intersections. We use CAV information to estimate HDV state and develop a "safety check" technique to control CAVs in the mixed traffic flow. Together, we propose a network-wide UTC framework with mixed traffic flow. To address the computation issue of the model-based multiscale method, we develop an imitation learning (IL) enhanced data-driven method to improve the computation efficiency. Specifically, we use a convolutional neural network (CNN) to represent the policies of the slower-scale signal control problem and use the data aggregation method as the learning framework to improve the policies. This algorithm's unique feature is that IL policies' training is based on the optimized results from the model-based multiscale control method. We test the model-based and IL-based methods in simulation, under various traffic scenarios and on multiple networks. We also test the transferability property of the IL-based method by training individual intersection control separately in small networks and applying them to larger networks with various types of intersections. [ABSTRACT FROM AUTHOR]

In the domain of complex urban traffic networks, real-time Traffic Signal Control (TSC) serves as a pivotal strategy for mitigating congestion. Coordinating signal control across multiple intersections involves considerable complexity. Deep Reinforcement Learning (DRL) has emerged as a robust solution. In recent years, there has been rapid advancement in TSC methods, with numerous researchers employing various novel DRL methodologies. Yet, existing surveys lack timeliness and universality in capturing the latest research. There is a notable gap in current research surveys with respect to the latest developments in TSC. Therefore, the focus of this paper lies in analyzing the most recent papers from the past five years, with the aim to provide a comprehensive and multi-dimensional review of the evolution of DRL in TSC. The survey categorizes current research based on model setups, utilized algorithms, and application scenarios. Finally, this paper highlights potential directions for future TSC research. [ABSTRACT FROM AUTHOR]

Traditional traffic signal control is one of the most widely used urban traffic control methods, due to its high efficiency, robustness, and simplicity. However, in the era of connected and automated vehicles (CAVs), it is prospective to enhance traffic control precision and achieve vehicle coordination in a more efficient manner. Focusing on an isolated intersection, this study proposes an innovative concept of Fine-grained Phase (FP) for CAV-enabled traffic control, which realizes more refined right-of-way allocation than traditional signal phases while preserving the simplicity and scalability. The development of FP jointly optimizes traffic control strategy and intersection layout design to fully utilize time-space resources, and multiple forms of FP could be generated in response to various traffic demands; meanwhile, vehicle coordination is achieved in an offline–online manner to balance solution quality and efficiency. Under the FP-based control, each lane is assigned with periodical entry time points using FP design results, then vehicles are supposed to catch up with the appropriate time points to fulfill their trips. Theoretical analyses are conducted under stationary vehicle arrival patterns, where the average delay and the intersection capacity associated with different forms of FP can be analytically acquired. For the implementation of FP-based control, we construct a general offline–online framework, consisting of an offline model that optimizes the geometry of the conflict zone at intersections and the control strategy of vehicles simultaneously, which is formulated as a mixed-integer linear programming problem, and an online FP adoption mechanism that can adapt to varying demand patterns. Under the framework, limited online computation is required, facilitating its practical real-time implementation. Simulation studies under a variety of demand settings show that FP-based control is advantageous over benchmark methods in reducing vehicle delay and also improving intersection capacity in most cases; even for cases with extremely imbalanced demands, FP-based control can admit comparable throughput, while the average delay is much smaller. In addition, results of computation time reveal that FP-based control could realize real-time implementation with negligible computation burden. • An innovative concept called FP for intersection traffic control with CAVs. • Joint optimization of traffic control and intersection layout design. • Offline–online implementation framework to balance solution quality and efficiency. • Theoretical analysis for average vehicle delay and admissible traffic capacity. • Improvement over signalized control and the state-of-art reservation strategy. [ABSTRACT FROM AUTHOR]

Urban traffic control systems (UTCSs) are deployed to a great number of urban cities despite lacking feedback when adjusting the traffic signals. The development of reinforcement learning (RL) makes it possible to apply feedback to UTCS, and great efforts have been made on RL-based traffic control strategies. However, those studies are regardless of the traffic flow theory of the network and the road users' perspectives on the performance of traffic. This study proposes a multiagent reinforcement learning (MARL) based traffic control strategy, in which each intersection in a macroscopic fundamental diagram (MFD) region was controlled by one agent using the level of services (LOS) and MFD-based parameters as rewards. The proposed MARL strategy was evaluated by simulation in a 3×3 grid network compared with pretimed, actuated, and MFD-based traffic control strategies. The evaluation results showed that, at different demand levels, the proposed MARL strategy outperforms the other three traffic control strategies in terms of average intersection queue length and average intersection waiting time to a different extent. Results also showed that the proposed MARL dissipated the congestion faster than the other three control strategies. Results of the Friedman test indicated that the differences in performances between the proposed MARL and other strategies were statistically significant regardless of the demand level. The MFD in the testbed network controlled by the proposed MARL was different from that controlled by the pretimed strategy, especially the MFD scatter plot. It provides insights on considering the traffic flow theory of the network when applying MARL to traffic control strategies. [ABSTRACT FROM AUTHOR]

Real-time traffic signal control has long been a critical way to improve traffic congestion. Transit Signal Priority (TSP) is seen as a cost-effective way to reduce travel time variability. Most of the previous studies develop real-time signal control systems on a vehicle basis, which is unable to efficiently provide preferential treatment on transit vehicles. Person-based signal control systems, which transform traffic delay computation units from vehicle to passenger, have been proposed to try to address this limitation. However, their models, optimizing signal plan cycle-by-cycle, cannot rapidly respond to traffic variations. This study proposes a Person-based Adaptive traffic signal control method with Cooperative Transit signal priority (PACT). In PACT, not only do Road-Side Units (RSUs) perform signal optimization, but also On-Board Units (OBUs) provide in-vehicle speed advisory to reduce delays. The interaction between RSU and OBU is conducted second-by-second, which has high adaptability to traffic variations. Experiments are performed based on real traffic data via traffic simulation platform SUMO. The results indicate that PACT can efficiently reduce delays of both bus passengers and auto passengers at a signalized intersection. Compared to preoptimized signal plans, the results show that each passenger on transit vehicles experiences 33%–70% decreases in delays, and each auto passenger experiences 3%–29% decreases in delays. PACT can reduce 80%–98% in delays when the occupancy weight factor is relatively large, showing the potential of extending PACT on performing signal preemption. [ABSTRACT FROM AUTHOR]

Though effective in theoretical simulation, the established traffic control models and optimization algorithms will result in model mismatch or even control strategy failure in actual application. However, they are commonly adopted in traffic signal control research, resulting in the unavailability of many exceptional control algorithms in practice. Simulation should function as a bridge between theoretical research and actual application, allowing the gap between the two to be communicated and made up for. However, an effective connection between the two has yet to be established to enable simulation methods in existing traffic control research. To this end, we designed and developed a simulation platform for "Online Application—HILS (Hardware-in-the-Loop Simulation)—Practice" integration over traffic signal control. In this paper, the architecture and characteristics of the integrated simulation platform were described. Besides, the function of each module of the platform was detailed, followed by listing simulation examples for six complex scenarios, with the active control scenario being selected for simulation comparison analysis. The findings demonstrated extensive road network simulation with the integrated simulation platform, multidimensional control variables, control strategies with support, as well as stable and reliable operation. It can be used to verify several sorts of traffic control simulation with variable dimensions. [ABSTRACT FROM AUTHOR]

Though effective in theoretical simulation, the established traffic control models and optimization algorithms will result in model mismatch or even control strategy failure in actual application. However, they are commonly adopted in traffic signal control research, resulting in the unavailability of many exceptional control algorithms in practice. Simulation should function as a bridge between theoretical research and actual application, allowing the gap between the two to be communicated and made up for. However, an effective connection between the two has yet to be established to enable simulation methods in existing traffic control research. To this end, we designed and developed a simulation platform for "Online Application—HILS (Hardware-in-the-Loop Simulation)—Practice" integration over traffic signal control. In this paper, the architecture and characteristics of the integrated simulation platform were described. Besides, the function of each module of the platform was detailed, followed by listing simulation examples for six complex scenarios, with the active control scenario being selected for simulation comparison analysis. The findings demonstrated extensive road network simulation with the integrated simulation platform, multidimensional control variables, control strategies with support, as well as stable and reliable operation. It can be used to verify several sorts of traffic control simulation with variable dimensions. [ABSTRACT FROM AUTHOR]

Concerning the critical role of Intelligent Transportation System (ITS) in tackling the problem of traffic congestion, and enhancing the safety, mobility and sustainability of the transport network, this paper provides a comprehensive review of recent developments in Connected Vehicle (CV) technology, its features and terminology. The real-world implementation of the CV technologies can result in a better understanding of the practical and technical issues. Given the technical and conceptual challenges, as well as novelty factors associated with CVs, many CV pilot studies around the world are reviewed, and their findings are summarized. The paper contributes to the literature by reviewing the characteristics, communication platform, multimodality, size and type of study areas of the pilot CV testbeds across the world. This research also paves the way for the better development of CV technology by comparing and discussing the pros and cons of the existing CV pilot testbeds. Moreover, we have discussed the evaluation plans and the advantages and disadvantages of different testbeds. Besides, as a main component of the CV system, the traffic signal control algorithms, as well as transit signal priority in a CV ecosystem, are also reviewed. Based on our findings, the real-time data obtained from the CV system could result in a better adjustment of traffic signal parameters which consequently enhance the traffic regulation in the network (say up to 30% in terms of travel time in comparison with an actuated coordinated traffic signal). However, a major criticism of the existing traffic signal strategies in a CV system is that they do not utilize the maximum capability of the CV system (V2 V, V2I and I2I communications). [ABSTRACT FROM AUTHOR]

In this paper, we present a decentralized control framework for the coordination of connected vehicles and traffic lights in urban intersections. The framework uses gradient-based methods to dynamically coordinate, at every time-step, the planned intersection arrival times of vehicles and the planned switching times of traffic lights. Assuming no constraints, vehicles then use analytical optimal control methods to determine a nominal acceleration profile intended to place them at the intersection at the desired arrival time. Finally, using control barrier functions, the agents' accelerations and arrival times are modified to ensure safety and feasibility. The work in this paper builds on existing research on safe-set nonlinear control methods, multi-agent gradient-based methods, and optimal control methods used to tackle the intelligent intersection management problem. Here, we integrate the use of these different approaches to present a comprehensive control architecture that can flexibly coordinate the timing of both vehicles and traffic lights, while maintaining safety and feasibility. Simulations show that the method can save between 4% and 15% in fuel consumption and between 55% and 70% in delay for different traffic conditions. [ABSTRACT FROM AUTHOR]

In complex urban intersection scenarios, due to heavy traffic and signal control, there are many slow-moving or temporarily stopped vehicles behind the stop lines. At these intersections, it is difficult to extract traffic parameters, such as delay and queue length, based on vehicle detection and tracking due to the dense and severe occlusion of vehicles. In this study, a novel background subtraction algorithm based on sparse representation is proposed to detect the traffic foreground at complex intersections to obtain traffic parameters. By establishing a novel background dictionary update model, the proposed method solves the problem that the background is easily contaminated by slow-moving or temporarily stopped vehicles and therefore cannot obtain the complete traffic foreground. Using the real-world urban traffic videos and the PV video sequences of i -LIDS, we first compare the proposed method with other detection methods based on sparse representation. Then, the proposed method is compared with other commonly used traffic foreground detection models in different urban intersection traffic scenarios. The experimental results show that the proposed method performs well in keeping the background model being unpolluted from slow-moving or temporarily stopped vehicles and has a good performance in both qualitative and quantitative evaluations. [ABSTRACT FROM AUTHOR]

The store-and-forward traffic model is widely used because of its simplicity and reasonable comprehension. Its results determine the duration of the green light according to a preset cycle. This paper builds further on the currently existing model: it expands the definitional domain of the optimization problem by adding additional probabilistic requirements regarding the number of vehicles in a street segment between intersections controlled by traffic lights. The defined optimization problem minimizes the probability of increasing the number of vehicles in the considered transport network. A further extension of the store-and-forward model allows the control domain to contain both green lights and cycle durations. Such optimal control allows the achievement of additional objective functions such as minimizing the number of vehicles in the network and minimizing the total time spent through the network. The definition of this control problem is done through a bi-level hierarchical formalization involving the store-and-forward model. The derived extended models are numerically tested and compared with real cases, giving preference to the derived extensions of the classical store-and-forward model. [ABSTRACT FROM AUTHOR]

Recently, with increasing urban traffic congestion, there has been an upsurge in studies on reinforcement learning for traffic signal control (RL-TSC), which enables efficient traffic management. However, most existing RL-TSC research relies on simulation, and instances of real-world application are relatively scarce. Furthermore, existing RL-TSC methods employ a step-based approach, controlling traffic signals every short step. This approach can be inefficient in oversaturated traffic conditions, where large deviations in traffic demand between movements prevent traffic signals from being effectively managed based on the overall traffic situation. In this study, we aim to transform simulation-based RL-TSC into a more practical and applicable model. We have developed a RL-TSC method capable of responding to oversaturated traffic conditions, designing an action space that enables the agent to derive an optimal signal set for every cycle length, thereby understanding the traffic situation across all movements. During each cycle length, our proposed model conducts traffic signal optimization and identifies the optimal signal through an iterative exploration. To facilitate a fast and accurate strategy search process, we developed a kinematic wave-based mesoscopic model. This model estimates the density across the entire link, based on collected traffic data and derives the state and reward values. We have validated the field applicability of the proposed RL-TSC method through a real-world demonstration at a congested intersection in Seoul, Korea. The results indicated a significant improvement in traffic congestion, with the average queue length at the intersection reduced by up to 11.4%. [ABSTRACT FROM AUTHOR]

• Systematic review on urban traffic control under mixed traffic with CAVs. • Cover signal timing, CAV trajectory/route planning, and their cooperative control. • Summarize mixed traffic control methods at intersections with CAV-dedicated facilities. • Outline promising research directions and challenges. Efficient traffic control can alleviate traffic congestion, reduce fuel consumption, and improve traffic safety. With the development of communication and automation technologies, regular vehicles (RVs), connected vehicles (CVs), and connected and automated vehicles (CAVs) will coexist on urban roads in the near future. In this paper, we systematically review the studies on urban traffic control under the mixed traffic environment, which utilize CVs and CAVs to improve the performance of urban traffic control. We first give a glance at the evolution of urban traffic control with the deployment of CVs and CAVs to identify the important and promising research fields in the mixed traffic control. We then review the recent advances in traffic signal timing with CAV/CV trajectory data, CAV trajectory/route planning, and the cooperative control of CAV trajectories and traffic signals from the intersection level to the network level under the mixed traffic environment. Besides, we summarize two types of studies on mixed traffic control at intersections with CAV-dedicated facilities: 1) traffic signal timing and vehicle trajectory planning at intersections with CAV-dedicated lanes, and 2) deployment of CAV-dedicated facilities including CAV-dedicated lanes, links, and zones. Finally, the future research directions and challenges are discussed. We hope that this review could provide researchers with a helpful roadmap for future research on urban traffic control under the mixed traffic environment. [ABSTRACT FROM AUTHOR]

The present paper's focus is the V2X (Vehicle-to-Everything) communication between traffic light controller and road vehicles. After a brief review on the state-of-the-art V2X communication technologies and their feasibility for practical implementation, a brief description of their potential is discussed providing a working solution for SPaT/MAP (Signal Phase and Timing and MAP as intersection geometry) standard based communication, specifically for automotive proving ground usage. The main outcome of the proposed solution is a full y flexible traffic control system applying industrial PLC while ensuring a standardized V2X protocol. As a demonstrative HiL (Hardware-in-the-Loop) example, exploiting the elements of the traffic management system at the ZalaZONE Automotive Proving Ground, a GLOSA (Green Light Optimal Speed Advisory) scenario is presented with the developed SPaT/MAP V2X communication realizing a global optimum traffic control solution. The more, the whole framework is designed in a way that it is capable of using mixed reality components for testing purposes and realizing a digital twin for traffic lights. The method of virtualization for V2X communication is introduced using a co-simulation framework of three common software tools (SUMO, Veins, and OMNeT++). [Display omitted] • CAVs integrate wireless communication technologies also towards the traffic lights. • SPaT/MAP messages are used for V2I/I2V communication based traffic light control. • A prototype of V2I/I2V communication is shown for ZalaZONE Automotive Proving Ground. • The SPaT/MAP based communication features mixed reality and digital twin technologies. • The featured GLOSA algorithm realizes a global optimum control. [ABSTRACT FROM AUTHOR]

• The study explored the difference in mobile phone use while driving across the time of day. • The impact of roadway design, traffic operation, and traffic control were different across morning, evening, and off-peak, investigated by structural equation modeling (SEM) in a naturalistic and big data environment. • High roadway design level increased the participation of mobile phone use while driving in the morning peak. • Strong traffic control encouraged drivers to engage in mobile phone use while driving. Mobile phone distracted driving (MPDD) is one of the most significant and common factors in distraction-affected crashes. In previous studies, MPDD has been described as a self-selected behavior that affects driving performance, rather than a multidimensionally impacted behavior. In this study, the researchers hypothesized that external environmental features significantly impacted MPDD and tested this hypothesis by structural equation modeling (SEM). Three external latent variables (road, operation, and control factors) were measured at different times during weekdays in urban areas of Texas by integrating a large number of mobile phone sensor data and roadway inventory data. A structural model was developed to test the relationship between the latent variables and the rate of drivers involved in MPDD (MPDDR) on the roadway during different time periods. Finally, the data summary and model results revealed significant temporal effects. Standardized estimates from the SEM results revealed the positive impact of roads factors in the morning peak that broader shoulders, wider medians, and smaller curve radians were correlated with higher MPDDR in the morning peak hours; the negative impact of operation factors that higher average annual daily truck traffic (truck AADT) were associated with lower MPDDR significantly. And the impact of control factors on MPDDR is positive. In other words, the road segments with a large number of traffic signals in urban areas had a higher MPDDR than those without traffic signals. These findings could assist transportation and legislation agencies in the development of appropriate countermeasures or enforcement tactics and implement them effectively to reduce the occurrence of MPDD. In addition, this study provides a novel perspective close to the actual consideration of drivers about using mobile phones while driving, in the context of MPDD research, rather than comparing driver groups and vehicle performance. [ABSTRACT FROM AUTHOR]

Traffic congestion in urban environment is one of the most critical issue for drivers and city planners for both environment and efficiency reasons. Traffic lights are one of the main tools used to regulate traffic by diverting the drivers between different paths. Rational drivers, in turn, react to the traffic light duration by evaluating their options and, if necessary, by changing direction in order to reach their destination quicker. In this paper, we introduce a macroscopic traffic model for urban intersections that incorporates this rational behavior of the drivers. Then, we exploit it to show that, by providing additional information about the expected red-time duration to the drivers, one can decrease the amount of congestion in the network and the overall length of the queues at the intersections. Additionally, we develop a control policy for the traffic lights that exploits the reaction of the drivers in order to divert them to a different route to further increase the performances. These claims are supported by extensive numerical simulations. • A traffic-flow macroscopic model of the drivers' rational decision-making. • It considers origin-destination pairs and the ability to show the red time duration. • Numerical simulations illustrate the effectiveness of showing the red time duration. • A novel control policy that exploit the drivers' reaction to the red time duration. • The increased efficiency of the controller is validated with extensive simulations. [ABSTRACT FROM AUTHOR]

The majority of fuel consumed in traffic on urban arterials is related to driving in congested traffic, characterized by frequent speed fluctuations and stops at signalized intersections. A range of traffic control strategies was suggested in the past to decrease fuel consumption and emissions in urban networks. The research presented in this study aims to fill the gap in the existing knowledge by proposing a novel combination of an ecology-based performance index and an evolutionary method for optimization of traffic signal settings. An optimization problem is defined to find the best values for traffic light control parameters on the street network. The ecology-based performance index is used as the criteria for optimization. The defined problem is solved by the Bee Colony Optimization (BCO) technique. The geometry of the subject network has been inserted into a Vissim model calibrated by using relevant traffic demand and field-measured travel times. The Vissim has been used as the tool for the evaluation of the proposed BCO, TRANSYT-7F (T7F) and field signal timing plans. The methodology is tested on the field-real-like network of the City of Kragujevac, Serbia. Results show that in the case of the overall network ecology performance index, BCO makes a decrease of 11.95 % and 8.47% compared to the signal timings from field and T7F, respectively. • Proposed an ecology-based fixed-time control logic for street networks. • The model uses a BCO algorithm and derives control parameters. • A VISSIM simulation estimates the quality of the proposed control algorithm. • TRANSYT-7F and field signal plans are used for comparison with the BCO algorithm. • The model is tested on the field-real-like network of the City of Kragujevac. [ABSTRACT FROM AUTHOR]

Improvement of traffic signal control (TSC) efficiency has been found to lead to improved urban transportation and enhanced quality of life. Recently, the use of reinforcement learning (RL) in various areas of TSC has gained significant traction; thus, we conducted a systematic literature review as a systematic, comprehensive, and reproducible review to dissect all the existing research that applied RL in the network-level TSC domain, called as RL in NTSC or RL-NTSC for brevity. The review only targeted the network-level articles that tested the proposed methods in networks with two or more intersections. This review covers 160 peer-reviewed articles from 30 countries published from 1994 to March 2020. The goal of this study is to provide the research community with statistical and conceptual knowledge, summarize existence evidence, characterize RL applications in NTSC domains, explore all applied methods and major first events in the defined scope, and identify areas for further research based on the explored research problems in current research. We analyzed the extracted data from the included articles in the following seven categories: (i) publication and authors' data, (ii) method identification and analysis, (iii) environment attributes and traffic simulation, (iv) application domains of RL-NTSC, (v) major first events of RL-NTSC and authors' key statements, (vi) code availability, and (vii) evaluation. This paper provides a comprehensive view of the past 26 years of research on applying RL to NTSC. It also reveals the role of advancing deep learning methods in the revival of the research area, the rise of using non-commercial microscopic traffic simulators, a lack of interaction between traffic and transportation engineering practitioners and researchers, and a lack of proposal and creation of testbeds which can likely bring different communities together around common goals. • A review on Reinforcement Learning in the network-scale Traffic Signal Control area. • Presents a comprehensive systematic literature review of 160 included articles. • Consolidates and characterizes the existing research on the defined area. • Explores the methods, applications, domains, and first events in the defined scope. • Identifies past and present trends and directions for further research in the area. [ABSTRACT FROM AUTHOR]

Previous studies have shown that the max pressure control is a throughput-optimal policy that can stabilize the store-and-forward traffic network when the demand is within the network capacity. Most of the existing studies on the max pressure control do not consider the loss of capacity associated with phase switching, which will undermine the stability of the network. This work proposes a novel framework that utilizes reinforcement learning algorithms to optimize a max pressure controller considering the phase switching loss. We extend the max pressure control by introducing a switching curve and prove that the proposed control method is throughput-optimal in a store-and-forward network. Then the theoretical control policy is extended by using a distributed approximation and position-weighted pressure so that the policy-gradient reinforcement learning algorithms can be utilized to optimize the parameters in the policy network including the switching curve and the weight curve. Simulation results show that the proposed control method greatly outperforms the conventional max pressure control. The proposed framework combines the strengths of the data-driven method and the theoretical control model by utilizing reinforcement learning algorithm to optimize the max pressure controller, which is also of great significance for real-world implementations because the proposed control policy can be generated in a distributed fashion based on local observations. • Extend the original max pressure control by adding the phase switching loss. • Propose a Switching-Curve based Max Pressure (SCMP) control framework with a stability proof. • Propose a novel framework utilizing the policy gradient RL algorithms to improve the max pressure control. [ABSTRACT FROM AUTHOR]

Guaranteeing the quality of transit service is of great importance to promote the attractiveness of buses and alleviate urban traffic issues such as congestion and pollution. Emerging technologies of automated driving and V2X communication have the potential to enable the accurate control of vehicles and the efficient organization of traffic to enhance both the schedule adherence of buses and the overall network mobility. This study proposes a novel network-level control scheme for heterogeneous automated traffic composed of buses and private cars under a full connected and automated environment. Inheriting the idea of network-level rhythmic control proposed by Lin et al. (2021b), an innovative rhythmic control scheme for heterogeneous traffic, i.e., RC-H, is established to organize the mixed traffic in a rhythmic manner. Realized virtual platoons are designed for accommodating vehicles to pass through the network, including dedicated virtual platoons for buses to provide exclusive right-of-ways (ROWs) on their trips and regular virtual platoons for private cars along with an optimal assignment plan to minimize the total travel cost. A mixed-integer linear program (MILP) is formulated to optimize the RC-H scheme with the objective of minimizing the weighted travel costs of both buses and private cars. A bilevel heuristic solution method is designed to relieve the computational burden of MILP. Numerical examples and simulation experiments are conducted to evaluate the performance of the RC-H scheme under different scenarios. The results show that the bus punctuality can be guaranteed and the traveler delay can be minimized under various demand levels with transit priority. Moreover, compared with traffic signal control (TSC) strategies, including those with fixed timing and those with bus priority, the RC-H scheme shows significant advantages in handling heavy traffic demand, in terms of both reducing vehicle delay and enhancing network throughput. • An innovative network-level control scheme for heterogeneous automated traffic. • Different realized virtual platoons for accommodating vehicles to pass through the network. • An optimal design model of RC-H scheme considering bus priority. • A bilevel heuristic solution method to relieve the computational burden. • Simulation experiments to test the performance of RC-H scheme and compare with TSC. [ABSTRACT FROM AUTHOR]

Heterogeneity is widely observed in various aspects of urban transport, such as road types, vehicle dynamics, and demand patterns, which greatly complexifies transport systems and hinders the successful control and management of traffic. On one hand, intelligent strategies are required to relieve the loss of efficiency caused by the mixed traffic flow composed of vehicles with different speeds; on the other hand, the spatial heterogeneity of travel demand distribution requires pertinent control schemes to improve the network-level mobility and the phenomenon of oversaturation under heavy traffic also demands an appropriate way to resolve. Leveraging the advantages of connected and automated vehicle (CAV) technology, this study proposes a multi-rhythm control (MRC) scheme to accommodate heterogeneous network traffic in a CAV environment with 100% penetration rate. While the rhythmic control (RC) proposed by (Lin et al., 2021) could organize traffic efficiently and in an orderly manner, the multi-rhythm strategy has greater potential to not only improve the efficiency of heterogeneous traffic by the design of different virtual platoons (VPs) catering to different vehicle types, but also address the spatial heterogeneity of network traffic by implementing differentiated cycle lengths among the road network. For the optimal design of the MRC scheme, a two-step model is developed to minimize the total travel cost, where the first step focuses on the mesoscopic level to jointly optimize the multi-rhythm scheme, VP design and lane configuration for both undersaturated and oversaturated cases, while the second step focuses on the microscopic design to optimize the space–time trajectories of VPs under the premise of collision free. Numerical examples and simulation experiments are conducted to test the performances of the MRC scheme compared to a naive version of RC with a homogeneous rhythm and a traffic signal control (TSC) strategy. The results show that among all control strategies, the MRC scheme has the best performance under all kinds of demand patterns, which is reflected in both the lowest travel cost and the highest network throughput. • A multi-rhythm control strategy to accommodate heterogeneous network traffic. • Different kinds of virtual platoons to enable compatible movements for vehicles. • A two-step model to solve the optimal design problem of MRC scheme for various saturated cases. • Simulation experiments to validate the performance of the MRC scheme. [ABSTRACT FROM AUTHOR]

Reinforcement Learning (RL) has been recognized as one of the most effective methods to optimize traffic signal control. However, due to the inappropriate design of RL elements (i.e., reward and state) for complex traffic dynamics, existing RL-based approaches suffer from slow convergence to optimal traffic signal plans. Meanwhile, to simplify the traffic modeling, most optimization methods assume that the phase duration of traffic signals is constant, which strongly limits the RL capability to search for traffic signal control policies with shorter average vehicle travel time and better GreenWave control. To address these issues, this paper proposes a novel intensity- and phase duration-aware RL-based method named IPDALight for the optimization of traffic signal control. Inspired by the Max Pressure (MP)-based traffic control strategy used in the transportation field, we introduce a new concept named intensity , which ensures that our reward design and state representation can accurately reflect the status of vehicles. By taking the coordination of neighboring intersections into account, our approach enables the fine-tuning of phase duration of traffic signals to adapt to dynamic traffic situations. Comprehensive experimental results on both synthetic and real-world traffic scenarios show that, compared with the state-of-the-art RL methods, IPDALight can not only achieve better average vehicle travel time and greenwave control for various multi-intersection scenarios, but also converge to optimal solutions much faster. [ABSTRACT FROM AUTHOR]

Signal control strategies for congested urban road networks designed in a centralized framework require many communication links, serious processing power, and infrastructure for the centralized coordination. As a result, strategies based on a centralized framework are not scalable. The use of decentralized signal control strategies for large-scale urban traffic networks is a solution to this problem, since it allows for the implementation of such strategies on networks whose centralized solution is not easily scalable. This paper addresses the problem of designing a decentralized traffic-responsive signal control solution, proposing two methods based on different formulations of the store-and-forward model: (i) the Decentralized Traffic-responsive Urban Control (DTUC) method; and (ii) the Decentralized Decoupled Traffic-responsive Urban Control (D2TUC). The decentralized configuration is such that each intersection is associated with one computational unit, with limited computational power and memory, which controls the traffic signals of the incoming links. Sufficient conditions for the controllability of the considered store-and-forward models are also presented. Both methods are validated resorting to numerical simulations of the urban traffic network of Chania, Greece, for two demand scenarios, and their performance is compared with the performance of the Traffic-responsive Urban Control (TUC) centralized strategy. One of the proposed decentralized methods, D2TUC, is shown to match the performance of TUC. • Design of decentralized signal control solutions based on the store-and-forward model. • Sufficient controllability conditions for the store-and-forward model are presented. • Two decentralized solutions are synthesized considering the network globally. • Validation resorting to numerical simulations of the traffic network of Chania. • One of the proposed decentralized solutions, D2TUC, matches the performance of TUC. [ABSTRACT FROM AUTHOR]

Due to the limitations of data transfer technologies, existing studies on urban traffic control mainly focused on isolated dimension control such as traffic signal control or vehicle route guidance to alleviate traffic congestion. However, in real traffic, the distribution of traffic flow is the result of multiple dimensions whose future state is influenced by each dimension's decisions. Presently, the development of the Internet of Vehicles enables an integrated intelligent transportation system. This paper proposes an integrated intelligent transportation model that can optimize predictive traffic signal control and predictive vehicle route guidance simultaneously to alleviate traffic congestion based on their feedback regulation relationship. The challenges of this model lie in that the formulation of the nonlinear feedback relationship between various dimensions is hard to describe and the design of a corresponding solving algorithm that can obtain Pareto optimality for multi-dimension control is complex. In the integrated model, we introduce two medium variables—predictive traffic flow and the predictive waiting time—to two-way link the traffic signal control and vehicle route guidance. Inspired by game theory, an asymmetric information exchange framework-based updating distributed algorithm is designed to solve the integrated model. Finally, an experimental study in two typical traffic scenarios shows that more than 73.33% of the considered cases adopting the integrated model achieve Pareto optimality. [ABSTRACT FROM AUTHOR]