Search

Traffic congestion has several adverse effects on urban traffic networks. Increased travel times of vehicles, with the addition of excessive greenhouse emissions, can be listed as harmful effects. To address these issues, transportation engineers aim to reduce private car usage, reduce travel times through different control strategies, and mitigate harmful effects on urban networks. In this study, we introduce an innovative approach to optimizing traffic signal control settings. This methodology takes into account both pedestrian delays and vehicular emissions. Non-dominated sorting genetic algorithm-II and Multi-objective Artificial Bee Colony algorithms are adopted to solve the multi-objective optimization problem. The vehicular emissions are modeled through the MOVES3 emission model and integrated into the utilized microsimulation environment. Initially, the proposed framework is tested on a hypothetical test network, followed by a real-world case study. Results indicate a significant improvement in pedestrian delays and lower emissions. [ABSTRACT FROM AUTHOR]

Traffic congestion is a serious problem in the US, and traffic signal control is one of the effective solutions to congestion. Previous research on model predictive control (MPC)-based traffic signal control showed substantial benefits over conventional methods. This study focused on implementing MPC over a large-scale network with complex intersections and the impact of cycle length, network size, and imperfect state estimation on performances. This study implemented a virtual phase link (VPL)-based model predictive control method which used the number of vehicles in each VPL as input state variables and was suitable for National Electrical Manufacturing Association (NEMA) ring-barrier control. To test the impact of network size, the performance of distributed MPC (36 intersections in the network are divided into five subnetworks) was compared with that of MPC over the full network for a set of cycle lengths. To test the impact of imperfect state estimation, we synthetically infused estimation error and developed two scenarios, MPC-error and MPC-error narrow, which had higher and lower estimation errors, respectively. The performance of these MPC methods was compared with that of the existing time-of-day (TOD) method and an offline method that used Webster's method for split and MULTIBAND for cycle length and offset optimization. Trajectory and linkwise signal performance measures were collected from the simulation to evaluate performance. The distributed MPC method with perfect state estimation had the lowest delay and highest energy efficiency of all the methods. The performance of MPC decreased as the prediction inaccuracy increased. MPC-error had 7% and 11% more delay than MPC-error narrow in the morning and evening peaks, respectively. Overall, simulation results suggest that even with imperfect state estimation, MPC methods will outperform offline methods significantly. [ABSTRACT FROM AUTHOR]

Recent advancements in the industrial revolution and artificial intelligence have aided in the development of novel approaches that have considerable potential for increasing the efficiency of traffic networks. Emerging concepts of autonomous driving and machine learning can be incorporated intelligently for improving traffic operations and control. In the coming years, traffic composition can vary in terms of autonomous vehicle (AV) penetration rate, which can lead to a heterogeneous traffic environment. Traffic control methods for such complex networks need to be designed effectively for accommodating the positive effects of AV implementation without compromising the safety and level of service in the presence of regular vehicles (RVs). An intelligent-based optimization framework for traffic signal control under heterogeneous AV-based traffic is proposed in this paper. This framework utilizes state-of-the-art machine-learning approaches to represent and design different components of the optimization process of cycle length. Further, SHapley Additive exPlanations (SHAP) is used to enhance model interpretability. The proposed optimization framework improves performance under congested traffic conditions compared with that of the conventional optimization methods. Compared to pure RV-based traffic, the penetration rates of 25%, 50%, and 100% can decrease optimized cycle lengths by 26%, 39%, and 53%, respectively, which can result in delay reductions of approximately 18%, 31%, and 56%, respectively. The proposed framework when applied in an adaptive-based manner can help in the generalization of controlling existing signalized intersections with the gradual penetration of AVs without the extra infrastructure or specific operational and connectivity capabilities of the involved vehicles. [ABSTRACT FROM AUTHOR]

Under the context of rapid development of the Internet of vehicles and vehicle-road collaboration system, active traffic management (ATM) becoming the mainstream means of road traffic control and developing toward refinement. In this paper, to study the high-precision lane-level dynamic induction control strategy in different scenarios, based on the NaSch model of cellular automata and combined with the characteristics of the failure section area, a fuzzy lane-changing bypass vehicle-following model considering lane-changing pressure in multi-lane failure scenarios was built. The simulation results show that (i) if the lane failure occurs on the middle lane, the lane should be induced in advance, and the induced lane change effect is the best at about 100 m. When the lane failure occurs in the left lane and right lane, the prompt is best at about 250 m. (ii) The induced distance should be based on actual traffic conditions, free combination of different early warning distances between 100 and 300 m can save about 20–30 s congestion time. (iii) The lane-level dynamic coordinated guidance control measures can effectively improve the road traffic efficiency compared with the static unified control measures, improve the traffic efficiency of road performance, and alleviate traffic congestion time. The conclusion of this paper can provide some reference for dynamic active control management and achieve higher accuracy of traffic flow lane-level control. [ABSTRACT FROM AUTHOR]

The current traffic signal light timing scheme cannot effectively solve the problem of traffic congestion. This paper studied the intelligent control of signal lights based on infrared sensors. Firstly, the traffic flow was detected by infrared sensors; then, the future traffic flow was predicted using a back-propagation neural network; an intelligent control algorithm was designed based on the prediction results, and data were collected at the actual intersection for simulation experiments. It was found that the maximum and minimum root-mean-square error (RMSE) value of the BPNN prediction were 72.33 and 45.77, respectively, i.e., BPNN could predict the traffic flow accurately. Then, in the comparison of timing schemes, the maximum average queuing delay time of the BPNN was 0.55 s, and the maximum average queuing length was 92 m in the case of large traffic flow, both of which were better than the traditional fixed timing scheme. The results prove the reliability of the proposed signal light intelligent control algorithm. The algorithm can be further applied in practice. [ABSTRACT FROM AUTHOR]

This paper proposes a convolutional neural network (CNN) model of the signal distribution control algorithm (SDCA) to maximize the dynamic vehicular traffic signal flow for each junction phase. The aim of the proposed algorithm is to determine the reward value and new state. It deconstructs the routing components of the current multi-directional queuing system (MDQS) architecture to identify optimal policies for every traffic scenario. Initially, the state value is divided into a function value and a parameter value. Combining these two scenarios updates the resulting optimized state value. Ultimately, an analogous criterion is developed for the current dataset. Next, the error or loss value for the present scenario is computed. Furthermore, utilizing the Deep Q-learning methodology with a quad agent enhances previous study discoveries. The recommended method outperforms all other traditional approaches in effectively optimizing traffic signal timing. [ABSTRACT FROM AUTHOR]

In recent years, high-resolution traffic signal event data has provided valuable insights into understanding and managing congestion at signalized intersections. While existing applications primarily employ automated traffic signal performance monitoring (ATSPM) systems as postanalysis tools for identifying everyday congestion causes, traffic engineers are increasingly overwhelmed by the number of ATSPM-capable intersections. The workload increases extensively as the number of ATSPM-capable intersections rises mainly due to the necessity of manually checking and generating performance figures. Nonetheless, an advanced ATSPM system capable of automatically detecting time-of-day congestion bottlenecks among multiple intersections and suggesting "top intersections of interest" would significantly aid traffic managers in monitoring historical congestion and preventing future congestion occurrences. This paper introduces an efficient graphical automated congestion ranking method for capable intersections, leveraging high-resolution traffic signal event data as the basis for automated congestion ranking. To accomplish these objectives, we build upon ATSPM concepts by continuously generating ATSPM measures of effectiveness (MOEs). Utilizing continuously generated ATSPM performance measures in Frisco, Texas, over several months, we devise an efficient graphical method for ranking hourly congestion levels among the studied ATSPM-capable intersections. All intersections are assessed and ranked using a multiobjective optimization technique, the Pareto front method. The points on the Pareto front represent dominating intersections with at least one inferior performance measurement, warranting prioritized improvement. The dominating points identified from the test dataset were validated and further explained using Purdue coordination diagrams (PCD), along with another individual dataset--Wejo-connected vehicle data. The outcomes of this approach have proven the validity of the method. [ABSTRACT FROM AUTHOR]

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system. [ABSTRACT FROM AUTHOR]

Urbanization has led to accelerated traffic congestion, posing a significant obstacle to urban development. Traditional traffic signal scheduling methods are often inefficient and cumbersome, resulting in unnecessary waiting times for vehicles and pedestrians, exacerbating the traffic situation. To address this issue, this article proposes a dynamic traffic signal scheduling system based on an improved greedy algorithm. Unlike conventional approaches, we introduce a reward function and a cost model to ensure fair scheduling plans. A constraint function is also established, and the traffic signal scheduling is iterated through the feasible matrix using the greedy algorithm to simplify the decision-making process and enhance solution efficiency. Moreover, an emergency module is integrated to prioritize special emergency vehicles, reducing their response time during emergencies. To validate the effectiveness of our dynamic traffic signal scheduling system, we conducted simulation experiments using the Simulation of Urban Mobility (SUMO) traffic simulation suite and the SUMO traffic control interface Traci. The results indicate that our system significantly improves intersection throughput and adapts well to various traffic conditions, effectively resolving urban traffic congestion while ensuring fair scheduling plans. [ABSTRACT FROM AUTHOR]

With the increasing number of urban vehicles, as well as the current situation of non-intelligent traffic control systems, spatiotemporal non-uniform traffic resource occupation, and limited traffic planning and design, existing urban traffic planning methods cannot effectively solve problems such as frequent traffic congestion and uncontrollable commuting time for residents. In order to solve the above problems, this paper first constructs a multi-queue, multi-server queuing model based on the server vacation and a multi-hop cascaded queuing model from the perspective of local intersections and global commuting paths. We analyze the theoretical changes in passage delay costs at local intersections and on global commuting paths as a function of traffic flow and the random duration of traffic signals. On this basis, this article proposes a collaborative intelligent traffic planning algorithm based on artificial intelligence, which utilizes traffic sensors to dynamically perceive traffic congestion status and collaboratively plans the optimal duration of traffic signals and the optimal driving path of vehicles from both local and global perspectives, thereby maximizing the on-time arrival ratio of vehicles while ensuring the required commuting delay. The simulation results show that the proposed method can increase the on-time arrival ratio of vehicles by at least 20% compared to contrast methods while meeting the requirements relating to commuting delays. This verifies that our method can provide support for the improvement in efficiency in future Internet of vehicles. [ABSTRACT FROM AUTHOR]

Due to the rapid increase of the population in the world, traffic signal controlling and monitoring has become an important issue to be solved with regard to the direct relation between the number of populations and the cars' usage. In this regard, an intelligent traffic signaling with a rapid urbanization is required to prevent the traffic congestions, cost reduction, minimization in travel time, and CO2 emissions to atmosphere. This paper provides a comprehensive review of computer vision techniques for autonomic traffic control and monitoring. Moreover, recent published articles in four related topics including density estimation investigation, traffic sign detection and recognition, accident detection, and emergency vehicle detection are investigated. The conducted survey shows that there is no fair comparison and performance evaluation due to the large number of involved parameters in the abovementioned four topics which can control the traffic signal controlling system such as (computation time, dataset availability, and an accuracy). [ABSTRACT FROM AUTHOR]

Traffic congestion is a major concern in urban centers, as it can affect society, the environment, and the economy. There are many studies on the use of computational intelligence (CI) to improve mobility in urban centers. Some of these researches focus on developing strategies for traffic light programming, since traffic coordination is complex due to its many parameters, variables, and dynamic behavior, and also an inefficient traffic control plan can lead to increased delays and contribute to traffic congestion. Although there are many works in the literature on strategies for traffic control, there are still some contributions and gaps to be filled, especially because some studies do not consider the automatic optimization of traffic signals in real time, that is, according to the demand of vehicles on the roads, considering multiple objectives and the use of a network of intersections in their experiments. In addition, some of the proposed models are not independent of simulation to evaluate the solutions of CI algorithms, resulting in a more complex deployment in real situations. In this context, this paper presents a new method to optimize traffic light plan in a network of intersections and in real time, called Active Control of Traffic Signals (ACTS) associated with the Non-Dominated Sorting Genetic Algorithm, considering multiple objectives in the optimization process (minimizing the average delay time and the number of vehicles stops per cycle). To test the applicability of the model, a real dataset of vehicle demand collected by the Company of Transport and Traffic of Belo Horizonte (BHTrans) is loaded into the AIMSUN simulator, then the method is applied and compared with the current traffic control plan used by BHTrans. The results show that the ACTS method reduces the average vehicle delay by almost half compared to the results obtained with the current solution used by BHTrans. In real life, this means less time spent in traffic, which promotes faster traffic flow, reducing traffic congestions. [ABSTRACT FROM AUTHOR]

Intelligent traffic light control (ITLC) algorithms are very efficient for relieving traffic congestion. Recently, many decentralized multi-agent traffic light control algorithms are proposed. These researches mainly focus on improving reinforcement learning method and coordination method. But, as all the agents need to communicate while coordinating with each other, the communication details should be improved as well. To guarantee communication effectiveness, two aspect should be considered. Firstly, a traffic condition description method need to be designed. By using this method, traffic condition can be described simply and clearly. Secondly, synchronization should be considered. As different intersections have different cycle lengths and message sending event happens at the end of each traffic signal cycle, every agent will receive messages of other agents at different time. So it is hard for an agent to decide which message is the latest one and the most valuable. Apart from communication details, reinforcement learning algorithm used for traffic signal timing should also be improved. In the traditional reinforcement learning based ITLC algorithms, either queue length of congested cars or waiting time of these cars is considered while calculating reward value. But, both of them are very important. So a new reward calculation method is needed. To solve all these problems, in this paper, a new ITLC algorithm is proposed. To improve communication efficiency, this algorithm adopts a new message sending and processing method. Besides, to measure traffic congestion in a more reasonable way, a new reward calculation method is proposed and used. This method takes both waiting time and queue length into consideration. [ABSTRACT FROM AUTHOR]

Traffic at urban intersections constitute a series of complex conflicting vehicular movements and contribute greatly to the problems of traffic congestion and air pollution. The emerging of connected and automated vehicle (CAV) technologies inspires innovative ideas in traffic management at intersections; it not only enables new control paradigms, but also allows for possibilities to revolutionize the geometric layouts of intersections. This study proposes a novel intersection design called knotted intersection (KI), to resolve the complexity of conflicting relations at intersections in a full CAV environment. This new design is associated with a set of neat control rules for vehicles to realize the smooth traffic operation at these intersections. The design problem of intersection geometry and control strategy is optimized jointly and formulated as a mixed-integer linear program (MILP), and some basic theoretical properties of KI design are derived, including nearly throughput-maximizing property and bounded within-intersection delay of vehicles. Furthermore, the KI design is then extended to a road network composed of multiple intersections to improve the overall efficiency. The optimal design of multiple knotted intersections (MKI) is developed to coordinate the traffic organization methods among intersections and a two-level solution method is proposed to solve the optimization efficiently. Numerical and simulation experiments are conducted at both the intersection level and network level under various cases, and the results validate the superior performance of the proposed methods compared to classical traffic signal control (TSC) strategies. • Knotted intersection design for resolving the complexity of intersection conflicts • Joint design of intersection geometric layout and traffic control strategy • Theoretical properties for nearly-maximum throughput and bounded delay • Optimal design of multiple knotted intersections to enhance network efficiency [ABSTRACT FROM AUTHOR]

To contend traffic congestion on urban networks, existing studies have made great efforts to develop traffic-responsive signal timing algorithms in the last decade. More recently, as an alternative to conventional model-based algorithms, machine learning-based methods have been tested on traffic light timing problems and show promising potentials. However, many researchers and practitioners still questioned the feasibility and applicability of adopting machine learning techniques in the ATSC domain. One of the reasons is that these methods assumed flawless detectors and heavily relied on simulators for training and evaluations. To address such a critical concern, this article customizes a Deep Q-learning Learning (DQL) method to optimize traffic signal timings at urban intersections, where the partial observations from identity-based detectors are inputs, and the green splits are outputs. A simulation-free data-driven prediction model is also developed to train the DQL with reduced computational time. Then the machine learning-based methods are evaluated on a real-world case with Automatic Number-Plate Recognition (ANPR) data. Experiments show the proposed data-driven model can predict the traffic state in limited computational time, and the DQL algorithm is 3.9% better than the field experiment performance from the adaptive control system, SCOOT, and 22% better than the time-of-day plan by SYNCHRO. The results indicate the DQL methods can only yield marginal improvement with restrictive input and output settings in congested traffic flow in comparison to the conventional adaptive method. [ABSTRACT FROM AUTHOR]

This research paper aims to study the effect of tram management on traffic fluidity and its impact on car drivers' behaviors at junctions crossed by trams. The methodology used in this research is based on a mathematical model and an investigation of car drivers. The first step is to analyze the data of annual travelers' attendance and assess the number of trams offered and needed in operation to respond adequately to the factual demand. The second step proceeds to show how the previous results of the trams' fleet influence traffic jams. That is, this step identifies how the number of trams used in operation blocks other motorists and reduces traffic flow capacity at junctions. Finally, the purpose of the questionnaire is to determine car drivers' opinions of the causes of traffic congestion at junctions and understand how this phenomenon affects their behaviors. The outcomes demonstrate that tram management is ineffective because there is a considerable gap between the annual offered tram fleet and the actual one needed according to the real statistical data. The high number of trams utilized is the leading cause of traffic congestion. Furthermore, this situation disturbs the control of traffic lights at common intersections. Unfortunately, this outcome is the main reason for drivers' poor behavior, as 75.20% of car drivers are always stressed. These issues have intensified traffic jams in several junctions along the tram line. The article recommends some solutions to improve tram management and traffic fluidity to avoid the substandard behavior of car drivers at junctions. [ABSTRACT FROM AUTHOR]

Actuated and pre-timed traffic signal controllers have been beneficial to the improvement of traffic flow in cities and dense urban environments around the world. While these methods have been effective in reducing traffic congestion, recent works have shown that incorporation of reinforcement learning (RL) or other artificial intelligence (AI) based optimization techniques may further improve the performance of traffic signal controllers. This work investigates a novel decentralized traffic signal control structure which encourages cooperative signal behavior via repeated negotiations between neighboring intelligent agents. This method capitalizes on emerging inter-infrastructure communications technologies to exercise 'system-level' control over a network of connected signalized intersections. The proposed method was tested in a simplified grid-network of 20 intersections. In this network, static arrivals of 1440 veh / l / h along east-west lanes and 360 veh / l / h along north-south lanes were supplied. In addition, a simulated shift to 720 veh / l / h along east-west lanes and 1080 veh / l / h along north-south lanes was analyzed to provide insights into the presented method's performance in response to any sudden shifts in traffic patterns. The findings indicated that, when compared to non-negotiating traffic signals, the presented method may improve the service rate of traffic networks under static conditions by 67 1 veh / h on average, reduce emissions by an average of 326 kg / h in addition to reducing travel time across a network of intersections. The performance characteristics were captured by a SUMO testbed, and computational efficiency was explored using a suite of simple testbeds developed in MATLAB. [ABSTRACT FROM AUTHOR]

Traffic flow and travel time-based measures are used to quantify and characterize congestion levels on urban roadway networks. However, under low-density conditions, contradictory results are observed when these two measures are used to identify the prevailing congestion levels. This accentuates the need to develop a new measure of congestion that effectively integrates traffic flow and travel time-based measures. The present study develops a new measure termed modified congestion index (MCI) by integrating traffic flow and travel time-based congestion measures for identifying prevailing congestion levels. As proof of the concept, the application of the methodology was demonstrated using empirical data collected at the corridor and network level and simulated data developed for a real-world urban network. The traffic flow and travel time-based congestion measures were integrated using a generalized least square framework (GLS) to derive MCI. Investigations revealed that traffic states bifurcated based on MCI follow the general philosophy of traffic state bifurcation using the macroscopic fundamental diagram (MFD) and fundamental diagram (FD). MCI, when correlated with existing performance measures, revealed that MCI could characterize both reliability and congestion simultaneously. As an important outcome from a policy and practical application perspective, MCI-based level of service (LOS) thresholds were developed. The application of the LOS thresholds was demonstrated by (a) analysing the effect of traffic signal control using a before-after perspective and (b) ranking and prioritizing segments in an urban network for optimal allocation of funds for developing congestion mitigation strategies. The developed LOS thresholds are expected to facilitate planners and engineers to comprehend the operational level of urban networks in terms of congestion and develop mitigation measures accordingly. • Modified congestion index (MCI) is proposed for characterizing and quantifying congestion. • Volume-to-capacity ratio and congestion index are integrated using a generalized least square framework for deriving MCI. • Congestion-based level of service (LOS) thresholds are developed to quantify service quality. • The application of LOS is demonstrated by evaluating the effect of traffic signal control on congestion. • Segments are ranked and prioritized based on MCI for optimal allocation of funds. [ABSTRACT FROM AUTHOR]

With the growing number of city vehicles, traffic management is becoming a persistent challenge. Traffic bottlenecks cause significant disturbances in our everyday lives and raise stress levels, negatively impacting the environment by increasing carbon emissions. Due to the population increase, megacities are experiencing severe challenges and significant delays in their day-to-day activities related to transportation. An intelligent traffic management system is required to assess traffic density regularly and take appropriate action. Even though separate lanes are available for various vehicle types, wait times for commuters at traffic signal points are not reduced. The proposed methodology employs artificial intelligence to collect live images from signals to address this issue in the current system. This approach calculates traffic density, utilizing the image processing technique YOLOv4 for effective traffic congestion management. The YOLOv4 algorithm produces better accuracy in the detection of multiple vehicles. Intelligent monitoring technology uses a signal-switching algorithm at signal intersections to coordinate time distribution and alleviate traffic congestion, resulting in shorter vehicle waiting times. [ABSTRACT FROM AUTHOR]

• An algorithm based on heterogeneous GNNs is proposed for feature fusion. • A mutual-information loss function is proposed for training. • Based on above methods, an IHA-MDGI algorithm is proposed for traffic signal control. • Experiments show the IHA-MDGI algorithm outperforms the state-of-the-art algorithms. Adaptive traffic signal control (ATSC) facilitates alleviating traffic congestion. Multi-agent deep reinforcement learning (MDRL) is a new promising algorithm for ATSC, and Graph Neural Networks (GNNs) further promote its learning ability. However, there are some drawbacks in the state-of-the-art MDRL algorithms. (1) These algorithms cannot effectively fuse diverse heterogeneous information of traffic networks due to adopting homogeneous GNNs; (2) These algorithms cannot be effectively trained due to merely adopting MDRL loss functions. In this paper, we propose an Inductive Heterogeneous graph Attention-based Multi-agent Deep Graph Infomax (IHA-MDGI) algorithm for ATSC. The proposed IHA-MDGI algorithm conducts both feature fusion via a proposed Inductive Heterogeneous graph Attention (IHA) algorithm and training via a proposed Multi-agent Deep Graph Infomax (MDGI) framework. Specifically, (1) Unlike the algorithms which adopt homogeneous GNNs, in the IHA algorithm, heterogeneous GNNs are designed to fuse both heterogeneous structural information and heterogeneous features of traffic networks, which aims to acquire heterogeneous information embeddings of traffic networks. (2) In the MDGI framework, the acquired embeddings are used to calculate the signal-control policies and Q -value for each agent, and then a mutual-information loss function is designed, which combines with the MDRL loss function to jointly train the whole algorithm. The designed mutual-information loss function focuses on maximizing mutual information between input (i.e., heterogeneous information embeddings) and output (i.e., Q -value), which can produce cooperative signal-control policies and maximize Q -value. We conduct the experiments in both real-traffic and synthetic-traffic networks under the time-varying traffic flows, and the results demonstrate that IHA-MDGI algorithm outperforms the state-of-the-art MDRL algorithms about multiple metrics. [ABSTRACT FROM AUTHOR]

The increasing traffic demand in urban areas frequently causes traffic congestion, which can be managed only through intelligent traffic signal controls. Although many recent studies have focused on reinforcement learning for traffic signal control (RL-TSC), most have focused on improving performance from an intersection perspective, targeting virtual simulation. The performance indexes from intersection perspectives are averaged by the weighted traffic flow; therefore, if the balance of each movement is not considered, the green time may be overly concentrated on the movements of heavy flow rates. Furthermore, as the ultimate purpose of traffic signal control research is to apply these controls to the real-world intersections, it is necessary to consider the real-world constraints. Hence, this study aims to design RL-TSC considering real-world applicability and confirm the appropriate design of the reward function. The limitations of the detector in the real world and the dual-ring traffic signal system are taken into account in the model design to facilitate real-world application. To design the reward for balancing traffic movements, we define the average delay weighted by traffic volume per lane and entropy of delay in the reward function. Model training is performed at the prototype intersection for ensuring scalability to multiple intersections. The model after prototype pre-training is evaluated by applying it to a network with two intersections without additional training. As a result, the reward function considering the equality of traffic movements shows the best performance. The proposed model reduces the average delay by more than 7.4% and 15.0% compared to the existing real-time adaptive signal control at two intersections, respectively. [ABSTRACT FROM AUTHOR]

In this paper, we consider a simple road intersection with traffic light control and suggest a queueing model for the traffic flow in the intersection. The suggested model implements the well-known queue with state-dependent departure rates. Using this model, we define optimal state-dependent scheduling of the traffic lights in the intersection and consider its properties. Activity of the model is illustrated by numerical simulations. It is demonstrated that in practical conditions the suggested scheduling of the traffic lights allows the prevention of traffic jams in the intersection and resolves vehicles queues with reasonable waiting times in the crossing lanes. [ABSTRACT FROM AUTHOR]

Adaptive traffic signal control (ATSC) is an effective method to reduce traffic congestion in modern urban areas. Many studies adopted various approaches to adjust traffic signal plans according to real-time traffic in response to demand fluctuations to improve urban network performance (e.g., minimise delay). Recently, learning-based methods such as reinforcement learning (RL) have achieved promising results in signal plan optimisation. However, adopting these self-learning techniques in future traffic environments in the presence of connected and automated vehicles (CAVs) remains largely an open challenge. This study develops a real-time RL-based adaptive traffic signal control that optimises a signal plan to minimise the total queue length while allowing the CAVs to adjust their speed based on a fixed timing strategy to decrease total stop delays. The highlight of this work is combining a speed guidance system with a reinforcement learning-based traffic signal control. Two different performance measures are implemented to minimise total queue length and total stop delays. Results indicate that the proposed method outperforms a fixed timing plan (with optimal speed advisory in a CAV environment) and traditional actuated control, in terms of average stop delay of vehicle and queue length, particularly under saturated and oversaturated conditions. [ABSTRACT FROM AUTHOR]

With the development of Internet of Things infrastructures and intelligent traffic systems, the traffic congestion that results from the continuous complexity of urban road networks and traffic saturation has a new solution. In this research, we propose a traffic signal control scenario based on edge computing. We also propose a chemical reaction–cooperative particle swarm optimization (CRO-CPSO) algorithm so that flexible traffic control is sunk to the edge. To implement short-term real-time vehicle waiting time prediction as a collaborative judgment of CRO-CPSO, we suggest a traffic flow prediction system based on fuzzy logic. In addition, we introduce a co-factor (collaborative factor) set based on offline learning to take into account the experiential characteristics of intersections in urban road networks for the generation of strategies by the algorithm. Furthermore, the real case of Changsha County is simulated on the SUMO simulation platform. The issue of traffic flow saturation is improved by our method. Compared with other methods, our algorithm enhances the proportions of vehicles that reach their destinations on time by 13.03%, which maximizes the driving experience for drivers. Meanwhile, our algorithm reduces the driving times of vehicles by 25.34%, thus alleviating traffic jams. [ABSTRACT FROM AUTHOR]

Traffic congestion is a significant issue in many countries today. The suggested method is a novel control method based on multiple intersections considering the kind of traffic light and the duration of the green phase to determine the optimal balance at intersections by using fuzzy logic control, for which the balance should be adaptable to the unchanging behavior of time. It should reduce traffic volume in transport, average waits for each vehicle, and collisions between cars by controlling this balance in response to the typical behavior of time and randomness in traffic conditions. The proposed method is investigated at intersections using a sampling multi-agent system to set traffic light timings appropriately. The program is provided with many intersections, each of which is an independent entity exchanging information with the others. The stability per entity is proven separately. Simulation results show that Takagi–Sugeno (TS) fuzzy modeling performs better than Takagi–Sugeno (TS) fixed-time scheduling in decreasing the length of queueing times for vehicles. [ABSTRACT FROM AUTHOR]

Two new synchronization strategies are developed for signalized grids of two-directional streets. Both strategies are found to reduce congestion significantly more than do other approaches. One of the strategies is static and the other adaptive. Both use a common timing pattern for all signals on the grid but use a different offset for each. The static strategy serves the morning rush by providing perfect forward progression on all streets in the directions that point toward a reference intersection, one that is located near the center of gravity of all workplaces. For the evening rush, perfect progression is achieved for all travel directions that point away from the reference intersection. The adaptive strategy toggles between this forward synchronization mode and a second mode suited for congestion, but only in a pre-determined district surrounding the reference intersection. Toggling is based on the district's real-time traffic density. The paper shows how to switch quickly between the two synchronization modes without resorting to unacceptably short phases. It also shows that if the grid is formed by two intersecting sets of parallel streets, even if unevenly spaced, then every street can be perfectly synchronized in one of its directions. As a result, an inbound driver in the morning, or an outbound driver in the evening, is guaranteed to encounter synchronized signals over the full length of her trip. Although this is not possible for more irregular grids, the paper shows how to modify the two strategies for this case, so that they still perform well. The strategies were benchmarked with simulations against a fixed, zero-offset strategy for many scenarios, because zero-offsets are known to work well under congestion. In one important scenario representing a severely congested morning rush, both strategies were also benchmarked against a state-of-the-practice computer program. While the state-of-the-practice program reduced the zero-offset delay by a modest 7%, the proposed strategies reduced it by 21% (static) and 32% (adaptive); i.e., improving on the state-of-the-practice program by 14% and 25%. These improvements considerably exceed the 1% to 5% reductions typically reported in the literature for other state-of-the-art methods that have been compared with state-of-the-practice programs. Similarly good results were obtained for the other scenarios, which included the morning and evening rushes, various distributions of workplaces, and both regular and irregular grids. [ABSTRACT FROM AUTHOR]

Traffic signal control is one effective way to alleviate traffic congestion. Anticipatory traffic signal control determines signal settings from a network planning perspective, which takes into account the influence of travelers' route choice response and triggers better equilibrium flow patterns for better network performance. For the route choice response, it is usually predicted by a response function known as traffic assignment model. However, the response behavior can never be precisely modeled, leading to a mismatch between the modeled and real traffic flow patterns. This model-reality mismatch generally contributes to suboptimal control performance and hence brings unexpected congestion in real-life traffic operations. This study aims to address the model-reality mismatch and proposes an effective anticipatory traffic control for real operations. A metamodel is introduced that serves as a surrogate of the unknown structural model bias. Then an iterative optimizing control scheme is applied to correct the model bias by learning from observations. By integrating the model-based control design with data-driven learning techniques, the metamodeling framework is able to enhance the control performance. Moreover, the analytical model bias formulation allows theoretical investigation of the model approximation error. To further improve the control performance, a joint traffic model parameter estimation is developed, hence achieving a better model calibration jointly with the model bias correction. The proposed control method is examined on a test network. Numerical examples confirm the effectiveness of the proposed method in improving control performance despite the model-reality mismatch. Comparison results show that the proposed method outperforms the traditional model-based control method and an improvement of 14.8% in total travel time is achieved in the example network. [ABSTRACT FROM AUTHOR]

Traffic congestion alleviation around intersections has been a growing challenge, and a competent traffic signal control scheme plays a pivotal role in intelligent transportation systems. Recent studies using deep reinforcement learning techniques have shown promising results for traffic signal control, but they only focus on extracting features from traffic conditions of isolated or adjacent intersections. In this work, we employed navigation information for traffic signal control, greatly enriching the features for traffic signal control with deep reinforcement learning. In addition, we are the first to propose a novel scheme DeepNavi to exploit the temporal-spatial relations from numerous navigation routes and extract dynamic real-time and future traffic features. We tested our scheme on a challenging real-world traffic dataset with 16 intersections in a residential district of Hangzhou, China. Extensive experiments were conducted and the results demonstrated that our DeepNavi scheme achieves superior performance over five popular and state-of-the-art baseline methods on different metrics, including queue length, speed, travel time and accumulative waiting time. In addition, with our method, vehicles suffer the least red lights and enjoy the most green waves, which further validates that our scheme greatly relieves the congestion and provides excellent experience for drivers. Simulations with different penetration levels of navigation routes showed that even with only part of navigation routes available in the traffic network, our scheme can obtain superior performance, further demonstrating the effectiveness and feasibility of DeepNavi. [ABSTRACT FROM AUTHOR]

Intelligent traffic light control is one of the modern approaches to solve traffic congestion, where reinforcement learning is a widely used method. Conventionally, reinforcement learning is used to determine whether to change the current phase (or choose a traffic phase) after each small interval. One major drawback of these approaches is that it makes the current traffic light phase duration uncertain before the current phase terminates. Directly determining the duration of the traffic light phase can effectively avoid this shortcoming. An adaptive traffic light timing system is proposed in this paper which can directly control the phase duration. In the proposed system, the Q-learning algorithm is employed and the action space is defined as all possible phase durations. In addition, the reward function is redefined to guide the agent to balance more traffic metrics, and the state is redefined to reduce the state space. Finally, the proposed system is evaluated by equal, unequal, and complex traffic scenarios. Results show that the proposed system has a better performance compared with other methods in controlling traffic lights, even on complex traffic scenarios. [ABSTRACT FROM AUTHOR]

Following major hazards and incidents, it is crucial to mitigate the congestion at intersections of urban traffic systems with disruptions; maximize the evacuation, rescue, and recovery efficiency; and prevent a hazard from turning into a disaster. An optimized traffic signal design strategy can effectively contribute to maintaining an efficient traffic system operation despite various disruptions. Most of the existing studies focused on static and generic congestion scenarios during the recovery stage, rather than realistic time-progressive scenarios covering the whole process following a disruption. An adaptive traffic signal control strategy in response to traffic disruptions at a single intersection is proposed by covering both the incident and recovery stages. Dynamic phase selection (DPS) technology is applied to adjust the traffic signal control plan adaptively during the incident stage, while the queue length dissipation (QLD) algorithm is adopted to carry out optimal green time calculation during the recovery stage. The proposed methodology is demonstrated by considering disruptions caused by several typical vehicle crashes at intersections. The proposed DPS+QLD traffic signal strategy is found to improve the resiliency of a typical intersection against disruptions by clearing queues faster, reducing overall traffic loss time, and maintaining stable mobility with superior performance over conventional fixed and actuated traffic signal plans. DOI: 10.1061/JTEPBS.0000671. [ABSTRACT FROM AUTHOR]

Traffic congestion is becoming a serious problem with the large number of vehicle on the roads. In the traditional traffic control system, the timing of the green light is adjusted regardless of the average traffic rate at the junction. Many strategies have been introduced to solve and improve vehicle management. However, in order to handle road traffic issues, an intelligent traffic management solution is required. This article represents a self adaptive real-time traffic light control algorithm based on the traffic flow. We present a machine learning approach coupled with image processing to manage the traffic clearance at the signal junction. The proposed system utilizes single image processing via neural network and You Only Look Once (YOLOv3) framework to establish traffic clearance at the signal. We employed YOLO architectures because it is accurate in terms of mean average precision (mAP), interaction over union (IOU) values and fast in object detection tasks as well. It runs significantly faster than other detection methods with comparable performance. The average processing time of single image was estimated to be 1.3 s. Further based on the input from YOLO we estimated the 'on' time period green light for effective traffic clearance. Several real time parameters like number of vehicles (two wheelers, four wheelers), road width and junction crossing time are considered to estimate the 'on'time of green light. Moreover, we used the real traffic images to test the performance and trained the system with different dataset. Our experiments investigation reveals that the predicted vehicle counts were well matched with the actual vehicle count and proposed method apprehended an average accuracy of 81.1%. The reported strategy is self adaptive, highly accurate, fast and has the potential to be implemented in the traffic clearance at the junctions. [ABSTRACT FROM AUTHOR]

Real-time traffic signal control has long been a critical way to improve traffic congestion. Transit Signal Priority (TSP) is seen as a cost-effective way to reduce travel time variability. Most of the previous studies develop real-time signal control systems on a vehicle basis, which is unable to efficiently provide preferential treatment on transit vehicles. Person-based signal control systems, which transform traffic delay computation units from vehicle to passenger, have been proposed to try to address this limitation. However, their models, optimizing signal plan cycle-by-cycle, cannot rapidly respond to traffic variations. This study proposes a Person-based Adaptive traffic signal control method with Cooperative Transit signal priority (PACT). In PACT, not only do Road-Side Units (RSUs) perform signal optimization, but also On-Board Units (OBUs) provide in-vehicle speed advisory to reduce delays. The interaction between RSU and OBU is conducted second-by-second, which has high adaptability to traffic variations. Experiments are performed based on real traffic data via traffic simulation platform SUMO. The results indicate that PACT can efficiently reduce delays of both bus passengers and auto passengers at a signalized intersection. Compared to preoptimized signal plans, the results show that each passenger on transit vehicles experiences 33%–70% decreases in delays, and each auto passenger experiences 3%–29% decreases in delays. PACT can reduce 80%–98% in delays when the occupancy weight factor is relatively large, showing the potential of extending PACT on performing signal preemption. [ABSTRACT FROM AUTHOR]

Traffic lights are an important controlling factor in traffic flows, and good policies will facilitate traffic congestion. A car's waiting time is highly related to the period in which the traffic lights are green or red; thus, a proper controlling policy reduces the waiting time and speeds up the car movement. Emergency vehicles always have a higher priority than other cars and need to reach their destination faster. In the last decade, a lot of research has been done to solve the traffic light scheduling issue using artificial intelligence techniques. Reinforcement learning with simulating human learning has the outstanding performance to solve complex problems, such as traffic lights control. In this study, a deep reinforcement learning traffic light control was implemented at a crossroad using real-time traffic information with an emphasis on emergency vehicles. The agent learns to adjust its policies to prioritize the emergency cars over the other cars. The results show less waiting time and speed up the cars' movement. It also indicates the emergency vehicles will cross the intersection with the least delay. With 200 to 600 cars and one emergency vehicle, the average delay decreases 2–16% in total using reinforcement learning. Considering more emergency vehicles, there is a 27–40% decrease in average delay for emergency vehicles. [ABSTRACT FROM AUTHOR]

Improving the efficiency of traffic signal control is an effective way to alleviate traffic congestion at signalized intersections. To achieve effective management of the system-wide traffic flows, current research tends to focus on applying reinforcement learning (RL) techniques for collaborative traffic signal control in a traffic road network. However, the existing collaboration-based methods often ignore the impact of transmission delay for exchanging traffic flow information on the system. Most of the studies assume that the signal controllers can collect all instantaneous vehicular features without delay. To fill the gap, we propose an RL-based cooperative traffic signal control scheme considering the data transmission delay issue in a traffic road network. In this paper, we (1) design our new RL agents to cooperatively control the traffic signals by improving the reward and state representation based on the state-of-the-art max-pressure control theory; (2) propose a traffic state prediction method to address the data transmission delay issue by decreasing the discrepancy between the real-time and delayed traffic conditions; (3) evaluated the performance of our proposed work on both synthetic and real-world scenarios with a different range of data transmission delays. The results demonstrate that our method surpassed the performance of the previous max-pressure-based traffic signal control methods and addressed the data transmission delay issue. [ABSTRACT FROM AUTHOR]

Concerning the critical role of Intelligent Transportation System (ITS) in tackling the problem of traffic congestion, and enhancing the safety, mobility and sustainability of the transport network, this paper provides a comprehensive review of recent developments in Connected Vehicle (CV) technology, its features and terminology. The real-world implementation of the CV technologies can result in a better understanding of the practical and technical issues. Given the technical and conceptual challenges, as well as novelty factors associated with CVs, many CV pilot studies around the world are reviewed, and their findings are summarized. The paper contributes to the literature by reviewing the characteristics, communication platform, multimodality, size and type of study areas of the pilot CV testbeds across the world. This research also paves the way for the better development of CV technology by comparing and discussing the pros and cons of the existing CV pilot testbeds. Moreover, we have discussed the evaluation plans and the advantages and disadvantages of different testbeds. Besides, as a main component of the CV system, the traffic signal control algorithms, as well as transit signal priority in a CV ecosystem, are also reviewed. Based on our findings, the real-time data obtained from the CV system could result in a better adjustment of traffic signal parameters which consequently enhance the traffic regulation in the network (say up to 30% in terms of travel time in comparison with an actuated coordinated traffic signal). However, a major criticism of the existing traffic signal strategies in a CV system is that they do not utilize the maximum capability of the CV system (V2 V, V2I and I2I communications). [ABSTRACT FROM AUTHOR]

Focusing on the problem with traffic congestion under changing environmental conditions, this paper proposed a trajectory reward light (TR-light) model by combining reinforcement learning, neural network, multi-agent and traffic simulation technology to optimize the traffic at multi-intersections. This method had considerable merits in the following aspects. The traffic organization plan was formulated based on traffic lights; multi-agent reinforcement learning was used on traffic light control; regional traffic organization was optimized through the coordination of traffic lights; the agent implemented trajectory reconstruction after the execution of each behavior so as to change the vehicle travel path without changing the OD pair, and to calculate the final reward of the agent according to the plan and reconstructed trajectory. Finally, it conducted a traffic simulation experiment through SUMO. The comparison of traffic indicators verifies that the proposed model improves the smoothness of the road network and the traffic state at the multi-intersections. Experiments show that the model is feasible and effectively mitigates the traffic congestion. [ABSTRACT FROM AUTHOR]

In the era of internet of vehicles, both the traffic signal control and the rerouting of connected and autonomous vehicles (CAVs) are essential techniques to alleviate traffic congestion and improve traffic efficiency. However, these two schemes have been treated separately without a unified framework allowing for joint optimization in the previous studies. In the case of traffic congestion at the bottleneck intersections, either of the two schemes alone is not enough. To this end, we propose to jointly control the traffic lights and the CAVs under the reinforcement learning (RL) framework. To lower the dimensionality of this learning problem, we propose to control the route choices of the CAVs through a few common scalar parameters instead of controlling the CAVs individually. In particular, the rerouting ratios are dynamically adjusted. A model-based method is further proposed to estimate the expected travel time with reduced estimation error. We then exploit the tools from deep RL and put forth an efficient algorithm that is able to control the green time allocation of traffic signals and the rerouting of CAVs jointly. Comprehensive numerical experiments demonstrate the validity of our proposed models and show the traffic efficiency can be significantly improved with our proposed algorithm. [ABSTRACT FROM AUTHOR]

• Develop a novel two-layer coordinated multi-agent reinforcement learning algorithm. • Synergize traffic signals through local cooperation and global coordination. • Optimization of vehicle emissions and traffic congestion as simultaneous goals. • Proposed method is performed in synthetic network and Cologne urban network on SUMO. Intersection traffic signal control considering vehicle emissions has become an important topic, however, the decision complexity of traffic signal control increases dramatically in a dynamic traffic environment with multi-intersections. It is a severe challenge to coordinate traffic signals at multi-intersections based on Internet of Things information to improve the traffic condition of the road network. This paper proposes a two-layer coordination algorithm based on multi-agent reinforcement learning—Multi-agent Coordinated Policy Optimization (MACoPO), for solving traffic signal control at multi-intersections. MACoPO consists of local cooperation, which adjusts the weights of individual rewards and neighborhood agents' rewards by using local cooperation factors (LCF), and global coordination, which updates the LCF to maximize global rewards. The state and reward functions are designed in terms of the current state of the signal, waiting queue length, vehicle density and emission concentration in the lane, vehicle delay, and vehicle emissions, thus making full use of the intersection state information. The proposed method is extensively assessed through simulation experiments using artificial and real road networks and the numerical results confirm its effectiveness in complex and dynamic real-time traffic environments with multi-intersections. [ABSTRACT FROM AUTHOR]

Recently, with increasing urban traffic congestion, there has been an upsurge in studies on reinforcement learning for traffic signal control (RL-TSC), which enables efficient traffic management. However, most existing RL-TSC research relies on simulation, and instances of real-world application are relatively scarce. Furthermore, existing RL-TSC methods employ a step-based approach, controlling traffic signals every short step. This approach can be inefficient in oversaturated traffic conditions, where large deviations in traffic demand between movements prevent traffic signals from being effectively managed based on the overall traffic situation. In this study, we aim to transform simulation-based RL-TSC into a more practical and applicable model. We have developed a RL-TSC method capable of responding to oversaturated traffic conditions, designing an action space that enables the agent to derive an optimal signal set for every cycle length, thereby understanding the traffic situation across all movements. During each cycle length, our proposed model conducts traffic signal optimization and identifies the optimal signal through an iterative exploration. To facilitate a fast and accurate strategy search process, we developed a kinematic wave-based mesoscopic model. This model estimates the density across the entire link, based on collected traffic data and derives the state and reward values. We have validated the field applicability of the proposed RL-TSC method through a real-world demonstration at a congested intersection in Seoul, Korea. The results indicated a significant improvement in traffic congestion, with the average queue length at the intersection reduced by up to 11.4%. [ABSTRACT FROM AUTHOR]