Search

The automatic control of vehicle traffic in large urban networks constitutes one of the most serious challenges to modern societies, with an impact on improving the quality of human life and saving energy and time. Intersections are a special traffic structure of pivotal importance as they accumulate a large number of vehicles that should be served in an optimal manner. Constructing intelligent models that manage to automatically coordinate and steer vehicles through intersections is a key point in the fragmentation of traffic control, offering active solutions through the flexibility of automatically adapting to a variety of traffic conditions. Responding to this call, this work aims to propose an integrated active solution of automatic traffic management. We introduce a multi-agent reinforcement learning framework that effectively models traffic flow at individual unsignalized intersections. It relies on a compact agent definition, a rich information state space, and a learning process characterized not only by depth and quality, but also by substantial degrees of freedom and variability. The resulting driving profiles are further transferred to larger road networks to integrate their individual elements and compose an effective automatic traffic control platform. Experiments are conducted on simulated road networks of variable complexity, demonstrating the potential of the proposed method. [ABSTRACT FROM AUTHOR]

One of the focal points in the field of intelligent transportation is the intelligent control of traffic signals (TS), aimed at enhancing the efficiency of urban road networks through specific algorithms. Deep Reinforcement Learning (DRL) algorithms have become mainstream, yet they suffer from inefficient training sample selection, leading to slow convergence. Additionally, enhancing model robustness is crucial for adapting to diverse traffic conditions. Hence, this paper proposes an enhanced method for traffic signal control (TSC) based on DRL. This approach utilizes dueling network and double q-learning to alleviate the overestimation issue of DRL. Additionally, it introduces a priority sampling mechanism to enhance the utilization efficiency of samples in memory. Moreover, noise parameters are integrated into the neural network model during training to bolster its robustness. By representing high-dimensional real-time traffic information as matrices, and employing a phase-cycled action space to guide the decision-making of intelligent agents. Additionally, utilizing a reward function that closely mirrors real-world scenarios to guide model training. Experimental results demonstrate faster convergence and optimal performance in metrics such as queue length and waiting time. Testing experiments further validate the method's robustness across different traffic flow scenarios. [ABSTRACT FROM AUTHOR]

In recent years, the increasing production and sales of automobiles have led to a notable rise in congestion on urban road traffic systems, particularly at ramps and intersections with traffic signals. Intelligent traffic signal control represents an effective means of addressing traffic congestion. Reinforcement learning methods have demonstrated considerable potential for addressing complex traffic signal control problems with multidimensional states and actions. In this research, the team propose Q-learning and Deep Q-Network (DQN) based signal control frameworks that use variable phase sequences and cycle times to adjust the order and the duration of signal phases to obtain a stable traffic signal control strategy. Experiments are simulated using the traffic simulator Simulation of Urban Mobility (SUMO) to test the average speed and the lane occupancy rate of vehicles entering the ramp to evaluate its safety performance and test the vehicle's traveling time to assess its stability. The simulation results show that both reinforcement learning algorithms are able to control cars in dynamic traffic environments with higher average speed and lower lane occupancy rate than the no-control method and that the DQN control model improves the average speed by about 10% and reduces the lane occupancy rate by about 30% compared to the Q-learning control model, providing a higher safety performance. [ABSTRACT FROM AUTHOR]

Multi-Agent Reinforcement Learning (MARL) has shown strong advantages in urban multi-intersection traffic signal control, but it also suffers from the problems of non-smooth environment and inter-agent coordination. However, most of the existing research on MARL traffic signal control has focused on designing efficient communication to solve the environment non-smoothness problem, while neglecting the coordination between agents. In order to coordinate among agents, this paper combines MARL and the regional mixed-strategy Nash equilibrium to construct a Deep Convolutional Nash Policy Gradient Traffic Signal Control (DCNPG-TSC) model, which enables agents to perceive the traffic environment in a wider range and achieves effective agent communication and collaboration. Additionally, a Multi-Agent Distributional Nash Policy Gradient (MADNPG) algorithm is proposed in this model, which is the first time the mixed-strategy Nash equilibrium is used for the improvement in the Multi-Agent Deep Deterministic Policy Gradient algorithm traffic signal control strategy to provide the optimal signal phase for each intersection. In addition, the eco-mobility concept is integrated into MARL traffic signal control to reduce pollutant emissions at intersections. Finally, simulation results in synthetic and real-world traffic road networks show that DCNPG-TSC outperforms other state-of-the-art MARL traffic signal control methods in almost all performance metrics, because it can aggregate the information of neighboring agents and optimize the agent's decisions through gaming to find an optimal joint equilibrium strategy for the traffic road network. [ABSTRACT FROM AUTHOR]

Trajectory data from connected vehicles (CVs) provide a continuous and reliable means of obtaining information that can be leveraged to optimize traffic signals. This paper proposes a real‐time traffic signal control method using CV trajectory data as the sole input. The primary goal of the proposed signal control method is to prevent queue spillover, which may significantly decrease the traffic efficiency on urban networks and induce high delays to the travelers. The proposed method formulates the signal control problem via a linear quadratic optimization model, considering the constraints related to the duration and variability of green lights in practical traffic signal control systems. Compared to conventional max‐pressure‐based methods, the optimization model offers enhanced efficiency in handling these constraints, making it highly suitable for real‐life implementation. The proposed method has undergone testing in both simulated environments and real‐world applications. In the simulation experiments, the proposed method has been demonstrated to effectively reduce spillover risks and outperform a conventional max‐pressure‐based approach even when the CV penetration rate is as low as 5%. In the real‐world experiment, the proposed method had been tested in a traffic network around the Beijing Capital International Airport for several months. The severity of spillovers, which was represented by two performance indicators, had been significantly reduced after implementing the proposed method. [ABSTRACT FROM AUTHOR]

Urbanization has led to accelerated traffic congestion, posing a significant obstacle to urban development. Traditional traffic signal scheduling methods are often inefficient and cumbersome, resulting in unnecessary waiting times for vehicles and pedestrians, exacerbating the traffic situation. To address this issue, this article proposes a dynamic traffic signal scheduling system based on an improved greedy algorithm. Unlike conventional approaches, we introduce a reward function and a cost model to ensure fair scheduling plans. A constraint function is also established, and the traffic signal scheduling is iterated through the feasible matrix using the greedy algorithm to simplify the decision-making process and enhance solution efficiency. Moreover, an emergency module is integrated to prioritize special emergency vehicles, reducing their response time during emergencies. To validate the effectiveness of our dynamic traffic signal scheduling system, we conducted simulation experiments using the Simulation of Urban Mobility (SUMO) traffic simulation suite and the SUMO traffic control interface Traci. The results indicate that our system significantly improves intersection throughput and adapts well to various traffic conditions, effectively resolving urban traffic congestion while ensuring fair scheduling plans. [ABSTRACT FROM AUTHOR]

The phenomenon of traffic congestion started in the second half of the twentieth century. This arose because of our society's constant increase in demand for mobility. The excessive traffic of vehicles attempting to use the same infrastructure at the same time is what causes congestion. The consequences are well-known: delays, air pollution, reduced speed, and dissatisfaction (which may lead to risky maneuvers, reducing pedestrian and other driver safety). Our objective is to simulate the change in traffic patterns brought about by app users in residential areas (using navigational tools like Google Maps and Apple Maps), where the majority of navigational tools provide shortcuts that go through residential areas. In addition to discouraging navigation apps from directing drivers through residential areas during peak hours to mitigate pollution levels, by developing an algorithm based on the technology of Green Light Optimized Speed Advisory (GLOSA) and implementing it in a simulated environment (VISSIM), we can see the effect of changing the duration of red lights while keeping green lights constant. Overall, this solution can be implemented to change the times of traffic lights without the need for supplies, additional equipment, or warning signs because most cities' traffic lights are already remotely controlled. In addition, this procedure is temporary to provide some freedom and does not adhere to the speed specified for drivers who wish to pass through residential areas outside of rush hour. [ABSTRACT FROM AUTHOR]

The optimization and control of traffic signals is very important for logistics transportation. It not only improves the operational efficiency and safety of road traffic, but also conforms to the direction of the intelligent, green, and sustainable development of modern cities. In order to improve the optimization effect of traffic signal control, this paper proposes a traffic signal optimization method based on deep reinforcement learning and Simulation of Urban Mobility (SUMO) software for urban traffic scenarios. The intersection training scenario was established using SUMO micro traffic simulation software, and the maximum vehicle queue length and vehicle queue time were selected as performance evaluation indicators. In order to be more relevant to the real environment, the experiment uses Weibull distribution to simulate vehicle generation. Since deep reinforcement learning takes into account both perceptual and decision-making capabilities, this study proposes a traffic signal optimization control model based on the deep reinforcement learning Deep Q Network (DQN) algorithm by considering the realism and complexity of traffic intersections, and first uses the DQN algorithm to train the model in a training scenario. After that, the G-DQN (Grouping-DQN) algorithm is proposed to address the problems that the definition of states in existing studies cannot accurately represent the traffic states and the slow convergence of neural networks. Finally, the performance of the G-DQN algorithm model was compared with the original DQN algorithm model and Advantage Actor-Critic (A2C) algorithm model. The experimental results show that the improved algorithm increased the main indicators in all aspects. [ABSTRACT FROM AUTHOR]

Traffic lights are crucial for urban traffic management, as they significantly impact congestion reduction and travel safety. Traditional methods relying on hand-crafted rules and operator experience are limited in their ability to adapt to changing traffic environments. To address this challenge, we have been exploring intelligent traffic light control using deep reinforcement learning techniques. However, current approaches often suffer from inadequate training data and unstable training processes, leading to suboptimal performance and real-world consequences. In this study, we propose RELight, a novel random ensemble reinforcement learning-based traffic light control framework. RELight effectively utilizes collected empirical data, ensuring a stable and efficient training process. To evaluate the performance of our proposed framework, we conducted a comprehensive set of experiments on a variety of datasets, including four synthetic datasets and a real traffic dataset collected from surveillance cameras at an intersection in Hangzhou, China. The results show that RELight outperforms existing approaches, demonstrating its superiority and potential for practical traffic light control applications. [ABSTRACT FROM AUTHOR]

Due to the increasing demand for transportation, road renovation is inevitable, and the emergence of work zones has become the most common problem in traffic control. There are many research results on the impact of work zones on traffic operation, but most of them focus on various capacity theoretical models or traffic flow control strategies and are mostly concentrated in highway work areas and urban road subway construction work areas. The location of these work zones is often unable to be changed and is mostly considered reasonable. At present, there is still a gap in selecting and evaluating the location of the work zone. Therefore, this article studied a bidirectional six-lane intersection in Xi'an and investigated the situation of traffic flow distortion caused by the setting of work zones at the intersection. Two different positions and forms of work zones were designed for evaluation and analysis. Firstly, we used VISSIM (2022 student) to simulate the original and proposed work zone road-occupation schemes and analyzed six indicators. Finally, in order to determine the optimal work zone locations under different traffic situations, we applied the entropy weight method (EWM) to assign weights to multiple indicators, thereby achieving a comprehensive assessment of various schemes. The results showed that the highest improvement level among the six indicators was 50.2%, and different schemes adapted to different traffic situations. However, occupying two lanes of the median opposite the exit lane performed better under high traffic volume. Occupying the median and lanes on both sides of the median is suitable for low traffic volume. Occupying two lanes of the entrance lane and using the opposite lane as the left-turn entrance lane is suitable for situations with high traffic volume in the opposite lane. [ABSTRACT FROM AUTHOR]

In recent years, there has been significant development in intelligent technologies for urban traffic control, such as smart city and vehicle-to-everything (V2X) communication. These advancements aim to provide more efficient and convenient services to participants in urban transportation. As the urban traffic control (UTC) system integrates with various networks and physical infrastructure, the potential threats of malicious attacks and breaches pose significant risks to the safety of individuals and their properties. To address this issue, this academic paper focuses on studying the network structure of the UTC system. A signal security game model is constructed based on the concepts of evolutionary game theory (EGT), involving three parties: attackers, upper computers (UC), and traffic signal machines (TSM). The model aims to analyze the evolutionary stability of the strategies chosen by each party, and to explore the relationships between various factors and the strategy choices of the three parties. Furthermore, the stability of equilibrium points in the three-party game system is analyzed using the Liapunov method. The conditions in which UC and TSM, dependent on detection rates and defense costs, choose to abandon defense at pure-strategy equilibrium points were obtained. Finally, MATLAB is utilized for simulation analysis to validate the impact of attack costs, defense costs, and detection rates on the information security of UTC systems. [ABSTRACT FROM AUTHOR]

One of the world's challenges is the amount of traffic on the roads. Waiting for the green light is a major cause of traffic congestion. Low throughput rates and eventual congestion come from many traffic signals that are hard coded, irrespective of the volume of the amount of traffic. Instead of depending on predefined time intervals, it is essential to build a traffic signal control system that can react to changing vehicle densities. Emergency vehicles, like ambulances, must be given priority at the intersection so as not to spend more time at the traffic light. Computer vision techniques can be used to improve road traffic signal control and reduce real-time traffic delays at intersections without the requirement for substantial infrastructure analysis. Long wait times and significant energy consumption are just two of the problems of the current traffic signal control system. To optimal efficiency, the traffic signal's duration must be dynamically changed to account for current traffic volume. To lessen congestion, the approach taken in this research focuses on modifying traffic signal time determined by the density of vehicles at the crossroads. The main purpose of this article is to demonstrate heavy traffic and emergency vehicle prioritization from all directions at the traffic intersection for a speedy passage. Using the Pygame tool, the proposed method in this study, which includes a mechanism for estimating traffic density and prioritization by counting vehicles at a traffic junction, is demonstrated. The vehicle throughput for the adaptive traffic light built using Pygame is compared with the vehicle pass rate for the adaptive traffic light built using Simulation of Urban Mobility (SUMO). The simulation results show that the adaptive traffic light built using Pygame achieves 90% throughput compared to the adaptive traffic light built using SUMO. A Two-Dimensional Convolutional Neural Network (2D-CNN) is implemented using Tensorflow for vehicle classification. The 2D-CNN model demonstrated 96% accuracy in classifying vehicles using the test dataset. Additionally, emergency vehicles, such as ambulances, are given priority for quick passing. [ABSTRACT FROM AUTHOR]

An alternative approach for real-time network-wide traffic control in cities that has recently gained attention is perimeter flow control. Many studies have shown that this method is more efficient than state-of-the-art adaptive signal control strategies for heterogeneously congested urban networks. The basic concept of such an approach is to partition heterogeneous cities into a small number of homogeneous regions (zones) and apply perimeter control to the interregional flows along the boundaries between regions. The transferring flows are controlled at the traffic intersections located at the borders between regions so as to distribute the congestion in an optimal way and minimize the total delay of the system. The focus of current work is the mathematical formulation of the original nonlinear problem in a linear parameter-varying (LPV) form so that optimal control can be applied in a (rolling horizon) model predictive concept. This work presents the mathematical analysis of the optimal control problem as well as the approximations and simplifications that are assumed in order to derive the formulation of a linear optimization problem. Numerical simulation results for the case of a macroscopic environment (plant) are presented in order to demonstrate the efficiency of the proposed approach. Results for the closed-loop model predictive control scheme are presented for the nonlinear case, which is used as "benchmark," as well as the linear case. Furthermore, the developed scheme is applied to a large-scale microsimulation of a European city with more than 500 signalized intersections in order to better investigate its applicability to real-life conditions. The simulation experiments demonstrate the effectiveness of the scheme compared with fixed-time control because all of the performance indicators are significantly improved. Funding: This work was supported by Dit4Tram (Distributed Intelligence & Technology for Traffic & Mobility Management) project from the European Union's Horizon 2020 research and innovation programme under [Grant 953783]. [ABSTRACT FROM AUTHOR]

Spatial–temporal prediction is an important part of a great number of applications, such as urban traffic control, urban traffic management, and urban traffic planning. However, real-world spatial–temporal data often have complex patterns, so it is still challenging to predict them accurately. Most existing spatial–temporal prediction models fail to aggregate the spatial features in a suitable neighborhood during fixed spatial dependencies extraction and lack adequately comprehensive time series analysis for intricate temporal dependencies. This paper proposes a novel model named multi-scale spatial–temporal transformer network (MSSTTN) to deal with intricate spatial–temporal patterns. Firstly, we develop an improved graph wavelet neural network, which learns how to pass the spatial graph signals of different frequency scales to adjust the neighborhood of feature aggregation adaptively. Then, we propose decomposing the time series into local trend-cyclical parts of various scales during time series analysis, making the model capture more reliable temporal dependencies. The proposed model has been evaluated on publicly available real-world datasets. The experimental findings indicate that the proposed model exhibits superior performance compared to conventional techniques including, spatial–temporal transformer (STTNs), GraphWaveNet, and others. [ABSTRACT FROM AUTHOR]

Platooning is generally known as a control method for driving a group of connected and automated vehicles in motorway context. Nevertheless, platoon control might also work on urban roads. One possible strategy to increase overall road traffic performance and to reduce congestion in urban traffic networks is to combine platooning with traffic signal control at intersections. The traffic flow can be maximized with coordinated scheduling of traffic signals together with platooning activities, resulting in decreased travel times and fuel consumption. This paper investigates several aspects of this combined control, such as the procedures for coordination and communication between platooning vehicles and traffic signals. Efficient algorithms are suggested to optimize platoon formation and dissolution at junctions and to change traffic signal phases depending on platoon arrival and departure times. The proposed solutions have been tested and verified with SUMO, a high-fidelity microscopic traffic simulator. [ABSTRACT FROM AUTHOR]

The real-time vehicular traffic system is an integral part of the urban vehicular traffic system, which provides effective traffic signal control for a large multifaceted traffic network and is a highly challenging distributed control problem. Coordinating vehicular traffic enables the network model to deliver an efficient service flow. Consider that there are four lanes of vehicular traffic in this situation, allowing parallel vehicle movements to occur without causing an accident. In this instance, the vehicular system's control parameters are time and vehicle volume. In this work, vehicular traffic flow is examined, and an algorithm to estimate vehicle waiting time in each direction is estimated. The effectiveness of the proposed vehicle traffic signal distribution control system by comparing the experimental results with a real-time vehicular traffic system is verified. This is also illustrated numerically. [ABSTRACT FROM AUTHOR]

We studied the ability of deep reinforcement learning and self-organizing approaches to adapt to dynamic complex systems, using the applied example of traffic signal control in a simulated urban environment. We highlight the general limitations of deep learning for control in complex systems, even when employing state-of-the-art meta-learning methods, and contrast it with self-organization-based methods. Accordingly, we argue that complex systems are a good and challenging study environment for developing and improving meta-learning approaches. At the same time, we point to the importance of baselines to which meta-learning methods can be compared and present a self-organizing analytic traffic signal control that outperforms state-of-the-art meta-learning in some scenarios. We also show that meta-learning methods outperform classical learning methods in our simulated environment (around 1.5–2× improvement, in most scenarios). Our conclusions are that, in order to develop effective meta-learning methods that are able to adapt to a variety of conditions, it is necessary to test them in demanding, complex settings (such as, for example, urban traffic control) and compare them against established methods. [ABSTRACT FROM AUTHOR]

Autonomous vehicles are in the main focus for automotive companies and urban traffic engineers as well. As their penetration rate in traffic becomes more and more pronounced due to improvement in sensor technologies and the corresponding infrastructure, new methods for autonomous vehicle controls become a necessity. For instance, autonomous vehicles can improve the performance of urban traffic and prevent the formation of congestions with the usage of Vehicle-to-Vehicle (V2V) and Vehicle-to-Infrastructure (V2I) communication based control methods. One of the key area for improvement is centralized intersection control for autonomous vehicles, by which traveling times can be reduced and efficiency of traffic flow can be improved, while safety of passengers can be guaranteed through constraints built in the centralized design. The paper presents the analysis of a Model Predictive Control (MPC) method for the coordination of autonomous vehicles at intersections by comparing it with an offline constraint optimization considering time and energy optimal intervention of vehicles. The analysis has been evaluated in high-fidelity simulation environment CarSim, where the speed trajectories, traveling times and energy consumptions have been compared for the different methods. The simulations show that the proposed time-optimal MPC intersection control method results in similar traveling times of that given by the time-optimal offline constraint optimization, while the energy optimal optimization re-quires significantly more time for the autonomous vehicle to achieve. Due to the possibility of a congestion forming in the latter case, the proposed centralized MPC method is more applicable in real traffic scenarios. [ABSTRACT FROM AUTHOR]

The transportation control infrastructure serves as the foundation for regional traffic signal control. However, in practice, this infrastructure is often imperfect and complex, characterized by factors such as heterogeneity and uncertainty, which pose significant challenges to existing methods and systems. Therefore, this paper proposes a novel approach to coordinated traffic signal control that emphasizes flexibility. To achieve this flexibility, we combine the flexible model of complex networks with robust fuzzy control methods. This approach enables us to overcome the complexity of the transportation control infrastructure and ensure efficient management of traffic signals. Additionally, to ensure long-term operational ease, we develop a regional traffic signal control system using steam computing technology, which provides high scalability and compatibility. Finally, computational experiments are performed to validate adaptability and performance of our proposed approach. [ABSTRACT FROM AUTHOR]

Urbanised city transportation simulation needs a wide range of factors to reflect the influence of certain real-life events accurately. The vehicle composition and the timing of the traffic light signal scheduling play an important role in controlling the traffic flow and facilitate road users, particularly in densely populated urban cities. Since road capacity in urban cities changes throughout the day, an optimal traffic light signal duration might be different. Hence, in this paper, the effect of vehicle composition and traffic light phases on traffic flow during peak and off-peak hours in Georgetown, Penang, one of the highly populated cities in Malaysia, is investigated. Through Agent-Based Modelling (ABM), this complex system is simulated by integrating the driver's behaviour into the model using the GIS and Agent-Based Modelling Architecture (GAMA) simulation platform. The result of predicted traffic flow varies significantly depending on the vehicle composition while the duration of the traffic signal timing has little impact on traffic flow during peak hours. However, during off-peak hour, it is suggested that 20 s duration of green light provides the highest flow compared to 30 s and 40 s duration of green light. This concludes that the planning for traffic light phasing should consider multiple factors since the vehicle composition and traffic light timing for an effective traffic flow varies according to the volume of road users. [ABSTRACT FROM AUTHOR]

The rapid global spread of the coronavirus disease 2019 (COVID-19) is now a reality. China has taken urban traffic control measures to prevent and control the epidemic, but this has prevented the flow of people between cities. This study investigates the mechanism of the impact of urban traffic control measures on the intercity population flow in China using the one-way causal measurement method. The results show that the impact of urban traffic control measures on the intercity flow of the population changes with time. Based on this, this study makes scientific suggestions for the government on how to reasonably undertake traffic control measures. [ABSTRACT FROM AUTHOR]

Effective accident detection and traffic flow forecasting are of great importance for quick respond, impact elimination and intelligent control of the traffic flow consisting of autonomous vehicles. This paper proposes a traffic accident detection method for connected and automated transport systems by conducting a grid-based parameter extracting and SVC-based traffic state classification. Allowing for the dynamic spread of traffic flow over time, from upstream to downstream and from accident lanes to other lanes, a spatiotemporal Markov model is established to predict the evolution of traffic flow after accident by introducing the grid as state detection unit and fitting the spatiotemporal evolution with the parameter space mean speed to match the need of both detection accuracy and monitoring scope. Compared with actual accident data, the validation results indicate that the proposed methods present a good performance in accident detection with the accident detection rate as 87.72% and a higher precision rate than both SVM (support vector machine) and ANN (artificial neural network) models in traffic flow prediction. With the active traffic accident identification and dynamic traffic flow prediction, it is beneficial to shorten detection time, reduce possible impacts of traffic accidents and carbon emissions from congestion. The methods can be implied to traffic state recognition and traffic flow prediction, which is one of the significant sections of connected and automated transport systems, and serve as references for accident handling and urban traffic management. [ABSTRACT FROM AUTHOR]

The connected and autonomous vehicle (CAV) is promised to ease congestion in the future with the rapid development of related technologies in recent years. To explore the characteristics of mixed-traffic flow and the dynamic transmission mechanism, this paper firstly detailed the car-following model of different vehicle types, establishing the fundamental diagram of the mixed-traffic flow through considering the different penetration rates and fleet size of CAV. Secondly, this paper constructed the lane-changing judgment mechanism based on the random utility theory. Finally, the paper proposed a lane-level dynamic cell transmission process, combined with a lane-changing strategy and cell transmission model. The effectiveness and feasibility of the model are verified using simulation analysis. This model makes a systematic, theoretical analysis from the perspective of the internal operation mechanism of traffic flow, and the lane-level traffic strategy provides a theoretical basis for balancing urban lane distribution and intelligent traffic management and control. [ABSTRACT FROM AUTHOR]

Traffic flow prediction is one of the most important tasks of the Intelligent Transportation Systems (ITSs) for traffic management, and it is also a challenging task affected by many complex factors, such as weather and time. Many cities adopt efficient traffic prediction methods to control traffic congestion. However, most of the existing methods of traffic prediction focus on urban road scenarios, neglecting the complexity of multivariate auxiliary information in highways. Moreover, these methods have difficulty explaining the prediction results based only on the historical traffic flow sequence. To tackle these problems, we propose a novel traffic prediction model, namely Multi-variate and Multi-horizon prediction based on Long Short-Term Memory (MMLSTM). MMLSTM can effectively incorporate auxiliary information, such as weather and time, based on a strategy of multi-horizon time spans to improve the prediction performance. Specifically, we first exploit a multi-horizon bidirectional LSTM model for fusing the multivariate auxiliary information in different time spans. Then, we combine an attention mechanism and multi-layer perceptron to conduct the traffic prediction. Furthermore, we can use the information of multivariate (weather and time) to provide interpretability to manage the model. Comprehensive experiments are conducted on Hangst and Metr-la datasets, and MMLSTM achieves better performance than baselines on traffic prediction tasks. [ABSTRACT FROM AUTHOR]

Reinforcement learning (RL)‐based models have been widely studied for traffic signal control with objectives, such as minimizing vehicle delay and queue length, maximizing vehicle throughput, and improving road safety, through tailored reward designs. Despite the advancements in RL‐based signal control models for car traffic, limited research focused on multimodal traffic (e.g. car, bus, pedestrian). The simplified environment of unimodal traffic restrains these models from applications in real‐world cases. In this paper, the authors propose an RL‐based human‐centric multimodal deep (HMD) traffic signal control method to coordinate multimodal traffic at an intersection, with the objective of minimizing the waiting time per capita for multiple traffic modes by taking consideration of the mode capacity to ensure social equity. The method is validated in the simulation of urban mobility (SUMO) simulation environment using real traffic data. The results show the superior performance of HMD over vehicle‐centric (VC) RL‐based methods and traditional signal control schemes. HMD reduces the waiting time per capita by up to 19.2% and 6.3% compared with the fixed timing and VC RL‐based methods. In addition, the experiment results show that the HMD method assigns a higher priority to public transport over low‐occupancy travel modes in passing through intersections compared with unimodal traffic signal control strategies. [ABSTRACT FROM AUTHOR]

Mixed traffic flows are opening up new areas for research and are seen as key drivers in the field of data and services that will make roads safer and more environmentally friendly. Understanding the effects of Connected Vehicles (CVs) and Connected Autonomous Vehicles (CAVs), as one of the vehicle components of mixed traffic flows, will make it easier to avoid traffic congestion and contribute to the creation of innovative applications and solutions. It is notable that the literature related to the analysis of the impact of mixed traffic flows on traffic signal control in urban areas rarely considers mixed traffic flow containing CVs, CAVs, and Human Driven Vehicles (HDVs). Therefore, this paper provides an overview of the relevant research papers covering the topic of urban Traffic Signal Control (TSC) and mixed traffic flows. Best practices for intersection state estimation and TSC in the case of mixed traffic flows in an urban environment are summarized and possible approaches for utilizing CVs and CAVs as mobile sensors and actuators are discussed. [ABSTRACT FROM AUTHOR]

Cooperative control of vehicle trajectories and traffic signal phases is a promising approach to improving the efficiency and safety of transportation systems. This type of traffic flow control refers to the coordination and optimization of vehicle trajectories and traffic signal phases to reduce congestion, travel time, and fuel consumption. In this paper, we propose a cooperative control method that combines a model predictive control algorithm for adaptive traffic signal control and a trajectory construction algorithm. For traffic signal phase selection, the proposed modification of the adaptive traffic signal control algorithm combines the travel time obtained using either the vehicle trajectory or a deep neural network model and stop delays. The vehicle trajectory construction algorithm takes into account the predicted traffic signal phase to achieve cooperative control. To evaluate the method performance, numerical experiments have been conducted for three real-world scenarios in the SUMO simulation package. The experimental results show that the proposed cooperative control method can reduce the average fuel consumption by 1% to 4.2%, the average travel time by 1% to 5.3%, and the average stop delays to 27% for different simulation scenarios compared to the baseline methods. [ABSTRACT FROM AUTHOR]

In the modern world, the extremely rapid growth of traffic demand has become a major problem for urban traffic development. Continuous optimization of signal control systems is an important way to relieve traffic pressure in cities. In recent years, with the impressive development of deep reinforcement learning (DRL), some DRL approaches have started to be applied to traffic signal control. Unlike traditional signal control methods, agents trained using DRL approaches continuously receive feedback from the environment to continuously improve the policy. Since current research in the field is more focused on the performance of the agent, data efficiency during training is ignored to some extent. However, in traffic signal control tasks, the cost of trial and error is very expensive. In this paper, we propose a DRL approach based on a traffic inference model. The proposed traffic inference model is based on the future information given based on upstream intersections and data from the environment to continuously learn the changing patterns of the traffic environment in order to make inferences about changes in the traffic environment. In the proposed algorithm, the inference model interacts with the agent instead of the environment. Through comprehensive experiments based on realistic datasets, we demonstrate that our proposed algorithm is superior to other algorithms in terms of its data efficiency and stronger performance. [ABSTRACT FROM AUTHOR]

Cooperation between intersections in large-scale road networks is critical in traffic congestion. Currently, most traffic signals cooperate via pre-defined timing phases, which is extremely inefficient in real-time traffic scenarios. Most existing studies on multi-agent reinforcement learning (MARL) traffic signal control have focused on designing efficient communication methods, but have ignored the importance of how agents interact in cooperative communication. To achieve more efficient cooperation among traffic signals and alleviate urban traffic congestion, this study constructs a Graph Cooperation Q-learning Network Traffic Signal Control (GCQN-TSC) model, which is a graph cooperation network with an embedded self-attention mechanism that enables agents to adjust their attention in real time according to the dynamic traffic flow information, perceive the traffic environment quickly and effectively in a larger range, and help agents achieve more effective collaboration. Moreover, the Deep Graph Q-learning (DGQ) algorithm is proposed in this model to optimize the traffic signal control strategy according to the spatio-temporal characteristics of different traffic scenes and provide the optimal signal phase for each intersection. This study also integrates the ecological traffic concept into MARL traffic signal control, which aims to reduce traffic exhaust emissions. Finally, the proposed GCQN-TSC is experimentally validated both in a synthetic traffic grid and a real-world traffic network using the SUMO simulator. The experimental results show that GCQN-TSC outperforms other traffic signal control methods in almost all performance metrics, including average queue length and waiting time, as it can aggregate information acquired from collaborative agents and make network-level signal optimization decisions. [ABSTRACT FROM AUTHOR]

In new-tier cities with rapid urbanization, the reorganization of urban spatial functions and the development of road networks have brought novel challenges to traffic congestion control. Urban land use patterns have a significant correlation with urban traffic congestion. However, whether and how land use patterns of cities close to the roads affect road congestion is less to be discussed. This article investigated the relationship between land use patterns close to the urban trunk road network and traffic congestion in new tier cities Xi'an, China. We adopted the DBSCAN algorithm to cluster POIs and use the mixed POI clusters to label the socio-economic functions of roads. We found the spatial heterogeneity of POIs on the trunk road network and identified the impacts of the scales and types of POI on road congestion based on the empirical analysis. Compared to the POIs as origin and destination of the trips, the POIs as stopover points of the trips cause significantly more road congestion. The POIs with bidirectional flows at entrances/exits are more likely to cause road congestion than the POIs with unidirectional flows. Moreover, the POIs with flexible traffic flows increase road congestion, while the POIs with predicted traffic flows have no statistically significant correlation with road congestion. The results help urban planners to plan the scale, type, and location of POIs close to roads and to optimize the socio-economic functions of roads and alleviate road congestion. [ABSTRACT FROM AUTHOR]

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system's model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density. [ABSTRACT FROM AUTHOR]

An optimization model for traffic light control in an urban network of intersections is derived. The model is based on store-and-forward analytic relations, which account for the length of the queue of waiting vehicles in front of the traffic light intersection. The model is complicated with probabilistic relations that formalize the requirements for maintaining short queues of vehicles. Probabilistic inequalities apply to each intersection of the city network. Approximations of probability inequalities are given in the article. Quadratic deterministic inequalities, which are part of the set of the traffic flow control optimization problem, are derived. Numerical simulations are performed, applying mean estimated data for real traffic in an urban area of Sofia. The model predictive approach is applied to traffic light optimization and control. Empirical results give advantages of the obtained model compared to the classical store-and-forward optimization model for the total number of vehicles waiting in the considered urban network. [ABSTRACT FROM AUTHOR]

The intersection traffic signal control is an essential means of urban traffic. To solve the problem of urban congestion, it is necessary to consider the optimal signal control strategy for intersections. Using the store-and-forward method of traffic control modeling, the in-queue vehicle number of the key signal phase as the payoff index, this paper designs an optimal intersection signal-timing strategy based on the game theory method. In this strategy, each key phase is regarded as a game player, and each player competes for the release time to maximize their own payoff and minimize the queue. To optimize the intersection efficiency, a game strategy is designed to achieve the Nash equilibrium state, which is the queueing equilibrium of each key phase. Finally, by VISSIM simulation, the total number of stops can be decreased by 5% to 10% compared with the MA-DD-DACC method. [ABSTRACT FROM AUTHOR]

Traffic patterns in urban areas present a complex and dynamic system that is characterized by inherent uncertainties. The presented study is a traffic light control system with feedback. The controller of the system is designed in a fuzzy and conventional way and is applied to a network of two junctions. The verification is performed using the MATLAB fuzzy toolbox platform (for designing the fuzzy controller) and Aimsun platform for microsimulation of the two junctions using the two types of controllers. To accomplish the control of the system a fuzzy controller on heuristic rules proposed to allow adaptive traffic control on signalized junctions in urban environments. The Fuzzy Toolbox in MATLAB is used to simulate the fuzzy controller. The Aimsun traffic simulator is used to model and simulate a traffic network of two intersections. The green light duration in the Aimsun model is based on the results for the two controllers from two separated experiments. Simulations of Aimsun models with the two types of controllers, the fuzzy and the conventional one, are compared. The experiment is performed under the premise that the traffic flow is oversaturated. Findings show that in a network of two junctions both controllers perform in a similar manner for the first junction. However, for the second junction, the fuzzy controller tends to have some advantages over the conventional controller with regard to higher traffic flow. In conclusion, the overall performance of the fuzzy controller is better than the one of the conventional controller, but further research is needed for more complex traffic networks. [ABSTRACT FROM AUTHOR]

Short‐term traffic flow prediction is particularly important for urban traffic control and congestion management. To improve the accuracy of traffic flow prediction, a new traffic flow prediction approach is proposed from the perspective of vehicle functions by using Radio Frequency Identification (RFID) electronic license plate (ELP) data. First, the improved Wavelet Neural Network (WNN) is introduced by adding three momentum terms to avoid local minimum and overfitting. The Long Short‐Term Memory Neural Network (LSTM) is constructed to train the time series with long time lags. Second, a novel short‐term traffic flow prediction method is developed by combining the improved WNN and LSTM in an urban road section. The proposed method performs a weighted combination to obtain a new prediction value according to whether the difference between the prediction values of the two methods satisfy the defined threshold, and then selects the one with the smallest error among the three prediction values as the final prediction result. Third, the experiments explore the prediction performance of the weekdays and weekends with 5 min‐interval, 15 min‐interval and 30 min‐interval via using RFID‐ELP data from Chongqing, China. Compared with existing prediction methods, the proposed approach can promote prediction performance and meet real‐time requirements. [ABSTRACT FROM AUTHOR]

Traffic volume data at fixed detectors are of great importance to track the time-varying states of urban traffic, and the volume of each turning movement (i.e., continuing straight, turning left, turning right) in an intersection plays a significant role in traffic control. It is a difficult issue to determine the complete road network volume due to the limited coverage of detector deployment. Existing traffic volume imputation methods seem to be hardly tractable to address this persistent missing data problem of fixed detectors because they mainly function by utilizing spatiotemporal patterns of historical data to address the problem of intermittent missing traffic data collected from probe vehicles. Considering the unattainable temporal information of the target movement, this paper aims to develop an end-to-end graph neural network-based imputation approach to impute traffic volume data with persistent missing patterns. We regard the road network as a directed graph with each turning movement as a node and employ a meta-learning-based graph attention mechanism with graph embedding in multiple spatial granularities to fully extract the relationship between the target node and its neighbours. In addition, a multitask learning mechanism is designed to improve the accuracy of the imputation results by setting auxiliary tasks according to the volume conservation constraints. The proposed approach has been validated with extensive simulation experiments and applied to field tests for Shenzhen and Shanghai, China, with considerable accuracy and reliability, satisfying the demand for traffic control. To the best of our knowledge, this is the first time that traffic volume has been imputed for persistent missing patterns with a graph neural network-based method. [ABSTRACT FROM AUTHOR]

Observability and controllability are two critical requirements for a partially observable transportation system. This paper proposes a stepwise signal optimization framework with connected vehicle (CV) data as input to solve both challenges. First, a Bayesian deduction method based on low‐penetration CV data is established to estimate the traffic volume. Thereafter, an offline signal optimization model is constructed to simultaneously optimize the flexible lane settings and signal timings, which are set as the prior information for the third step. In the third step, an online deep recurrent Q‐learning (DRQN) signal optimization model dynamically adjusts signal settings based on real‐time traffic information. Numerical experiments demonstrate that the model outperforms the actuated control, the online DQRN model without offline filter, and the back‐pressure model by 9%–66% and 7%–29% in two networks. This study innovatively combines traffic state estimation and traffic signal control as an integrated process. It contributes to an improved understanding of traffic control in a CV environment and lays a solid foundation for future traffic control strategies. [ABSTRACT FROM AUTHOR]

With the fast-expanding number of vehicles in smart cities, the management of road intersections and traffic congestion has grown to be major problems. Drivers often express their opinion that putting traffic lights on while taking traffic flows into account will have a significant impact on how traffic moves. This paper presents a smart Road traffic Control management system termed Urban Traffic Control (UTC) keeping real-time dynamic traffic flow in mind which helps in upgrading the level of road traffic network management. To provide an organized traffic arrangement, UTC presents methodologies such as vehicle counting, controlling process, and evaluation of lanes keeping status in mind, this whole procedure is implemented by taking the complete traffic network into an account instead of just considering intersections. The primary goal of our system is to lessen traffic jams by cutting down on the trip and waiting times vehicles spend at crossings and intersections. We need to assign a plan for traffic flow that has the least amount of traffic congestion and vehicle waiting time, for this purpose some indicators and models are introduced in this study. Lane weight, traffic jam indicator, and vehicle priority are among these models. As this work is an improvement on the current Road Network without much changing, we integrate our system on normal traffic lights which allow each lane a chance to move and we also considered the no-interference lane movement. To simulate our idea, we introduced a smart road traffic control system consisting of multi-agents, by using a NetLogo stimulator. To compare the fixed cycle traffic light, several vehicles (150 in total) with random behaviour were generated and scattered over 25 different intersections for the time duration of 9 h. This setting was used to test our smart traffic control solution on both lane flow and no interference movement flow. According to the obtained results, there was a 25.98% reduction in total average waiting time over simulation period for all vehicles and a reduction of 34.16% for no interference movement flow. These observations clearly state that suggested method is better suited for today's complex traffic conditions where change in infrastructure is minimal. [ABSTRACT FROM AUTHOR]

Strategic traffic management is crucial for combating traffic congestion at the macroscopic level. However, such a field is still relatively unexplored, particularly for microscopic control objects, such as intersections and coordinated intersection groups. This article proposes a human-in-the-loop recommendation system for strategic urban traffic management, which follows an agent-based structure. A regional agent dispatcher is defined to assign agents for operation whenever “operation on-demand” is required. Such a requirement is identified by a daily-dependent operational mode on strategic traffic operations at a control object level. The strategic management scheme for each control object is guided by a strategic agent (customized), which is essentially a deep recommender model with a specific architecture. By featuring the multiagent design, a customized operational scheme can be generated at the intersection level, which instructs the corresponding controller to take specific operations. The utility of the recommendation system is demonstrated via a case study using real-world traffic data. In both offline and online evaluations, the system performs consistently at traffic operational recommendations in different scenarios and has the potential to provide more reasonable traffic operational strategies than a human-operated system. [ABSTRACT FROM AUTHOR]

Software-defined networking (SDN), a novel network paradigm, separates the control plane and data plane into different network equipment to realize the flexible control of network traffic. Its excellent programmability and global view present many new opportunities. DDoS detection under the SDN context is an important and challenging research field. Some previous works attempted to collect and analyze statistics related to flows, usually recorded in switches, to address DDoS threats. In contrast, other works applied machine learning-based solutions to identify DDoS and achieved promising results. Generally, most previous works need to periodically request flow rules or packets to obtain flow statistics or features to detect stealthy exceptions. Nevertheless, the request for flow rules is very time-consuming and CPU-consuming; moreover may congest the communication channel between the controller and the switches. Therefore, we present FORT, a lightweight DDoS detection scheme, which spreads the rule-based detection algorithm at edge switches and determines whether to start it by periodically retrieving the ports state. A time-series algorithm, ARIMA, is utilized to determine the port statistics adaptively, and an SVM algorithm is applied to detect whether a DDoS attack does occur. Representative experiments demonstrate that FORT can significantly reduce the controller load and provide a reliable detection accuracy. Referring to the false alarm rate of 1.24% in the comparison scheme, the false alarm rate of this scheme is only 0.039%, which significantly reduces the probability of false alarm. Besides, by introducing the alarm mechanism, this scheme can reduce the load of the southbound channel by more than 60% in the normal state. [ABSTRACT FROM AUTHOR]

Adaptive traffic signal control (ATSC) is an effective method to reduce traffic congestion in modern urban areas. Many studies adopted various approaches to adjust traffic signal plans according to real-time traffic in response to demand fluctuations to improve urban network performance (e.g., minimise delay). Recently, learning-based methods such as reinforcement learning (RL) have achieved promising results in signal plan optimisation. However, adopting these self-learning techniques in future traffic environments in the presence of connected and automated vehicles (CAVs) remains largely an open challenge. This study develops a real-time RL-based adaptive traffic signal control that optimises a signal plan to minimise the total queue length while allowing the CAVs to adjust their speed based on a fixed timing strategy to decrease total stop delays. The highlight of this work is combining a speed guidance system with a reinforcement learning-based traffic signal control. Two different performance measures are implemented to minimise total queue length and total stop delays. Results indicate that the proposed method outperforms a fixed timing plan (with optimal speed advisory in a CAV environment) and traditional actuated control, in terms of average stop delay of vehicle and queue length, particularly under saturated and oversaturated conditions. [ABSTRACT FROM AUTHOR]

The significant advancements in intelligent transportation systems (ITS) have contributed to the increased development in traffic modeling. These advancements include prediction and simulation models that are used to simulate and predict traffic behaviors on highway roads and urban networks. These models are capable of precise modeling of the current traffic status and accurate predictions of the future status based on varying traffic conditions. However, selecting the appropriate traffic model for a specific environmental setting is challenging and expensive due to the different requirements that need to be considered, such as accuracy, performance, and efficiency. In this research, we present a comprehensive literature review of the research related to traffic prediction and simulation models. We start by highlighting the challenges in the long-term and short-term prediction of traffic modeling. Then, we review the most common nonparametric prediction models. Lastly, we look into the existing literature on traffic simulation tools and traffic simulation algorithms. We summarize the available traffic models, define the required parameters, and discuss the limitations of each model. We hope that this survey serves as a useful resource for traffic management engineers, researchers, and practitioners in this domain. [ABSTRACT FROM AUTHOR]

Predicting spatiotemporal congestion situations of a traffic network is a prerequisite for urban traffic control. This study proposes a spatiotemporal traffic congestion situation prediction method based on the recurrent gated unit-convolutional neural network (GRU-CNN). Considering the time and space attributes of traffic data, the third-order tensor of the traffic data is extracted from the time domain, and the GRU is used to predict the traffic flow parameters of the traffic network. Then, the third-order tensor of multisource spatiotemporal traffic data is compressed into traffic data images and combined with the spatial structure. The feature extraction technology of a CNN is used to extract and identify the traffic network congestion features. Actual urban traffic network data are selected for model verification. The multistep prediction of the traffic flow parameters effectively ensures prediction accuracy. The proposed model is trained by the actual classification dataset. The prediction results of the test set demonstrate the model's reliability. Based on predicting the traffic parameters of the network, this model can give a highly accurate judgment of the traffic situation for the entire network. Compared with other models, the proposed model further improves the accuracy of road network traffic state discrimination and has better robustness. [ABSTRACT FROM AUTHOR]

Traffic parameter characteristics in congested road networks are explored based on traffic flow theory, and observed variables are transformed to a uniform format. The Gaussian mixture model is used to reconstruct route trajectories based on data regarding travel routes containing only the origin and destination information. Using a bi-level optimization framework, a Bayesian traffic demand estimation model was built using route trajectory reconstruction in congested networks. Numerical examples demonstrate that traffic demand estimation errors, without considering a congested network, are within ±12; whereas estimation demands considering traffic congestion are close to the real values. Using the Gaussian mixture model's technology of trajectory reconstruction, the mean of the traffic demand root mean square error can be stabilized to approximately 1.3. Traffic demand estimation accuracy decreases with an increase in observed data usage, and the designed iterative algorithm can predict convergence with 0.06 accuracy. The evolution rules of urban traffic demands and road flows in congested networks are uncovered, and a theoretical basis for alleviating urban traffic congestion is provided to determine traffic management and control strategies. [ABSTRACT FROM AUTHOR]

Cities need to develop, people's lives need to be improved, and the living environment needs to be enhanced. With the strengthening of the national policy of paying attention to people's livelihood, the speed of development, the increase of the number of cars, and the major demolition and construction of streets are in full swing everywhere. However, traffic congestion has become a serious social problem, which greatly affects economic development and people's daily life. Therefore, the study of signal coordination control of urban traffic arteries has become an urgent problem for all countries. In this paper, after a brief introduction of the basic concepts and related technologies of traffic control systems, we focus on the arterial coordinated control system. The adaptive control model studied in this paper reveals the vehicle arrival dynamics from a microscopic perspective, which helps to improve the adaptive control effect and alleviate urban intersection congestion. The use of traffic information acquisition and control systems can promote the application of vehicle networking technology, while moreover helping to provide important model simulations for future street simulation renovation. [ABSTRACT FROM AUTHOR]

Detecting and counting on road vehicles is a key task in intelligent transport management and surveillance systems. The applicability lies both in urban and highway traffic monitoring and control, particularly in difficult weather and traffic conditions. In the past, the task has been performed through data acquired from sensors and conventional image processing toolbox. However, with the advent of emerging deep learning based smart computer vision systems the task has become computationally efficient and reliable. The data acquired from road mounted surveillance cameras can be used to train models which can detect and track on road vehicles for smart traffic analysis and handling problems such as traffic congestion particularly in harsh weather conditions where there are poor visibility issues because of low illumination and blurring. Different vehicle detection algorithms focusing the same issue deal only with on or two specific conditions. In this research, we address detecting vehicles in a scene in multiple weather scenarios including haze, dust and sandstorms, snowy and rainy weather both in day and nighttime. The proposed architecture uses CSPDarknet53 as baseline architecture modified with spatial pyramid pooling (SPP-NET) layer and reduced Batch Normalization layers. We also augment the DAWN Dataset with different techniques including Hue, Saturation, Exposure, Brightness, Darkness, Blur and Noise. This not only increases the size of the dataset but also make the detection more challenging. The model obtained mean average precision of 81% during training and detected smallest vehicle present in the image [ABSTRACT FROM AUTHOR]

In the domain of complex urban traffic networks, real-time Traffic Signal Control (TSC) serves as a pivotal strategy for mitigating congestion. Coordinating signal control across multiple intersections involves considerable complexity. Deep Reinforcement Learning (DRL) has emerged as a robust solution. In recent years, there has been rapid advancement in TSC methods, with numerous researchers employing various novel DRL methodologies. Yet, existing surveys lack timeliness and universality in capturing the latest research. There is a notable gap in current research surveys with respect to the latest developments in TSC. Therefore, the focus of this paper lies in analyzing the most recent papers from the past five years, with the aim to provide a comprehensive and multi-dimensional review of the evolution of DRL in TSC. The survey categorizes current research based on model setups, utilized algorithms, and application scenarios. Finally, this paper highlights potential directions for future TSC research. [ABSTRACT FROM AUTHOR]

Modeling and control of road traffic in large-scale urban networks present considerable challenges. The traffic equilibrium phenomena, with the question of route choice behavior in case of heterogeneous urban networks, has not been thoroughly investigated in parsimonious and classical models due to the limitation, like large network size, spatiotemporal propagation of congestion, and the interaction between driver decisions, etc. In this paper, we propose a bi-level approximating dynamic equilibrium model (BLADEM) for the approximating dynamic equilibrium analysis in multi-region network based on macroscopic fundamental diagram (MFD). The proposed model combines the region-based model and the internal-region model. With the information from region MFD, the region-based model is used to implement the time-dependent regional route choice estimation. Traffic equilibrium condition (dynamic user equilibrium, DUE) is considered in an internal-region model with time-aggregated regional OD demand from the region level. Furthermore, the complexity of the proposed model is derived. Then, the comparative analysis of the algorithm complexity between the proposed model and the DUE model is given. The proposed model is evaluated based on the high-resolution vehicle trajectory data (or connected vehicles trajectory data) from the DiDi platform collected in Chengdu, China with more than 3,000,000 GPS points during a typical workday. The evaluation results show that the proposed model can obtain the approximating traffic dynamics compared with the DUE algorithm. Pleasantly, the improved calculation efficiency is between 21% and 42%. The results indicate the promising potential of using the proposed model to analyze approximating dynamic equilibrium in the multi-region heterogeneous network. [ABSTRACT FROM AUTHOR]

The problem of traffic congestion caused by the fast-growing travel demands has been getting serious in urban areas. Meanwhile, the future of urban mobility has been foreseen as being electric, shared, and autonomous. Accordingly, the routing and charging strategies for fleets of shared autonomous electric vehicles (SAEVs) need to be carefully addressed to cope with the characteristics of the rideshare service operation of the SAEV fleets. In the literature, much work has been done to develop various traffic control strategies for alleviating the problem in urban traffic congestion. However, little research has proposed effective solutions that integrate the route of charging strategies for SAEV fleets with the urban traffic congestion problem. In this regard, this work presents an integrated framework that tackles the route and charging of SAEV fleets as well as the urban traffic congestion prevention issues. Notably, our contribution in this work not only proposes a joint solution for the problems of the urban traffic congestion control and rideshare dispatch of SAEV fleets, but also fills the gap of the routing and charging strategies for mixed privately owned EVs (PEV) and SAEV fleets in the literature. A general optimization framework is formulated, and effective heuristics are proposed to tackle the above-mentioned problems in this work. The feasibility and effectiveness of the proposed algorithms were evaluated through four different scenarios in the simulation. After applying the proposed algorithms, the traffic volumes of the oversaturated main arterial road were diverted to other less busy road sections, and the traveling times of EV passengers were decreased by 28% during peak periods. The simulation results reveal that the proposed algorithms not only provide a practical solution to prevent the problem in urban traffic congestion during rush hours, but also shorten the travel times of EV passengers effectively. [ABSTRACT FROM AUTHOR]

If we consider road traffic in urban areas, one of its major problems encountered nowadays is that of traffic congestion. The paper aims to provide an improvement, in terms of reducing traffic congestion, by analyzing different traffic light cycles. A traffic light cycle is determined by the red and green duration of the traffic lights. Traditionally these two have a fixed duration and controlling road traffic can be achieved by modifying it, resulting in a congestion reduction. We present a comparison between the fixed and an improved fixed situation, as well as a QL algorithm to further reduce the congestion at an intersection. Urban traffic can thus be optimized, in terms of reducing congestion, on an existing traffic light system. A study case validates the results, based on road traffic data obtained from the city of Bucharest. [ABSTRACT FROM AUTHOR]