Search

Nowadays, traffic congestion poses a significant problem in urban areas, affecting daily life. The imbalance between supply and demand causes overloading. Intersections are critical nodes in urban transport networks, and their design has a substantial impact on traffic safety and efficiency. Microscopic traffic flow models, which describe vehicle maneuvers and traffic patterns, are widely used for optimal design and performance evaluation of transportation facilities. This article focuses on traffic modeling at intersections using the Aimsun software. The examined intersections are located in Topoľčany, Slovakia, where a 13-h traffic survey was conducted on Tovarnická Street. In addition to the current situation, simulations were performed for scenarios distributing 10% and 20% of peak traffic intensity over longer periods, with overall quality levels determined. This article highlights the importance of researching intersection throughput and the need for capacity assessment in planning any construction that affects traffic in the area. [ABSTRACT FROM AUTHOR]

Traffic lights are the most commonly used tool to manage urban traffic to reduce congestion and accidents. However, the poor management of traffic lights can result in further problems. Consequently, many studies on traffic light control have been conducted using deep reinforcement learning in the past few years. In this study, we propose a traffic light control method in which a Deep Q-network with fuzzy logic is used to reduce waiting time while enhancing the efficiency of the method. Nevertheless, existing studies using the Deep Q-network may yield suboptimal results because of the reward function, leading to the system favoring straight vehicles, which results in left-turning vehicles waiting too long. Therefore, we modified the reward function to consider the waiting time in each lane. For the experiment, Simulation of Urban Mobility (SUMO) software version 1.18.0 was used for various environments and vehicle types. The results show that, when using the proposed method in a prototype environment, the average total waiting time could be reduced by 18.46% compared with the traffic light control method using a conventional Deep Q-network with fuzzy logic. Additionally, an ambulance prioritization system was implemented that significantly reduced the ambulance waiting time. In summary, the proposed method yielded better results in all environments. [ABSTRACT FROM AUTHOR]

To improve the effectiveness of model predictive control (MPC) in dynamic traffic signal control strategies, it has been combined with graph convolutional networks (GCNs) and deep reinforcement learning (DRL) technologies. In this study, a neural-network-based traffic signal control optimization method under the MPC framework is proposed. A dynamic correlation matrix is introduced in the predictive model to adapt to the dynamic changes in correlations between nodes over time. The signal control optimization strategy is solved using DRL, where the agent explores the optimal control strategy based on pre-set constraints in the future road environment. The geometric structure and traffic flow data of a real intersection were selected as the simulation validation environment, and a joint simulation was conducted using Python and SUMO. The experimental results indicate that in low-traffic scenarios, the queue length is reduced by more than 2 vehicles compared to the selected comparison methods; in high-traffic scenarios, the queue length is reduced by an average of 17 vehicles. Under the actual traffic data of the intersection, the average speed is increased by 6.4% compared to the fixed timing method; compared to the inductive signal control method, it increases from 9.76 m/s to 11.69 m/s, an improvement of 19.7%, effectively enhancing the intersection signal control performance. [ABSTRACT FROM AUTHOR]

This paper proposes a convolutional neural network (CNN) model of the signal distribution control algorithm (SDCA) to maximize the dynamic vehicular traffic signal flow for each junction phase. The aim of the proposed algorithm is to determine the reward value and new state. It deconstructs the routing components of the current multi-directional queuing system (MDQS) architecture to identify optimal policies for every traffic scenario. Initially, the state value is divided into a function value and a parameter value. Combining these two scenarios updates the resulting optimized state value. Ultimately, an analogous criterion is developed for the current dataset. Next, the error or loss value for the present scenario is computed. Furthermore, utilizing the Deep Q-learning methodology with a quad agent enhances previous study discoveries. The recommended method outperforms all other traditional approaches in effectively optimizing traffic signal timing. [ABSTRACT FROM AUTHOR]

In recent years, the increasing production and sales of automobiles have led to a notable rise in congestion on urban road traffic systems, particularly at ramps and intersections with traffic signals. Intelligent traffic signal control represents an effective means of addressing traffic congestion. Reinforcement learning methods have demonstrated considerable potential for addressing complex traffic signal control problems with multidimensional states and actions. In this research, the team propose Q-learning and Deep Q-Network (DQN) based signal control frameworks that use variable phase sequences and cycle times to adjust the order and the duration of signal phases to obtain a stable traffic signal control strategy. Experiments are simulated using the traffic simulator Simulation of Urban Mobility (SUMO) to test the average speed and the lane occupancy rate of vehicles entering the ramp to evaluate its safety performance and test the vehicle's traveling time to assess its stability. The simulation results show that both reinforcement learning algorithms are able to control cars in dynamic traffic environments with higher average speed and lower lane occupancy rate than the no-control method and that the DQN control model improves the average speed by about 10% and reduces the lane occupancy rate by about 30% compared to the Q-learning control model, providing a higher safety performance. [ABSTRACT FROM AUTHOR]

This paper introduces an approach to enhance the efficiency of urban intersections by integrating Visible Light Communication (VLC) into a multi-intersection traffic control system. The main objectives include the reduction in waiting times for vehicles and pedestrians, the improvement of overall traffic safety, and the accommodation of diverse traffic movements during multiple signal phases. The proposed system utilizes VLC to facilitate communication among interconnected vehicles and infrastructure. This is achieved by utilizing streetlights, headlamps, and traffic signals for transmitting information. By integrating VLC localization services with learning-driven traffic signal control, the multi-intersection traffic management system is established. A reinforcement learning scheme, based on VLC queuing/request/response behaviors, is utilized to schedule traffic signals effectively. Agents placed at each intersection control traffic lights by incorporating information from VLC-ready cars, including their positions, destinations, and intended routes. The agents devise optimal strategies to improve traffic flow and engage in communication to optimize the collective traffic performance. An assessment of the multi-intersection scenario through the SUMO urban mobility simulator reveals considerable benefits. The system successfully reduces both waiting and travel times. The reinforcement learning approach effectively schedules traffic signals, and the results highlight the decentralized and scalable nature of the proposed method, especially in multi-intersection scenarios. The discussion emphasizes the possibility of applying reinforcement learning in everyday traffic scenarios, showcasing the potential for the dynamic identification of control actions and improved traffic management. [ABSTRACT FROM AUTHOR]

Multi-Agent Reinforcement Learning (MARL) has shown strong advantages in urban multi-intersection traffic signal control, but it also suffers from the problems of non-smooth environment and inter-agent coordination. However, most of the existing research on MARL traffic signal control has focused on designing efficient communication to solve the environment non-smoothness problem, while neglecting the coordination between agents. In order to coordinate among agents, this paper combines MARL and the regional mixed-strategy Nash equilibrium to construct a Deep Convolutional Nash Policy Gradient Traffic Signal Control (DCNPG-TSC) model, which enables agents to perceive the traffic environment in a wider range and achieves effective agent communication and collaboration. Additionally, a Multi-Agent Distributional Nash Policy Gradient (MADNPG) algorithm is proposed in this model, which is the first time the mixed-strategy Nash equilibrium is used for the improvement in the Multi-Agent Deep Deterministic Policy Gradient algorithm traffic signal control strategy to provide the optimal signal phase for each intersection. In addition, the eco-mobility concept is integrated into MARL traffic signal control to reduce pollutant emissions at intersections. Finally, simulation results in synthetic and real-world traffic road networks show that DCNPG-TSC outperforms other state-of-the-art MARL traffic signal control methods in almost all performance metrics, because it can aggregate the information of neighboring agents and optimize the agent's decisions through gaming to find an optimal joint equilibrium strategy for the traffic road network. [ABSTRACT FROM AUTHOR]

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system. [ABSTRACT FROM AUTHOR]

The continuous evolution of artificial intelligence and cyber–physical systems has presented promising opportunities for optimizing traffic signal control in densely populated urban areas, with the aim of alleviating traffic congestion. One area that has garnered significant interest from both researchers and practitioners is the application of deep reinforcement learning (DRL) in traffic signal control. However, DRL-based algorithms often suffer from instability due to the dynamic nature of traffic flows. Discrepancies between the environments used for training and those encountered during deployment often lead to operational failures. Moreover, conventional DRL-based traffic signal control algorithms tend to reveal vulnerabilities when faced with unforeseen events, such as sensor failure. These challenges highlight the need for innovative solutions to enhance the robustness and adaptability of such systems. To address these pertinent issues, this paper introduces StageLight, a novel two-stage multiscale learning approach, which involves learning optimal timings on a coarse time scale in stage 1, while finetuning them on a finer time scale in stage 2. Our experimental results demonstrate StageLight's remarkable capability to generalize across diverse traffic conditions and its robustness to various sensor-failure scenarios. [ABSTRACT FROM AUTHOR]

With the increasing number of urban vehicles, as well as the current situation of non-intelligent traffic control systems, spatiotemporal non-uniform traffic resource occupation, and limited traffic planning and design, existing urban traffic planning methods cannot effectively solve problems such as frequent traffic congestion and uncontrollable commuting time for residents. In order to solve the above problems, this paper first constructs a multi-queue, multi-server queuing model based on the server vacation and a multi-hop cascaded queuing model from the perspective of local intersections and global commuting paths. We analyze the theoretical changes in passage delay costs at local intersections and on global commuting paths as a function of traffic flow and the random duration of traffic signals. On this basis, this article proposes a collaborative intelligent traffic planning algorithm based on artificial intelligence, which utilizes traffic sensors to dynamically perceive traffic congestion status and collaboratively plans the optimal duration of traffic signals and the optimal driving path of vehicles from both local and global perspectives, thereby maximizing the on-time arrival ratio of vehicles while ensuring the required commuting delay. The simulation results show that the proposed method can increase the on-time arrival ratio of vehicles by at least 20% compared to contrast methods while meeting the requirements relating to commuting delays. This verifies that our method can provide support for the improvement in efficiency in future Internet of vehicles. [ABSTRACT FROM AUTHOR]

The phenomenon of traffic congestion started in the second half of the twentieth century. This arose because of our society's constant increase in demand for mobility. The excessive traffic of vehicles attempting to use the same infrastructure at the same time is what causes congestion. The consequences are well-known: delays, air pollution, reduced speed, and dissatisfaction (which may lead to risky maneuvers, reducing pedestrian and other driver safety). Our objective is to simulate the change in traffic patterns brought about by app users in residential areas (using navigational tools like Google Maps and Apple Maps), where the majority of navigational tools provide shortcuts that go through residential areas. In addition to discouraging navigation apps from directing drivers through residential areas during peak hours to mitigate pollution levels, by developing an algorithm based on the technology of Green Light Optimized Speed Advisory (GLOSA) and implementing it in a simulated environment (VISSIM), we can see the effect of changing the duration of red lights while keeping green lights constant. Overall, this solution can be implemented to change the times of traffic lights without the need for supplies, additional equipment, or warning signs because most cities' traffic lights are already remotely controlled. In addition, this procedure is temporary to provide some freedom and does not adhere to the speed specified for drivers who wish to pass through residential areas outside of rush hour. [ABSTRACT FROM AUTHOR]

This paper uses colored Petri nets (PN) to develop a model of vehicle movement in a city. The modeler defines the number and location of crossroads, the connections between them, and how many vehicles are at the given points of the network. The vehicles are recognized by their license plate numbers, and it is possible to determine where they start their journey and where they are going. The algorithm proposed in this paper suggests the shortest vehicle route based on Dijkstra's algorithm. This study focuses on improving route planning by considering road usage, which is determined by the starting and ending locations of vehicles (as if traffic cameras were identifying license plates). This approach will lead to optimal control of traffic lights (or vehicle navigation) to minimize traffic jams and make good use of all roads. Additionally, this paper shares the results of preliminary simulations using both colored and uncolored Petri nets in the GPenSIM environment. [ABSTRACT FROM AUTHOR]

This paper introduces a novel approach, Visible Light Communication (VLC), to optimize urban intersections by integrating VLC localization services with learning-based traffic signal control. The system enhances communication between connected vehicles and infrastructure using headlights, streetlights, and traffic signals to transmit information. Through Vehicle-to-Vehicle (V2V) and Infrastructure-to-Vehicle (I2V) interactions, joint data transmission and collection occur via mobile optical receivers. The goal is to reduce waiting times for pedestrians and vehicles, enhancing overall traffic safety by employing flexible and adaptive measures accommodating diverse traffic movements. VLC cooperative mechanisms, transmission range, relative pose concepts, and queue/request/response interactions help balance traffic flow and improve road network performance. Evaluation in the SUMO urban mobility simulator demonstrates advantages, reducing waiting and travel times for both vehicles and pedestrians. The system employs a reinforcement learning scheme for effective traffic signal scheduling, utilizing VLC-ready vehicles to communicate positions, destinations, and routes. Agents at intersections calculate optimal strategies, communicating to optimize overall traffic flow. The proposed decentralized and scalable approach, especially suitable for multi-intersection scenarios, showcases the feasibility of applying reinforcement learning in real-world traffic scenarios. [ABSTRACT FROM AUTHOR]

Developing appropriate signal timing strategies is a primary concern in traffic signal control; however, professionals are constrained by predefined controller options. Existing signal controllers in North America adhere to National Electrical Manufacturers Association (NEMA) standards with ring-barrier control (RBC) design. Due to unique traffic conditions and objectives for each traffic mode, conflicts arise, making it challenging to devise suitable traffic control strategies within current controllers. The limitations include inflexibility in defining pretimed signal diagrams, modifying them, and defining algorithms for modification. This paper introduces the event-based controller (EBC) framework, implemented in DUMKA_E software, capable of replicating NEMA-based RBC functionalities while providing additional flexibility beyond conventional RBC controllers. The EBC eliminates the asymmetry of flexibilities in existing traffic controller frameworks, addressing the challenges mentioned. Overcoming critical limitations of RBC, such as barrier constraints and restricted functionalities to built-in algorithms, the EBC empowers professionals to craft custom traffic signal control strategies. Unlike approaches enhancing RBC with complex computation, the EBC offers flexible functionalities without sacrificing simplicity. The study shows that the EBC's fundamental concepts are no more intricate than RBC's, positioning the EBC as a potential traffic controller framework. The paper establishes the EBC's capability to reproduce RBC controllers' core logic, showcasing advanced abilities for more efficient control logic than RBC. The EBC's functionalities enable context-sensitive traffic signal control strategies, catering to special conditions like multi-modal activities and diverse priority requests, highlighting its full potential. [ABSTRACT FROM AUTHOR]

Traffic signal priority issues have been a research subject for several decades in Poland and worldwide. Traffic control algorithms have evolved considerably during this period and have become increasingly advanced. Most of them operate within coordinated street sequences, which adds to their complexity. Tramway priority affects traffic conditions for other road users, so many aspects must be taken into account when choosing a priority solution. Typically, one of the main criteria for evaluating the effectiveness of priority is reducing travel time for the priority vehicle while ensuring that the travel times of other traffic participants through the intersection are maintained or slightly deteriorated. However, the energy aspects are often overlooked. This publication aims to investigate how local priority for tramways in traffic signals of coordinated streets affects energy consumption for tramway traction needs. The study was conducted using a microscopic modeling method with PTV Vissim software (ver. 2021). The models were built for coordinated sequences with different levels of priority. Real traffic control algorithms with priority were implemented into the model on the sequence of Marymoncka Street and Grochowska Street in Warsaw. Then, by introducing changes to the parameters of the algorithms, their effect on traffic characteristics, including estimated power consumption, was studied. The results obtained from the computer simulation were statistically processed using R software (ver. 4.3.2). The analysis results prove the effectiveness of tramway priority operation, show its impact on electricity consumption, and allow us to determine the limits of its effective application. Thus, they complement the knowledge of the impact of tramway priority on traffic. The research results also have practical value, as they help us to make rational decisions in the process of designing traffic control algorithms at intersections with a multi-criteria approach. [ABSTRACT FROM AUTHOR]

The optimization and control of traffic signals is very important for logistics transportation. It not only improves the operational efficiency and safety of road traffic, but also conforms to the direction of the intelligent, green, and sustainable development of modern cities. In order to improve the optimization effect of traffic signal control, this paper proposes a traffic signal optimization method based on deep reinforcement learning and Simulation of Urban Mobility (SUMO) software for urban traffic scenarios. The intersection training scenario was established using SUMO micro traffic simulation software, and the maximum vehicle queue length and vehicle queue time were selected as performance evaluation indicators. In order to be more relevant to the real environment, the experiment uses Weibull distribution to simulate vehicle generation. Since deep reinforcement learning takes into account both perceptual and decision-making capabilities, this study proposes a traffic signal optimization control model based on the deep reinforcement learning Deep Q Network (DQN) algorithm by considering the realism and complexity of traffic intersections, and first uses the DQN algorithm to train the model in a training scenario. After that, the G-DQN (Grouping-DQN) algorithm is proposed to address the problems that the definition of states in existing studies cannot accurately represent the traffic states and the slow convergence of neural networks. Finally, the performance of the G-DQN algorithm model was compared with the original DQN algorithm model and Advantage Actor-Critic (A2C) algorithm model. The experimental results show that the improved algorithm increased the main indicators in all aspects. [ABSTRACT FROM AUTHOR]

One of the world's challenges is the amount of traffic on the roads. Waiting for the green light is a major cause of traffic congestion. Low throughput rates and eventual congestion come from many traffic signals that are hard coded, irrespective of the volume of the amount of traffic. Instead of depending on predefined time intervals, it is essential to build a traffic signal control system that can react to changing vehicle densities. Emergency vehicles, like ambulances, must be given priority at the intersection so as not to spend more time at the traffic light. Computer vision techniques can be used to improve road traffic signal control and reduce real-time traffic delays at intersections without the requirement for substantial infrastructure analysis. Long wait times and significant energy consumption are just two of the problems of the current traffic signal control system. To optimal efficiency, the traffic signal's duration must be dynamically changed to account for current traffic volume. To lessen congestion, the approach taken in this research focuses on modifying traffic signal time determined by the density of vehicles at the crossroads. The main purpose of this article is to demonstrate heavy traffic and emergency vehicle prioritization from all directions at the traffic intersection for a speedy passage. Using the Pygame tool, the proposed method in this study, which includes a mechanism for estimating traffic density and prioritization by counting vehicles at a traffic junction, is demonstrated. The vehicle throughput for the adaptive traffic light built using Pygame is compared with the vehicle pass rate for the adaptive traffic light built using Simulation of Urban Mobility (SUMO). The simulation results show that the adaptive traffic light built using Pygame achieves 90% throughput compared to the adaptive traffic light built using SUMO. A Two-Dimensional Convolutional Neural Network (2D-CNN) is implemented using Tensorflow for vehicle classification. The 2D-CNN model demonstrated 96% accuracy in classifying vehicles using the test dataset. Additionally, emergency vehicles, such as ambulances, are given priority for quick passing. [ABSTRACT FROM AUTHOR]

Automated traffic signal performance measures (ATSPMs) have garnered significant attention for their ability to collect and evaluate real-time and historical data at signalized intersections. ATSPM data are widely utilized by traffic engineers, planners, and researchers in various application scenarios. In working with ATSPM data in Utah, it was discovered that five types of ATSPM data anomalies (data switching, data shifting, data missing under 6 months, data missing over 6 months, and irregular curves) were present in the data. To address the data issues, this paper presents a method that enables transportation agencies to automatically detect data anomalies in their ATSPM datasets. The proposed method utilizes the moving average and standard deviation of a moving window to calculate the z-score for traffic volume data points at each timestamp. Anomalies are flagged when the z-score exceeds 2, which is based on the data falling within two standard deviations of the mean. The results demonstrate that this method effectively identifies anomalies within ATSPM systems, thereby enhancing the usability of data for engineers, planners, and all ATSPM users. By employing this method, transportation agencies can improve the efficiency of their ATSPM systems, leading to more accurate and reliable data for analysis. [ABSTRACT FROM AUTHOR]

Reinforcement learning is an effective method for adaptive traffic signal control in urban transportation networks. As the number of training rounds increases, the optimal control strategy is learned, and the learning capabilities of deep neural networks are further enhanced, thereby avoiding the limitations of traditional signal control methods. However, when faced with the sequential decision tasks of regional signal control, it encounters issues such as the curse of dimensionality and environmental non-stationarity. To address the limitations of traditional reinforcement learning algorithms applied to multiple intersections, the mean field theory is applied. This models the traffic signal control problem at multiple intersections within a region as interactions between individual intersections and the average effects of neighboring intersections. By decomposing the Q-function through bilateral estimation between the agent and its neighbors, this method reduces the complexity of interactions between agents while preserving global interactions between the agents. A traffic signal control model based on Mean Field Multi-Agent Reinforcement Learning (MFMARL) was constructed, containing two algorithms: Mean Field Q-Network Area Traffic Signal Control (MFQ-ATSC) and Mean Field Actor-Critic Network Area Traffic Signal Control (MFAC-ATSC). The model was validated using the SUMO simulation platform. The experimental results indicate that across different metrics, such as average speed, the mean field reinforcement learning method outperforms classical signal control methods and several existing approaches. [ABSTRACT FROM AUTHOR]

A widely used technique for locating the position of a train during its journey involves electrical detection: on a section of track, the train closes ("shunts") a circuit dedicated to its location via its wheels and axles. The quality of the wheel–rail contact is therefore particularly important for signalling management and traffic control. In this paper, we show that the current flowing through the track circuit induces a permanent modification and a nonlinear, frequency-dependent behaviour of the electrical contact. We propose an analytical expression that describes the evolution of the measured voltage as a function of current and frequency for these nonlinear behaviours. This behavioural law was obtained using experimental measurements on a real train and could therefore be integrated into a global model describing the track system. [ABSTRACT FROM AUTHOR]

The paper presents a proposed queuing model based on Kendall's notation for the intersection of two streets in Panama City (53 East and 56 East). The proposed model is based on a set of traffic lights that controls the flow of vehicles at the intersection according to a predetermined schedule. The model analyzes the stability of the system and simulations are performed to evaluate its performance. The main objective of the paper is to optimize the vehicle flow by minimizing the waiting time for passage. In the study, it was observed that the current traffic light system on Calle 50 (50th Street) is unstable and oversaturated during weekdays, which generates large vehicle queues with no estimated exit times. It was proposed to increase the system capacity to 1300 vehicles per hour to achieve reasonable stability and provide a solution to improve traffic signal timing on 50th Street. The need to increase the system capacity has been demonstrated and an optimal value has been suggested. The evaluation of other models and the use of AI can further strengthen the system and improve the prediction accuracy in different traffic scenarios. [ABSTRACT FROM AUTHOR]

Platooning is generally known as a control method for driving a group of connected and automated vehicles in motorway context. Nevertheless, platoon control might also work on urban roads. One possible strategy to increase overall road traffic performance and to reduce congestion in urban traffic networks is to combine platooning with traffic signal control at intersections. The traffic flow can be maximized with coordinated scheduling of traffic signals together with platooning activities, resulting in decreased travel times and fuel consumption. This paper investigates several aspects of this combined control, such as the procedures for coordination and communication between platooning vehicles and traffic signals. Efficient algorithms are suggested to optimize platoon formation and dissolution at junctions and to change traffic signal phases depending on platoon arrival and departure times. The proposed solutions have been tested and verified with SUMO, a high-fidelity microscopic traffic simulator. [ABSTRACT FROM AUTHOR]

The real-time vehicular traffic system is an integral part of the urban vehicular traffic system, which provides effective traffic signal control for a large multifaceted traffic network and is a highly challenging distributed control problem. Coordinating vehicular traffic enables the network model to deliver an efficient service flow. Consider that there are four lanes of vehicular traffic in this situation, allowing parallel vehicle movements to occur without causing an accident. In this instance, the vehicular system's control parameters are time and vehicle volume. In this work, vehicular traffic flow is examined, and an algorithm to estimate vehicle waiting time in each direction is estimated. The effectiveness of the proposed vehicle traffic signal distribution control system by comparing the experimental results with a real-time vehicular traffic system is verified. This is also illustrated numerically. [ABSTRACT FROM AUTHOR]

The transportation control infrastructure serves as the foundation for regional traffic signal control. However, in practice, this infrastructure is often imperfect and complex, characterized by factors such as heterogeneity and uncertainty, which pose significant challenges to existing methods and systems. Therefore, this paper proposes a novel approach to coordinated traffic signal control that emphasizes flexibility. To achieve this flexibility, we combine the flexible model of complex networks with robust fuzzy control methods. This approach enables us to overcome the complexity of the transportation control infrastructure and ensure efficient management of traffic signals. Additionally, to ensure long-term operational ease, we develop a regional traffic signal control system using steam computing technology, which provides high scalability and compatibility. Finally, computational experiments are performed to validate adaptability and performance of our proposed approach. [ABSTRACT FROM AUTHOR]

We studied the ability of deep reinforcement learning and self-organizing approaches to adapt to dynamic complex systems, using the applied example of traffic signal control in a simulated urban environment. We highlight the general limitations of deep learning for control in complex systems, even when employing state-of-the-art meta-learning methods, and contrast it with self-organization-based methods. Accordingly, we argue that complex systems are a good and challenging study environment for developing and improving meta-learning approaches. At the same time, we point to the importance of baselines to which meta-learning methods can be compared and present a self-organizing analytic traffic signal control that outperforms state-of-the-art meta-learning in some scenarios. We also show that meta-learning methods outperform classical learning methods in our simulated environment (around 1.5–2× improvement, in most scenarios). Our conclusions are that, in order to develop effective meta-learning methods that are able to adapt to a variety of conditions, it is necessary to test them in demanding, complex settings (such as, for example, urban traffic control) and compare them against established methods. [ABSTRACT FROM AUTHOR]

Road intersections are shared among several conflicted traffic flows. Stop signs are used to control competing traffic flows at road intersections safely. Then, driving rules are constructed to control the competing traffic flows at these stop sign road intersections. Vehicles must apply a complete stop with no motion in front of stop signs. First to arrive, first to go, straight before turns, and right then left are the main driving rules at stop sign intersections. Drivers must be aware of the stop sign's existence, the architecture of the road intersection, and traffic distribution in the competing traffic flows. This is to make the best decision to pass the intersection or wait for other conflicted flows to pass according to the current situation. Due to bad weather conditions, obstacles, or existing heavy vehicles, drivers may miss capturing the stop sign. Moreover, the architecture of the road intersection and the characteristics of the competing traffic flows are not always clear to the drivers. In this work, we aim to keep the driver aware ahead of time of the existing stop signs, the architecture of the road intersection, and the traffic characteristics of the competing traffic flow at the targeted destination. Moreover, the best speed and driving behaviors are recommended to each driver. This is based on his/her position and the distribution of the existing traffic there. A driving assistance protocol is presented in this paper based on vehicular network technology. Real-time traffic characteristics are gathered and analyzed of vehicles around the intersections. Then, the best action for each vehicle is recommended accordingly. The experimental results show that the proposed driving assistant protocol successfully enhances the safety conditions around road intersections controlled by stop signs. This is by reducing the percentage of accident occurrences. Fortunately, the traffic efficiency of these road intersections is also enhanced; the accident percentage is decreased by 25% upon using the proposed protocol. [ABSTRACT FROM AUTHOR]

Railway traffic control (RTC) equipment are technical devices developed for maintaining the safety of rail vehicle traffic operation, and must satisfy certain requirements related to a specific level of traffic safety and effectiveness. They are designed to ensure operational reliability under the intended application conditions throughout their entire service life. Regardless of their type and kind, however, they must behave in accordance with the assumed functional rules and requirements. This is why periodic tests of their correct operation are so crucial. Functional tests are applied to this end. They are employed in the course of device design and approval for use as well as in equipment operational diagnostics. Previous methods for generating test sets and their processing have been intuitive and often rely on the experience of testers that have been acquired in the course of implementing other tests. Such tests may be incomplete or fail to take into account all studied functions. Therefore, this article presents a proprietary method for generating functional tests covering railway traffic control devices that improve their readiness. The authors describe a test determination procedure algorithm and specify the conditions to be met by a test set and by optimization criteria. The article ends with a computer-based exemplification of the developed functional test generation method. [ABSTRACT FROM AUTHOR]

In recent years, researchers have proposed smart traffic light control systems to improve traffic flow at intersections, but there is less focus on reducing vehicle and pedestrian delays simultaneously. This research proposes a cyber-physical system for smart traffic light control utilizing traffic detection cameras, machine learning algorithms, and a ladder logic program. The proposed method employs a dynamic traffic interval technique that categorizes traffic into low, medium, high, and very high volumes. It adjusts traffic light intervals based on real-time traffic data, including pedestrian and vehicle information. Machine learning algorithms, including convolutional neural network (CNN), artificial neural network (ANN), and support vector machine (SVM), are demonstrated to predict traffic conditions and traffic light timings. To validate the proposed method, the Simulation of Urban Mobility (SUMO) platform was used to simulate the real-world intersection working. The simulation result indicates the dynamic traffic interval technique is more efficient and showcases a 12% to 27% reduction in the waiting time of vehicles and a 9% to 23% reduction in the waiting time of pedestrians at an intersection when compared to the fixed time and semi-dynamic traffic light control methods. [ABSTRACT FROM AUTHOR]

Fast-changing demand in real traffic systems always leads to asymmetrical traffic flow and queues, which aggravates congestion and energy waste. In this paper, the traffic signal control problem of multi-phase intersections was studied with fast-changing traffic flows. First, a novel model-free adaptive control-based symmetrical queuing balancing method was designed by using the full-format dynamic linearization (FFDL) technique. Second, in order to deal with the fast-changing traffic flow, a radial basis function neural network (RBFNN) was added to adjust parameters in a two-layer structure. Moreover, a variable cycle tuning algorithm was introduced to further reduce the time loss. Using the simulation, the proposed algorithm was compared with three other control strategies under low and high traffic demand, respectively, and the results showed the capability of the proposed algorithm. [ABSTRACT FROM AUTHOR]

Traffic accidents are a leading cause of premature death for citizens, with millions of injuries and fatalities occurring annually. Due to the fact that a large proportion of accidents are caused by red light running, reduction of the frequency of red light running (RLR) has been extensively researched in recent years. However, most of the previous studies have focused on reducing RLR frequency through driver education or warning sign design, with little attention paid to the relationship between RLR behavior and traffic signal control. Considering RLR is significantly affected by the number of vehicles arriving during yellow, it is possible to identify RLR behaviors in advance by analyzing data on yellow-arriving vehicles. Meanwhile, based on the strong correlation between yellow arriving and RLR frequency, it is possible to reduce RLR by traffic signal control. In this paper, we propose a quantitative model of correlation between RLR frequency and yellow light arrival based on high-resolution traffic and signal event data from Twin Cities, Minnesota. On this basis, the Non-dominated Sorting Genetic Algorithm-II (NSGA-II) is implemented to find trade-offs between minimizing the RLR frequency and the traffic delay. A case study of a 6-intersection arterial road reveals that in unsaturation, saturation, and supersaturation flow, our approach can converge to a Pareto optimal front in 30–50 iterations, which shows that is possible to simultaneously reduce RLR frequency and enhance traffic efficiency safety, which is conducive to ensuring the life safety of traffic participants. [ABSTRACT FROM AUTHOR]

Optimizing traffic control systems at traffic intersections can reduce the network-wide fuel consumption, as well as emissions of conventional fuel-powered vehicles. While traffic signals have been controlled based on predetermined schedules, various adaptive signal control systems have recently been developed using advanced sensors such as cameras, radars, and LiDARs. Among these sensors, cameras can provide a cost-effective way to determine the number, location, type, and speed of the vehicles for better-informed decision-making at traffic intersections. In this research, a new approach for accurately determining vehicle locations near traffic intersections using a single camera is presented. For that purpose, a well-known object detection algorithm called YOLO is used to determine vehicle locations in video images captured by a traffic camera. YOLO draws a bounding box around each detected vehicle, and the vehicle location in the image coordinates is converted to the world coordinates using camera calibration data. During this process, a significant error between the center of a vehicle's bounding box and the real center of the vehicle in the world coordinates is generated due to the angled view of the vehicles by a camera installed on a traffic light pole. As a means of mitigating this vehicle localization error, two different types of regression models are trained and applied to the centers of the bounding boxes of the camera-detected vehicles. The accuracy of the proposed approach is validated using both static camera images and live-streamed traffic video. Based on the improved vehicle localization, it is expected that more accurate traffic signal control can be made to improve the overall network-wide energy efficiency and traffic flow at traffic intersections. [ABSTRACT FROM AUTHOR]

Mixed traffic flows are opening up new areas for research and are seen as key drivers in the field of data and services that will make roads safer and more environmentally friendly. Understanding the effects of Connected Vehicles (CVs) and Connected Autonomous Vehicles (CAVs), as one of the vehicle components of mixed traffic flows, will make it easier to avoid traffic congestion and contribute to the creation of innovative applications and solutions. It is notable that the literature related to the analysis of the impact of mixed traffic flows on traffic signal control in urban areas rarely considers mixed traffic flow containing CVs, CAVs, and Human Driven Vehicles (HDVs). Therefore, this paper provides an overview of the relevant research papers covering the topic of urban Traffic Signal Control (TSC) and mixed traffic flows. Best practices for intersection state estimation and TSC in the case of mixed traffic flows in an urban environment are summarized and possible approaches for utilizing CVs and CAVs as mobile sensors and actuators are discussed. [ABSTRACT FROM AUTHOR]

Cooperative control of vehicle trajectories and traffic signal phases is a promising approach to improving the efficiency and safety of transportation systems. This type of traffic flow control refers to the coordination and optimization of vehicle trajectories and traffic signal phases to reduce congestion, travel time, and fuel consumption. In this paper, we propose a cooperative control method that combines a model predictive control algorithm for adaptive traffic signal control and a trajectory construction algorithm. For traffic signal phase selection, the proposed modification of the adaptive traffic signal control algorithm combines the travel time obtained using either the vehicle trajectory or a deep neural network model and stop delays. The vehicle trajectory construction algorithm takes into account the predicted traffic signal phase to achieve cooperative control. To evaluate the method performance, numerical experiments have been conducted for three real-world scenarios in the SUMO simulation package. The experimental results show that the proposed cooperative control method can reduce the average fuel consumption by 1% to 4.2%, the average travel time by 1% to 5.3%, and the average stop delays to 27% for different simulation scenarios compared to the baseline methods. [ABSTRACT FROM AUTHOR]

In the modern world, the extremely rapid growth of traffic demand has become a major problem for urban traffic development. Continuous optimization of signal control systems is an important way to relieve traffic pressure in cities. In recent years, with the impressive development of deep reinforcement learning (DRL), some DRL approaches have started to be applied to traffic signal control. Unlike traditional signal control methods, agents trained using DRL approaches continuously receive feedback from the environment to continuously improve the policy. Since current research in the field is more focused on the performance of the agent, data efficiency during training is ignored to some extent. However, in traffic signal control tasks, the cost of trial and error is very expensive. In this paper, we propose a DRL approach based on a traffic inference model. The proposed traffic inference model is based on the future information given based on upstream intersections and data from the environment to continuously learn the changing patterns of the traffic environment in order to make inferences about changes in the traffic environment. In the proposed algorithm, the inference model interacts with the agent instead of the environment. Through comprehensive experiments based on realistic datasets, we demonstrate that our proposed algorithm is superior to other algorithms in terms of its data efficiency and stronger performance. [ABSTRACT FROM AUTHOR]

In this paper, we study the problem of traffic signal control in general intersections by applying a recent reinforcement learning technique. Nowadays, traffic congestion and road usage are increasing significantly as more and more vehicles enter the same infrastructures. New solutions are needed to minimize travel times or maximize the network capacity (throughput). Recent studies embrace machine learning approaches that have the power to aid and optimize the increasing demands. However, most reinforcement learning algorithms fail to be adaptive regarding goal functions. To this end, we provide a novel successor feature-based solution to control a single intersection to optimize the traffic flow, reduce the environmental impact, and promote sustainability. Our method allows for flexibility and adaptability to changing circumstances and goals. It supports changes in preferences during inference, so the behavior of the trained agent (traffic signal controller) can be changed rapidly during the inference time. By introducing the successor features to the domain, we define the basics of successor features, the base reward functions, and the goal preferences of the traffic signal control system. As our main direction, we tackle environmental impact reduction and support prioritized vehicles' commutes. We include an evaluation of how our method achieves a more effective operation considering the environmental impact and how adaptive it is compared to a general Deep-Q-Network solution. Aside from this, standard rule-based and adaptive signal-controlling technologies are compared to our method to show its advances. Furthermore, we perform an ablation analysis on the adaptivity of the agent and demonstrate a consistent level of performance under similar circumstances. [ABSTRACT FROM AUTHOR]

To meet the demand for cooperative signal control at oversaturated heterogeneous traffic flow intersections containing CAVs and HVs, cooperative control including dedicated CAV lanes has been explored to improve intersection safety capacity and reduce vehicle delays while avoiding uncertain HV driving behaviour. However, this approach does not fully exploit CAV network connectivity advantages and intersection spatial and temporal resources. Here, an oversaturated heterogeneous traffic flow signal control model based on a variable virtual waiting zone with a dedicated CAV lane is proposed. Within the model, CAVs going straight or left share a dedicated CAV lane, a CAV variable virtual waiting zone is within the intersection ahead of the dedicated CAV lane, and CAVs and HVs share the straight-through lane. The model framework has three layers. The upper layer optimizes the barrier time using a rolling time domain scheme. The middle layer optimizes the phase duration and variable virtual waiting zone switching time based on the fixed phase sequence, returning the vehicle delay to the upper optimization model. The lower layer performs CAV grouping and trajectory planning in the dedicated CAV lane based on signal timing and variable virtual waiting zone duration, returning the CAV delays to the middle level. [ABSTRACT FROM AUTHOR]

This paper has two main objectives. First, we modify the traffic flow model by introducing the uphill dispersion that derives from the fact that, in peak hours, drivers tend to travel from low to high density regions. This means that the proposed model recovers wrong-way travel and is free from advected discontinuity. Second, in order to describe the anomalous transport behavior, we fractalize the proposed model to include dynamics with the fractional in space. As a result of adopting the fractional Fick's law, several moving jam waves are presented which elucidate the non-homogeneity of driving styles. Then, the GFFD fractional derivative and the trail equation method are applied and for some special cases solutions are simulated which could help transportation engineers to understand traffic behavior and thus make appropriate decisions when constructing a traffic signals network. [ABSTRACT FROM AUTHOR]

The advent of connected vehicle (CV) technology offers new possibilities for a revolution in future transportation systems. With the availability of real-time traffic data from CVs, it is possible to more effectively optimize traffic signals to reduce congestion, increase fuel efficiency, and enhance road safety. The success of CV-based signal control depends on an accurate and computationally efficient model that accounts for the stochastic and nonlinear nature of the traffic flow. Without the necessity of prior knowledge of the traffic system's model architecture, reinforcement learning (RL) is a promising tool to acquire the control policy through observing the transition of the traffic states. In this paper, we propose a novel data-driven traffic signal control method that leverages the latest in deep learning and reinforcement learning techniques. By incorporating a compressed representation of the traffic states, the proposed method overcomes the limitations of the existing methods in defining the action space to include more practical and flexible signal phases. The simulation results demonstrate the convergence and robust performance of the proposed method against several existing benchmark methods in terms of average vehicle speeds, queue length, wait time, and traffic density. [ABSTRACT FROM AUTHOR]

Intersections are at the core of congestion in urban areas. After the end of the Second World War, the problem of intersection management has benefited from a growing body of advances to address the optimization of the traffic lights' phase splits, timing, and offset. These contributions have significantly improved traffic safety and efficiency in urban areas. However, with the growth of transportation demand and motorization, traffic lights show their limits. At the end of the 1990s, the perspective of autonomous and connected driving systems motivated researchers to introduce a paradigm shift for controlling intersections. This new paradigm is well known today as autonomous intersection management (AIM). It harnesses the self-organization ability of future vehicles to provide more accurate control approaches that use the smallest available time window to reach unprecedented traffic performances. This is achieved by optimizing two main points of the interaction of connected and autonomous vehicles at intersections: the motion control of vehicles and the schedule of their accesses. Considering the great potential of AIM and the complexity of the problem, the proposed approaches are very different, starting from various assumptions. With the increasing popularity of AIM, this paper provides readers with a comprehensive vision of noticeable advances toward enhancing traffic efficiency. It shows that it is possible to tailor vehicles' speed and schedule according to the traffic demand by using distributed particle swarm optimization. Moreover, it brings the most relevant contributions in the light of traffic engineering, where flow–speed diagrams are used to measure the impact of the proposed optimizations. Finally, this paper presents the current challenging issues to be addressed. [ABSTRACT FROM AUTHOR]

An optimization model for traffic light control in an urban network of intersections is derived. The model is based on store-and-forward analytic relations, which account for the length of the queue of waiting vehicles in front of the traffic light intersection. The model is complicated with probabilistic relations that formalize the requirements for maintaining short queues of vehicles. Probabilistic inequalities apply to each intersection of the city network. Approximations of probability inequalities are given in the article. Quadratic deterministic inequalities, which are part of the set of the traffic flow control optimization problem, are derived. Numerical simulations are performed, applying mean estimated data for real traffic in an urban area of Sofia. The model predictive approach is applied to traffic light optimization and control. Empirical results give advantages of the obtained model compared to the classical store-and-forward optimization model for the total number of vehicles waiting in the considered urban network. [ABSTRACT FROM AUTHOR]

The intersection traffic signal control is an essential means of urban traffic. To solve the problem of urban congestion, it is necessary to consider the optimal signal control strategy for intersections. Using the store-and-forward method of traffic control modeling, the in-queue vehicle number of the key signal phase as the payoff index, this paper designs an optimal intersection signal-timing strategy based on the game theory method. In this strategy, each key phase is regarded as a game player, and each player competes for the release time to maximize their own payoff and minimize the queue. To optimize the intersection efficiency, a game strategy is designed to achieve the Nash equilibrium state, which is the queueing equilibrium of each key phase. Finally, by VISSIM simulation, the total number of stops can be decreased by 5% to 10% compared with the MA-DD-DACC method. [ABSTRACT FROM AUTHOR]

In this paper, a new method is proposed to detect traffic regulations at intersections using GPS traces. The knowledge of traffic rules for regulated locations can help various location-based applications in the context of Smart Cities, such as the accurate estimation of travel time and fuel consumption from a starting point to a destination. Traffic regulations as map features, however, are surprisingly still largely absent from maps, although they do affect traffic flow which, in turn, affects vehicle idling time at intersections, fuel consumption, CO 2 emissions, and arrival time. In addition, mapping them using surveying equipment is costly and any update process has severe time constraints. This fact is precisely the motivation for this study. Therefore, its objective is to propose an automatic, fast, scalable, and inexpensive way to identify the type of intersection control (e.g., traffic lights, stop signs). A new method based on summarizing the collective behavior of vehicle crossing intersections is proposed. A modification of a well-known clustering algorithm is used to detect stopping and deceleration episodes. These episodes are then used to categorize vehicle crossing of intersections into four possible traffic categories (p1: free flow, p2: deceleration without stopping events, p3: only one stopping event, p4: more than one stopping event). The percentages of crossings of each class per intersection arm, together with other speed/stop/deceleration features, extracted from trajectories, are then used as features to classify the intersection arms according to their traffic control type (dynamic model). The classification results of the dynamic model are compared with those of the static model, where the classification features are extracted from OpenStreetMap. Finally, a hybrid model is also tested, where a combination of dynamic and static features is used, which outperforms the other two models. For each of the three models, two variants of the feature vector are tested: one where only features associated with a single intersection arm are used (one-arm model) and another where features also from neighboring intersection arms of the same intersection are used to classify an arm (all-arm model). The methodology was tested on three datasets and the results show that all-arm models perform better than single-arm models with an accuracy of 95% to 97%. [ABSTRACT FROM AUTHOR]

Reinforcement-learning (RL) algorithms have made great achievements in many scenarios. However, in large-scale traffic signal control (TSC) scenarios, RL still falls into local optima when controlling multiple signal lights. To solve this problem, we propose a novel goal-based multi-agent hierarchical model (GMHM). Specifically, we divide the traffic environment into several regions. The region contains a virtual manager and several workers who control the traffic lights. The manager assigns goals to each worker by observing the environment, and the worker makes decisions according to the environment state and the goal. For the worker, we adapted the goal-based multi-agent deep deterministic policy gradient (MADDPG) algorithm combined with hierarchical reinforcement learning. In this way, we simplify tasks and allow agents to cooperate more efficiently. We carried out experiments on both grid traffic scenarios and real-world scenarios in the SUMO simulator. The experimental results show the performance advantages of our algorithm compared with state-of-the-art algorithms. [ABSTRACT FROM AUTHOR]

Optimizing traffic signals to improve traffic progression relies on minimizing mobility performance measures (e.g., delays and stops). However, delay and stop minimizations do not necessarily lead to minimal sustainability measures (e.g., fuel consumption and emissions). For that reason, researchers have focused, for decades, on integrating traffic models, signal optimization models, and fuel consumption and emissions models to minimize sustainability metrics while keeping acceptable levels of mobility metrics. Therefore, this paper reviews, classifies, and analyzes studies found in the literature regarding optimizing sustainable traffic signals. This paper provides researchers with a good starting point to further develop solutions which can address sustainable traffic control. To achieve that, this study details the most notable sustainable signal timing optimization studies from six perspectives: traffic models, fuel consumption and emissions models, optimization methods, objective functions, operating conditions, and reported sustainability savings. Outcomes of this research show that the previous studies deployed many combinations of elements from the six-perspective mentioned above, leading to a wide range of fuel consumption and emissions savings. The study also concludes that the available fuel consumption and emissions models are relatively old. Hence, future research is needed to develop new fuel consumption and emissions models based on recently collected data. [ABSTRACT FROM AUTHOR]

Deep reinforcement learning provides a new approach to solving complex signal optimization problems at intersections. Earlier studies were limited to traditional traffic detection techniques, and the obtained traffic information was not accurate. With the advanced in technology, we can obtain highly accurate information on the traffic states by advanced detector technology. This provides an accurate source of data for deep reinforcement learning. There are many intersections in the urban network. To successfully apply deep reinforcement learning in a situation closer to reality, we need to consider the problem of extending the knowledge gained from the training to new scenarios. This study used advanced sensor technology as a data source to explore the variation pattern of state space under different traffic scenarios. It analyzes the relationship between the traffic demand and the actual traffic states. The model learned more from a more comprehensive state space of traffic. This model was successful applied to new traffic scenarios without additional training. Compared our proposed model with the popular SAC signal control model, the result shows that the average delay of the DQN model is 5.13 s and the SAC model is 6.52 s. Therefore, our model exhibits better control performance. [ABSTRACT FROM AUTHOR]

In this paper, we consider a simple road intersection with traffic light control and suggest a queueing model for the traffic flow in the intersection. The suggested model implements the well-known queue with state-dependent departure rates. Using this model, we define optimal state-dependent scheduling of the traffic lights in the intersection and consider its properties. Activity of the model is illustrated by numerical simulations. It is demonstrated that in practical conditions the suggested scheduling of the traffic lights allows the prevention of traffic jams in the intersection and resolves vehicles queues with reasonable waiting times in the crossing lanes. [ABSTRACT FROM AUTHOR]

Using deep reinforcement learning to solve traffic signal control problems is a research hotspot in the intelligent transportation field. Researchers have recently proposed various solutions based on deep reinforcement learning methods for intelligent transportation problems. However, most signal control optimization takes the maximization of traffic capacity as the optimization goal, ignoring the concerns of pedestrians at intersections. To address this issue, we propose a pedestrian-considered deep reinforcement learning traffic signal control method. The method combines a reinforcement learning network and traffic signal control strategy with traffic efficiency and safety aspects. At the same time, the waiting time of pedestrians and vehicles passing through the intersection is considered, and the Discrete Traffic State Encoding (DTSE) method is applied and improved to define the more comprehensive states and rewards. In the training of the neural network, the multi-process operation method is adopted, and multiple environments are run for training simultaneously to improve the model's training efficiency. Finally, extensive simulation experiments are conducted on actual intersection scenarios using the simulation software Simulation of Urban Mobility (SUMO). The results show that compared to Dueling DQN, the waiting time due to our method decreased by 58.76% and the number of people waiting decreased by 51.54%. The proposed method can reduce both the number of people waiting and the waiting time at intersections. [ABSTRACT FROM AUTHOR]

Adaptive traffic signal control (ATSC) is an effective method to reduce traffic congestion in modern urban areas. Many studies adopted various approaches to adjust traffic signal plans according to real-time traffic in response to demand fluctuations to improve urban network performance (e.g., minimise delay). Recently, learning-based methods such as reinforcement learning (RL) have achieved promising results in signal plan optimisation. However, adopting these self-learning techniques in future traffic environments in the presence of connected and automated vehicles (CAVs) remains largely an open challenge. This study develops a real-time RL-based adaptive traffic signal control that optimises a signal plan to minimise the total queue length while allowing the CAVs to adjust their speed based on a fixed timing strategy to decrease total stop delays. The highlight of this work is combining a speed guidance system with a reinforcement learning-based traffic signal control. Two different performance measures are implemented to minimise total queue length and total stop delays. Results indicate that the proposed method outperforms a fixed timing plan (with optimal speed advisory in a CAV environment) and traditional actuated control, in terms of average stop delay of vehicle and queue length, particularly under saturated and oversaturated conditions. [ABSTRACT FROM AUTHOR]

Traffic simulation is widely used for modeling, planning, and analyzing different strategies for traffic control and road development in a cost-efficient manner. In order to perform an intersection simulation, random vehicle trip data are typically applied to an intersection network, making them unrealistic. In this paper, we address this issue by presenting two different methods of incorporating actual turning movement count (TMC) data and comparing their similarity for intersection simulation and analysis. The TMC of three intersections in Las Vegas are estimated separately for one hour using a developed vision-based tracking system and they are incorporated into Simulation of Urban MObility (SUMO) for estimating traffic measurements and traffic signal design. t-tests with a 95% confidence interval on the simulation variables demonstrate the importance of using a route-based creation method which injects vehicles into a simulation environment based on the frame-level departure time. The intersection analyses and comparisons are performed based on estimated traffic measurements such as travel time, density, lane density, occupancy, and normalized waiting time. Since the critical edge of each intersection network is identified based on a higher normalized waiting time, new traffic signal designs are suggested based on the actual critical turning movements and improvements in vehicle travel time are achieved to better accommodate the actual traffic demand. [ABSTRACT FROM AUTHOR]

The intersection management system can increase traffic capacity, vehicle safety, and the smoothness of all vehicle movement. Platoons of connected vehicles (CVs) use communication technologies to share information with each other and with infrastructures. In this paper, we proposed a deep reinforcement learning (DRL) model that applies to vehicle platooning at an isolated signalized intersection with partial detection. Moreover, we identified hyperparameters and tested the system with different numbers of vehicles (1, 2, and 3) in the platoon. To compare the effectiveness of the proposed model, we implemented two benchmark options, actuated traffic signal control (ATSC) and max pressure (MP). The experimental results demonstrated that the DRL model has many outstanding advantages compared to other models. Through the learning process, the average waiting time of vehicles in the DRL method was improved by 20% and 28% compared with the ATSC and MP options. The results also suggested that the DRL model is effective when the CV penetration rate is over 20%. [ABSTRACT FROM AUTHOR]