Search

Machine learning (ML) methods, particularly Reinforcement Learning (RL), have gained widespread attention for optimizing traffic signal control in intelligent transportation systems. However, existing ML approaches often exhibit limitations in scalability and adaptability, particularly within large traffic networks. This paper introduces an innovative solution by integrating decentralized graph-based multi-agent reinforcement learning (DGMARL) with a Digital Twin to enhance traffic signal optimization, targeting the reduction of traffic congestion and network-wide fuel consumption associated with vehicle stops and stop delays. In this approach, DGMARL agents are employed to learn traffic state patterns and make informed decisions regarding traffic signal control. The integration with a Digital Twin module further facilitates this process by simulating and replicating the real-time asymmetric traffic behaviors of a complex traffic network. The evaluation of this proposed methodology utilized PTV-Vissim, a traffic simulation software, which also serves as the simulation engine for the Digital Twin. The study focused on the Martin Luther King (MLK) Smart Corridor in Chattanooga, Tennessee, USA, by considering symmetric and asymmetric road layouts and traffic conditions. Comparative analysis against an actuated signal control baseline approach revealed significant improvements. Experiment results demonstrate a remarkable 55.38% reduction in Eco_PI, a developed performance measure capturing the cumulative impact of stops and penalized stop delays on fuel consumption, over a 24 h scenario. In a PM-peak-hour scenario, the average reduction in Eco_PI reached 38.94%, indicating the substantial improvement achieved in optimizing traffic flow and reducing fuel consumption during high-demand periods. These findings underscore the effectiveness of the integrated DGMARL and Digital Twin approach in optimizing traffic signals, contributing to a more sustainable and efficient traffic management system. [ABSTRACT FROM AUTHOR]

Smart cities can effectively improve urban life quality. But, with the rise in population size, there is an increase in the use of vehicles for transportation. In smart city development, traffic control and route planning are the primary tasks to address the problem of travel time estimation. It has become complex due to concerns of wrapped spatio-temporal data on dynamic real-time traffic conditions. The existing methods failed to estimate travel time efficiently due to not considering the spatio-temporal features and lack of computing resources. There is a need for a system like intelligent transportation system to monitor and accurately predict traffic flow to avoid traffic congestion and reduce the impact on the ecological system. This paper developed a novel hybrid deep learning model to estimate optimized travel time and possible trajectories. In this work, U-Net used to reduce the number of feature points for each temporal data and GNN is used to build the graph with connectivity between vehicular nodes. This hybrid model helps us predict traffic flow and aims to estimate accurate travel time from one location (node) to another. The model's performance is evaluated on the standard benchmark datasets Q-Traffic, TaxiBJ, and Chengdu. The experimental results show that the proposed framework significantly improves performance in extracting travel patterns and provides an optimal route with an estimated travel time than existing methods with RMSE 4%, MAE 20.49%, and MAPE 18%. The proposed model has accurately predicted the estimation of travel time of the vehicle for the given urban traffic data. [ABSTRACT FROM AUTHOR]

Accurate crowd flow prediction is essential for traffic guidance and traffic control. However, the high nonlinearity, temporal complexity, and spatial complexity that crowd flow data have makes this problem challenging. This research proposes a dynamic graph convolutional network model (Res-DGCN) based on the residual network structure for crowd inflow and outflow prediction in urban areas. Firstly, as the attention layer, the spatio-temporal attention module (SA) is employed for capturing the spatial relationship between the target node and the multi-order adjacent nodes by processing the features of the human flow data. Secondly, a conditional convolution module (SCondConv) is used to enhance the model's capacity for learning about the shifting characteristics of crowd flow to obtain spatial dependence. Finally, we train the model with the Huber loss function to lower the model's sensitivity to outliers and achieve optimal convergence. In two public datasets, the mean absolute error (MAE) of the proposed model is improved by 5.2% and 9.4%, respectively, compared to the baseline models, and the root mean square error (RMSE) is improved by 4.8% and 8.8%, confirming the model's usefulness for crowd flow prediction tasks. [ABSTRACT FROM AUTHOR]

The key to intelligent traffic control and guidance lies in accurate prediction of traffic flow. Since traffic flow data is nonlinear, complex, and dynamic, in order to overcome these issues, graph neural network techniques are employed to address these challenges. For this reason, we propose a deep-learning architecture called AMGC-AT and apply it to a real passenger flow dataset of the Hangzhou metro for evaluation. Based on a priori knowledge, we set up multi-view graphs to express the static feature similarity of each station in the metro network, such as geographic location and zone function, which are then input to the multi-graph neural network with the goal of extracting and aggregating features in order to realize the complex spatial dependence of each station's passenger flow. Furthermore, based on periodic features of historical traffic flows, we categorize the flow data into three time patterns. Specifically, we propose two different self-attention mechanisms to fuse high-order spatiotemporal features of traffic flow. The final step is to integrate the two modules and obtain the output results using a gated convolution and a fully connected neural network. The experimental results show that the proposed model has better performance than eight other baseline models at 10 min, 15 min and 30 min time intervals. [ABSTRACT FROM AUTHOR]

Traffic volume data at fixed detectors are of great importance to track the time-varying states of urban traffic, and the volume of each turning movement (i.e., continuing straight, turning left, turning right) in an intersection plays a significant role in traffic control. It is a difficult issue to determine the complete road network volume due to the limited coverage of detector deployment. Existing traffic volume imputation methods seem to be hardly tractable to address this persistent missing data problem of fixed detectors because they mainly function by utilizing spatiotemporal patterns of historical data to address the problem of intermittent missing traffic data collected from probe vehicles. Considering the unattainable temporal information of the target movement, this paper aims to develop an end-to-end graph neural network-based imputation approach to impute traffic volume data with persistent missing patterns. We regard the road network as a directed graph with each turning movement as a node and employ a meta-learning-based graph attention mechanism with graph embedding in multiple spatial granularities to fully extract the relationship between the target node and its neighbours. In addition, a multitask learning mechanism is designed to improve the accuracy of the imputation results by setting auxiliary tasks according to the volume conservation constraints. The proposed approach has been validated with extensive simulation experiments and applied to field tests for Shenzhen and Shanghai, China, with considerable accuracy and reliability, satisfying the demand for traffic control. To the best of our knowledge, this is the first time that traffic volume has been imputed for persistent missing patterns with a graph neural network-based method. [ABSTRACT FROM AUTHOR]

The emergence of connected and autonomous vehicles (CAVs) holds promise for fine-grained traffic control. However, due to the longevity of future mixed traffic scenarios, there is a need for an in-depth exploration of integrating the microscopic speed control of CAVs with the macroscopic variable speed limit (VSL) of human-driven vehicles (HDVs). This paper proposes a Cooperative Traffic Optimization with Multi-agent Reinforcement Learning and Evolutionary VSL (CTO-ME) framework, which combines microscopic CAV control with macroscopic VSL control. The framework incorporates a Graph Attention Mechanism (GATs) into the multi-agent reinforcement learning framework for intelligent decision-making by microscopic-level vehicles. Additionally, an evolutionary strategy is developed to design the VSL network architecture, enabling macroscopic level real-time speed limit adjustments based on infrastructure. A multi-objective reward function is proposed to optimize both micro and macro efficiency and safety, accounting for both vehicle behavior and traffic flow. Experiments on the designed Bottleneck traffic scenarios show that the proposed approach, CTO-ME, is able to achieve superior performance and outperforms other baselines in terms of traffic throughput, average speed, and safety. Specifically, CTO-ME enhances average velocity by 37%, increases overall throughput by 309%, and raises arrival ratio by 70% than traditional Intelligent Driver Model (IDM). • Macro–Micro Control Integration: We tackled the challenge of harmonizing macroscopic (Variable Speed Limit - VSL) and microscopic (Connected and Automated Vehicles - CAVs) controls to enhance both granular and overarching traffic efficiency. Our proposed method, the Cooperative Traffic Optimization with Multi-agent Reinforcement Learning and Evolutionary VSL (CTO-ME), cooperates with these control methods, paving the way for synchronized and efficient traffic management. • We integrated the Graph Attention Mechanism (GATs) into the multi-agent reinforcement learning framework to amplify the decision-making capabilities of vehicles and developed an advanced evolutionary strategy for VSL control to facilitate real-time speed limit adjustments. • We proposed a multi-objective reward function, considering both micro and macro efficiency and safety considerations, to promote optimized traffic flow and enhance overall control performance. [ABSTRACT FROM AUTHOR]

The development of intelligent traffic light control systems is essential for smart transportation management. While some efforts have been made to optimize the use of individual traffic lights in an isolated way, related studies have largely ignored the fact that the use of multi-intersection traffic lights is spatially influenced, as well as the temporal dependency of historical traffic status for current traffic light control. To that end, in this article, we propose a novel Spatio-Temporal Multi-Agent Reinforcement Learning (STMARL) framework for effectively capturing the spatio-temporal dependency of multiple related traffic lights and control these traffic lights in a coordinating way. Specifically, we first construct the traffic light adjacency graph based on the spatial structure among traffic lights. Then, historical traffic records will be integrated with current traffic status via Recurrent Neural Network structure. Moreover, based on the temporally-dependent traffic information, we design a Graph Neural Network based model to represent relationships among multiple traffic lights, and the decision for each traffic light will be made in a distributed way by the deep Q-learning method. Finally, the experimental results on both synthetic and real-world data have demonstrated the effectiveness of our STMARL framework, which also provides an insightful understanding of the influence mechanism among multi-intersection traffic lights. [ABSTRACT FROM AUTHOR]

Intelligent Transportation Systems (ITS) face the formidable challenge of large-scale missing data, particularly in the imputation of traffic data. Existing studies have mainly relied on modeling network-level spatiotemporal correlations to address this issue. However, these methods often overlook the rich semantic information (e.g., road infrastructure, sensor location, etc.) inherent in road networks when capturing network-wide spatiotemporal correlations. We address this limitation by presenting the Graph Transformer-based Traffic Data Imputation (GT-TDI) model, which imputes missing values in extensive traffic data by leveraging spatiotemporal semantic understanding of road networks. The proposed model leverages semantic descriptions that capture the spatial and temporal dynamics of traffic across road networks, enhancing its capacity to infer comprehensive spatiotemporal relationships. Moreover, to augment the model's capabilities, we employ a Large Language Model (LLM) and prompt engineering to enable natural and intuitive interactions with the traffic data imputation system, allowing users to query and request in plain language, without requiring expert knowledge or complex mathematical models. The proposed model, GT-TDI, utilizes Graph Neural Networks (GNN) and Transformer architectures to perform large-scale traffic data imputation using deficient observations, sensor social connectivity, and semantic descriptions as inputs. We evaluate the GT-TDI model on the PeMS freeway dataset and benchmark it against cutting-edge models. The experimental evidence demonstrates that GT-TDI surpasses the cutting-edge approaches in scenarios with intricate patterns and varying rates of missing data. • A novel semantic description for traffic data imputation that captures spatiotemporal correlations flexibly. • A pioneering application of prompt engineering to ITS that bridges the gap between LLMs and ITS. • The proposed model leverages LLMs and semantic prompts for traffic data imputation. • Extensive experiments on real-world traffic data show the superiority. • A potential framework for integrating LLMs and semantic prompts into other ITS tasks. [ABSTRACT FROM AUTHOR]

• This study identifies the restricted exploration problem encountered when training a signal control model which causes a model to obtain a partially-trained policy. • The goal of this research is to obtain a transferable policy that enhances the model's applicability on traffic states of unexperienced demand pattern using already-experienced information. • The key idea consists of two parts; 1) to represent the traffic state as graph-structured data by embedding it into a graph, 2) to process the information-condensed graph by employing message-passing graph neural network (GNN). • The experiment conducted on five unexperienced test demand scenarios which have different levels of traffic volumes and traveling patterns shows that the proposed GNN-based model obtains a transferable policy so that it adapts better to the unexperienced traffic states, while the conventional RL model fails. Reinforcement learning (RL) has emerged as an alternative approach for optimizing the traffic signal control system. However, there is a restricted exploration problem encountered when a signal control model is trained with a predefined demand scenario in the traffic simulation. With the restricted exploration, the model learns a policy based only on partial experiences in the search space, which yields a partially-trained policy. Partially-trained policy fails to adapt to some unexperienced ('unexplored', 'never-before-seen') dataset that have different distributions from the training dataset. Although this issue has critical effects on training a signal control model, it has not been considered in the literature. Therefore, this research aims to obtain a transferable policy to enhance the model's applicability on unexperienced traffic states. The key idea is to represent the state as graph-structured data, and train it using a graph neural network (GNN). Since this approach enables to learn the relationship between the features resulting from the spatial structure of the intersection, it is able to transfer the already-learned knowledge of the relationship to the unexperienced data. In order to investigate the transferability, an experiment is conducted on five unexperienced test demand scenarios. For the evaluation, the performance of the proposed GNN model is compared with the conventional DQN model that is based on vector-valued state. At first, the models are trained with only a single dataset (training demand scenario). Then, they are tested with different unexperienced dataset (test demand scenarios) without additional trainings. The results show that the proposed GNN model obtains a transferable policy so that it adapts better to the unexperienced traffic states, while the conventional DQN model fails. [ABSTRACT FROM AUTHOR]