Search

One of the focal points in the field of intelligent transportation is the intelligent control of traffic signals (TS), aimed at enhancing the efficiency of urban road networks through specific algorithms. Deep Reinforcement Learning (DRL) algorithms have become mainstream, yet they suffer from inefficient training sample selection, leading to slow convergence. Additionally, enhancing model robustness is crucial for adapting to diverse traffic conditions. Hence, this paper proposes an enhanced method for traffic signal control (TSC) based on DRL. This approach utilizes dueling network and double q-learning to alleviate the overestimation issue of DRL. Additionally, it introduces a priority sampling mechanism to enhance the utilization efficiency of samples in memory. Moreover, noise parameters are integrated into the neural network model during training to bolster its robustness. By representing high-dimensional real-time traffic information as matrices, and employing a phase-cycled action space to guide the decision-making of intelligent agents. Additionally, utilizing a reward function that closely mirrors real-world scenarios to guide model training. Experimental results demonstrate faster convergence and optimal performance in metrics such as queue length and waiting time. Testing experiments further validate the method's robustness across different traffic flow scenarios. [ABSTRACT FROM AUTHOR]

Since its outbreak in December 2019, COVID-19 has spread rapidly across the world. To slow down the spread of the pandemic, various countries have implemented a series of policies and measures. The transportation system is not only an important carrier for COVID-19, but also a vital means for the prevention and control of the spread of the pandemic. Therefore, most anti-pandemic measures are based on travel restrictions, thereby slowing down the spread of the pandemic. As a result, because of the impact of the pandemic and corresponding control measures, the transportation system has undergone tremendous changes. By analyzing the evolution of the transportation system in response to the influence of COVID-19, it is possible to better understand socioeconomic changes and the changes in residents' daily life. Based on rich license plate recognition data, the characteristics of urban motorized travel under the influence of COVID-19 has been analyzed. According to the processes associated with the control of the pandemic and the resumption of work and production, the analysis period is divided into four stages. The changes in indicators of macroscopic traffic status are analyzed for each stage. The three types of typical motor vehicle groups (i.e., non-localized operating vehicles, taxis, and localized operating vehicles) are characterized by the traffic flow they contribute, the number of vehicles in transit, the average travel intensity, the average daily travel time of a vehicle, the average daily travel distance of a vehicle, and the spatiotemporal distributions of origins and destinations of trips. These data clarify the spatiotemporal evolution characteristics of peoples' travel behavior at different stages of the pandemic. The results of data analysis show that COVID-19 has deeply changed the motorized travel behavior of urban residents. In the initial stage of resumption of work and production, the willingness to engage in motorized travel had decreased significantly compared with that in the first stage. This willingness gradually resumed until the third and fourth stages, but still did not fully reach the level before the onset of the pandemic. Specifically, the traffic status during morning and evening peaks has basically recovered, and has even increased beyond the level before the pandemic; however, a certain gap was still found between off-peak hours. There were also significant differences in the extent to which different types of vehicles were affected by the pandemic. Among these, taxis were impacted the most by the pandemic. In the fourth stage (at the end of April), the average daily travel time of a vehicle and the average daily travel distance of a vehicle still decreased by 29.25% and 22.63% compared with the first stage, respectively. The operating time of many taxis was shortened from 22:00 PM to 19:00 PM. The spatiotemporal characteristics of vehicles show that the reduction of flexible travel demand (e.g., shopping, catering, and entertainment) is key to the reduction of the travel demand of the road network. This research provides data support for the implementation of traffic control measures under future grave public health events and enables the formulation of urban traffic policies in the post COVID-19 era. [ABSTRACT FROM AUTHOR]

In this study, a traffic queue model is employed to simulate traffic parameters for optimization purposes. The primary objective is to enhance the average queue length, cumulative delay, and cumulative reward for varying numbers of vehicles generated using an innovative approach. The proposed methodology integrates deep Reinforcement Q-Learning techniques implemented through a realistic simulator, Simulation of Urban MObility, based on OpenStreetMap. This simulator is used to balance the flow of traffic by monitoring traffic conditions and adjusting signals (Red/Yellow/Green) accordingly. The research extensively evaluates simulation outcomes across different scenarios involving 50, 100, 500, and 1000 vehicles, with episodes 10, 50 and 100. The results provide valuable insights into training times, simulation durations, and total rewards obtained, indicating improvements in mitigating traffic congestion. The introduction of a traffic control strategy enhances model effectiveness through the utilization of four-layer deep neural network architectures with 400 neurons in hidden layers. However, the study also highlights persistent challenges related to real-time implementation and complexities in state-action-agent relationships. The progress highlights improvements in reducing congestion and enhancing efficiency at junctions by dynamically adjusting signal phases while leveraging historical data. The results highlight the potential of dynamic traffic management strategies in effectively addressing urban traffic challenges. [ABSTRACT FROM AUTHOR]

Traffic lights are crucial for urban traffic management, as they significantly impact congestion reduction and travel safety. Traditional methods relying on hand-crafted rules and operator experience are limited in their ability to adapt to changing traffic environments. To address this challenge, we have been exploring intelligent traffic light control using deep reinforcement learning techniques. However, current approaches often suffer from inadequate training data and unstable training processes, leading to suboptimal performance and real-world consequences. In this study, we propose RELight, a novel random ensemble reinforcement learning-based traffic light control framework. RELight effectively utilizes collected empirical data, ensuring a stable and efficient training process. To evaluate the performance of our proposed framework, we conducted a comprehensive set of experiments on a variety of datasets, including four synthetic datasets and a real traffic dataset collected from surveillance cameras at an intersection in Hangzhou, China. The results show that RELight outperforms existing approaches, demonstrating its superiority and potential for practical traffic light control applications. [ABSTRACT FROM AUTHOR]