Search

Traffic congestion is a major concern for many metropolises. Although it is difficult to regulate traffic flow because of numerous complexities and uncertainties, the traffic congestion problem must be mitigated in order to reduce the environmental problems related to traffic and the time lost on the roads in big cities. Intelligent traffic control methods, the use of which is increasing with the development of new methods, as opposed to conventional methods, and provide more efficient solutions, especially in traffic intersections with high traffic density. In this paper, we propose a new agent-based Fuzzy Logic assisted traffic light signal timing for traffic intersections. Deep Q-Learning algorithms and Fuzzy Logic Control (FLC) are used together in the proposed method. In this study, the proposed method and many traffic light control methods in the literature were simulated. In order to demonstrate the effectiveness of the proposed method, some of the important metrics of evaluation such as traffic congestion, air pollution, and waiting time were used in the assessment of the simulation results. In addition, with the proposed method, it has been shown that the stability and robustness of the system are increased. [ABSTRACT FROM AUTHOR]

When multiple bus vehicles send priority requests at a single intersection, the existing fixed-phase sequence control methods cannot provide priority traffic request services for multiphase bus vehicles. In view of the conflict of multiphase bus priority requests at intersections, the priority vehicle traffic sequence is determined, which is the focus of this study. In this paper, a connected vehicle-enabled transit signal priority system (CV-TSPS) has been proposed, which uses vehicle-infrastructure communication function (V2I) technology to obtain real-time vehicle movement, road traffic states, and traffic signal light phase information. By developing a deep Q-learning neural network (DQNN), especially for optimizing traffic signal control strategy, the public transit vehicles will be prioritized to improve their travel efficiency, while the overall delay of road traffic flow will be balanced to ensure the safe and orderly passage of intersections. In order to verify the validity of the model, the SUMO traffic analysis software has been applied to simulate real-time traffic control, and the experimental results show that compared with the traditional timing signal control, the loss time of vehicles is reduced by nearly 40%, and the cumulative loss time per capita is reduced by nearly 43.5%, and a good control effect is achieved. In the case of medium and low densities, it is better than the solid scheduled traffic control scheme. [ABSTRACT FROM AUTHOR]

In recent years, the growing development of Connected Autonomous Vehicles (CAV), Intelligent Transport Systems (ITS), and 5G communication networks have led to the advent of Autonomous Intersection Management (AIM) systems. AIMs present a new paradigm for CAV control in future cities, taking control of CAVs in scenarios where cooperation is necessary and allowing safe and efficient traffic flows, eliminating traffic signals. So far, the development of AIM algorithms has been based on basic control algorithms, without the ability to adapt or keep learning new situations. To solve this, in this paper we present a new advanced AIM approach based on end-to-end Multi-Agent Deep Reinforcement Learning (MADRL) and trained using Curriculum through Self-Play, called advanced Reinforced AIM (adv.RAIM). adv.RAIM enables the control of CAVs at intersections in a collaborative way, autonomously learning complex real-life traffic dynamics. In addition, adv.RAIM provides a new way to build smarter AIMs capable of proactively controlling CAVs in other highly complex scenarios. Results show remarkable improvements when compared to traffic light control techniques (reducing travel time by 59% or reducing time lost due to congestion by 95%), as well as outperforming other recently proposed AIMs (reducing waiting time by 56%), highlighting the advantages of using MADRL. [ABSTRACT FROM AUTHOR]

With rapid development of the urbanization, how to improve the traffic lights efficiency has become an urgent issue. The traditional traffic light control is a method that calculates a series of corresponding timing parameters by optimizing the cycle length. However, fixing sequence and duration of traffic lights is inefficient for dynamic traffic flow regulation. In order to solve the above problem, this study proposes a traffic light timing optimization scheme based on deep reinforcement learning (DRL). In this scheme, the traffic lights can output an appropriate phase according to the traffic flow state of each direction at the intersection and dynamically adjust the phase length. Specifically, we first adopt Proximal Policy Optimization (PPO) to improve the convergence speed of the model. Then, we elaborate the design of state, action, and reward, with the vehicle state defined by Discrete Traffic State Encoding (DTSE) method. Finally, we conduct experiments on real traffic data via the traffic simulation platform SUMO. The results show that, compared to the traditional timing control, the proposed scheme can effectively reduce the waiting time of vehicles and queue length in various traffic flow modes. [ABSTRACT FROM AUTHOR]

The most observable obstacle to sustainable mobility is traffic congestions. These congestions cannot effectively be fixed by traditional control of traffic signals. Safe and smooth movement of traffic is ensured by a self-controlled traffic signal. As such, to coordinate the traffic flow it is necessary to implement dynamic traffic signal subsequences. Primarily, Traffic Signal Controllers (TSC) provides sophisticated control and coordination of vehicles. The control and coordination of traffic signal control systems can be effectively achieved by implementing the Deep Reinforcement Learning (DRL) approaches. The decision-making capabilities at intersections are improved by having variations of traffic signal timing using an adaptive TSC. Alternatively, the actual traffic demand is nothing but managing the traffic systems. It analyses the incoming number and type of vehicles and gives a real- time response at intersection geometrics and controls the traffic signals accordingly. The proposed DRL algorithm observes traffic data and operates optimum management plans for the regulation of the traffic flow. Furthermore, an existing traffic simulator is used to help provide a realistic environment to support the proposed algorithm. [ABSTRACT FROM AUTHOR]

Inefficient traffic control may cause numerous problems such as traffic congestion and energy waste. This paper proposes a novel multi-agent reinforcement learning method, named KS-DDPG (K nowledge S haring D eep D eterministic P olicy G radient) to achieve optimal control by enhancing the cooperation between traffic signals. By introducing the knowledge-sharing enabled communication protocol, each agent can access to the collective representation of the traffic environment collected by all agents. The proposed method is evaluated through two experiments respectively using synthetic and real-world datasets. The comparison with state-of-the-art reinforcement learning-based and conventional transportation methods demonstrate the proposed KS-DDPG has significant efficiency in controlling large-scale transportation networks and coping with fluctuations in traffic flow. In addition, the introduced communication mechanism has also been proven to speed up the convergence of the model without significantly increasing the computational burden. • A multi-agent reinforcement learning for adaptive signal control. • Agents can communicate with others through knowledge-sharing protocol. • Proposed algorithm achieves consistent improvements over baselines. [ABSTRACT FROM AUTHOR]

As traffic congestion in cities becomes serious, intelligent traffic signal control has been actively studied. Deep Q-Network (DQN), a representative deep reinforcement learning algorithm, is applied to various domains from fully-observable game environment to traffic signal control. Due to the effective performance of DQN, deep reinforcement learning has improved speeds and various DQN extensions have been introduced. However, most traffic signal control researches were performed at a single intersection, and because of the use of virtual simulators, there are limitations that do not take into account variables that affect actual traffic conditions. In this paper, we propose a cooperative traffic signal control with traffic flow prediction (TFP-CTSC) for a multi-intersection. A traffic flow prediction model predicts future traffic state and considers the variables that affect actual traffic conditions. In addition, for cooperative traffic signal control in multi-intersection, each intersection is modeled as an agent, and each agent is trained to take best action by receiving traffic states from the road environment. To deal with multi-intersection efficiently, agents share their traffic information with other adjacent intersections. In the experiment, TFP-CTSC is compared with existing traffic signal control algorithms in a 4 × 4 intersection environment. We verify our traffic flow prediction and cooperative method. [ABSTRACT FROM AUTHOR]