Search

In many real-life scenarios, multiple agents necessitate cooperation to accomplish tasks. Benefiting from the significant success of deep learning, many single-agent deep reinforcement learning algorithms have been extended to multi-agent scenarios. Overestimation in value estimation of Q-learning is a significant issue that has been studied comprehensively in the single-agent domains, but rarely in multi-agent reinforcement learning. In this paper, we first demonstrate that Q-learning-based multi-agent reinforcement learning (MARL) methods generally have notably serious overestimation issues, which cannot be alleviated by current methods. To tackle this problem, we introduce the double critic networks structure and the delayed policy update to Q-learning-based multi-agent MARL methods, which reduce the overestimation and enhance the quality of policy updating. To demonstrate the versatility of our proposed method, we select several Q-learning based MARL methods and evaluate them on several multi-agent tasks on the multi-agent particle environment and SMAC. Experimental results demonstrate that the proposed method can avoid the overestimation problem and significantly improve performance. Besides, application in the Traffic Signal Control verifies the feasibility of applying the proposed method in real-world scenarios. [ABSTRACT FROM AUTHOR]

The rapid development of urbanization in China has contributed to traffic events, such as traffic accidents and delays. It is difficult to detect and resolve highway traffic congestion in a timely manner using traditional methods because they are slow, require a large number of workers, and require the installation of a large amount of monitoring equipment. Therefore, it is imperative to introduce advanced technology to address these challenges. Recently, deep learning technology has made significant breakthroughs and has been widely applied to various fields with satisfactory results. Deep learning is among the most important technologies for the detection and evaluation of traffic congestion, enabling the accurate detection of the state of the expressway network's traffic congestion, the evaluation of traffic congestion, and the prediction of possible traffic congestion. This enables management to formulate traffic dredging strategies in advance to prevent the negative impact of traffic congestion on normal traffic flow. This paper proposes a framework based on deep learning for next-generation highway traffic management. This framework selects traffic congestion indicators to construct an index model, and then constructs a deep learning model based on self-coding. It predicts and classifies highway traffic environment data and excavates sample data based on the characteristics of traffic parameters. As soon as traffic data were classified, a prediction model based on SoftMax was established to detect and predict highway traffic congestion. We conducted a traffic congestion analysis of the Shanghai expressway network based on the speed performance data obtained from the China Traffic Management Bureau. As a result of their research, we developed an index to measure highway traffic congestion. For traffic control and management organizations to function effectively, it is crucial to have an accurate and clear picture of traffic network operations. We evaluated the proposed framework using data gathered from highway monitoring scenes, and the results indicated that 98.6% of the data could be correctly detected. Using the prediction model based on SoftMax for expressway vehicles during peak hours, the accuracy was 92%, and the misjudgment rate was 8%. This study demonstrates that detecting and evaluating the state of highway traffic environments using deep learning has high accuracy, can be applied to actual highway traffic systems, and is extremely useful for detecting highway congestion. This framework is a promising solution for next-generation highway traffic management and provides accurate and timely traffic congestion detection and evaluation. [ABSTRACT FROM AUTHOR]

In this paper, first we introduce the notions of size, order, and degree of vertices and edges in a soft graph, and we give some examples for a better understanding of these concepts. Then, we define the fundamental concepts of the adjacency matrix of soft graphs, complement of soft graphs, and regularity based on the degree of vertices of soft graphs, and we investigate some related results. Moreover, we introduce the concept of soft multiset and soft multigraph and define the notions of union, intersection, complement, and sum, and then we investigate the relations among them. Finally, we give an application of soft graphs in controlling urban traffic flows. [ABSTRACT FROM AUTHOR]

Accurate assessment of road conditions can effectively alleviate traffic congestion and guide people's travel plans, traffic control decisions of transportation departments, and formulation of traffic-related laws and regulations. This paper proposes a quantum particle swarm optimization (QPSO) and adaptive hybrid exponential smoothing with residual correction (AHES-RC) for the nonlinearity and randomness of traffic flow. In the proposed algorithm, the single–double-exponential smoothing method is mixed with adaptive weights to form AHES, a new method of mixing weights according to real-time traffic trend changes. After the residual correction of AHES is calculated by the extreme learning machine algorithm, the parameters of AHES-RC are optimized using QPSO to improve the prediction accuracy further. This paper comprehensively compares the QPSO-AHES-RC algorithm with other benchmark models through testing on 26 real-world data sets. The results show that the proposed algorithm can adaptive forecasting under various traffic conditions, yielding the best forecasting performance in terms of various forecast error metrics. Compared with advanced machine learning algorithms such as XGBoost and CatBoost, the mean RMSE and mean MAPE have been improved by over 20% on average. In addition, it is revealed that the real-time dynamic capture of traffic flow can effectively improve prediction accuracy. [ABSTRACT FROM AUTHOR]

Signal optimisation is essential in traffic engineering. The traffic light control timings should be set as optimum. However, it is challenging because the traffic network is a non-polynomial problem. In this study, the problem is evaluated from a unique perspective. The primary idea is to remove the crossings of the intersections. A Hamiltonian cycle algorithm has been used to design the network. So, vehicles are only able to join or split. Thus, no control mechanism is needed that delays or interrupts the flow. The suggested algorithm and intersection design were tested on Allsop and Charlesworth's widely used sample network. Findings were compared with the literature in the form of delay calculated using the Highway Capacity Manual 2010 formula. The suggested network's delay is calculated to be 98.17% and 95.45% less than the original network and recently published study-based delay, respectively. As a result, Hamiltonian roads seem sustainable in time and fuel consumption and could be used for future designs. [ABSTRACT FROM AUTHOR]

Accurate vehicle speed prediction is of great significance to the urban traffic intelligent control system. However, in terms of traffic speed prediction, the modules that integrate temporal and spatial features in the existing traffic speed prediction methods are effective in short-term prediction, but the medium-term or long-term prediction errors are relatively large. In order to reduce the errors of existing methods in short-term prediction and predict the medium-term and long-term traffic speed, this paper proposes a traffic speed prediction method that combines attention and Spatial–temporal features, referred to as ASTCN. Specifically, unlike previous methods, ASTCN can use the temporal attention convolutional network (ATCN) to separately extract temporal features from the traffic speed features collected by each sensor, and use the spatial attention mechanism to extract spatial features and then perform spatial–temporal feature fusion. Experiments on three real-world datasets show that the proposed ASTCN model outperforms the state-of-the-art baselines. [ABSTRACT FROM AUTHOR]

RPL (IPv6 Routing Protocol for Low power and Lossy Networks) is the pseudo-standard routing protocol for Internet of Things. RPL employs a customizable objective function to optimize the routing. The default objective functions used in RPL are i) OF0 (Objective Function Zero) and ii) MRHOF (Minimum Rank with Hysteresis Objective Function). The OF0 is based on the routing metric hop count, whereas the MRHOF uses the ETX metric. They both do not measure the actual link quality. The link quality is directly related to the reliability of the network. The quality of the link can be estimated through methods that are both hardware and software based. The software-based methods are easy to implement and to ensure the reliability of the network. There are different software-based link quality estimation methods; the prominent methods among them are ETX and Link Quality Level (LQL). The ETX is a method of approximation of the transmitted packets. It uses probe packets to predict the expected transmission count, and it may not accurately reflect the link quality. The proposed Link Quality-Based Objective Function (LQBOF) makes use of the LQL metric which provides better link estimation values than the ETX method. The proposed method intends to provide a more reliable routing based on the link quality. The LQL is estimated through a metric called Packet Reception Rate (PRR). The LQL is calculated and ranked as values from 1 to 7, reflecting the best and worst link quality, respectively. The estimated LQL value is linked with the default ETX in computing the best path. This method intends to increase the reliability of the network. The reliability of the objective function is evaluated with the performance metrics packet delivery ratio, power consumption, throughput, convergence time, control traffic overhead and hop count. [ABSTRACT FROM AUTHOR]

Because of the population increasing so high, and traffic density remaining the same, traffic prediction has become a great challenge today. Creating a higher degree of communication in automobiles results in the time wastage, fuel wastage, environmental damage, and even death caused by citizens being trapped in the middle of traffic. Only a few researchers work in traffic congestion prediction and control systems, but it may provide less accuracy. So, this paper proposed an efficient IoT-based traffic prediction using OWENN algorithm and traffic signal control system using Intel 80,286 microprocessor for a smart city. The proposed system consists of '5' phases, namely IoT data collection, feature extraction, classification, optimized traffic IoT values, and traffic signal control system. Initially, the IoT traffic data are collected from the dataset. After that, traffic, weather, and direction information are extracted, and these extracted features are given as input to the OWENN classifier, which classifies which place has more traffic. Suppose one direction of the place has more traffic, it optimizes the IoT values by using IBSO, and finally, the traffic is controlled by using Intel 80,286 microprocessor. An efficient OWENN algorithm for traffic prediction and traffic signal control using a Intel 80,286 microprocessor for a smart city. After extracting the features, the classification is performed in this step. Hereabout, the classification is done by using the optimized weight Elman neural network (OWENN) algorithm that classifies which places have more traffic. OWENN attains 98.23% accuracy than existing model also its achieved 96.69% F-score than existing model. The experimental results show that the proposed system outperforms state-of-the-art methods. [ABSTRACT FROM AUTHOR]

Driverless automatically guided vehicles are becoming a new trend in transportation envisioned in a smart city environment. Automatically guided vehicles depend on environmental data for executing target-oriented navigation and movements. The traffic knowledge can be used by automatically guided vehicles by measuring their intensity and delivery date in the green light. Therefore, considering sensor data's significance in this guided vehicle environment, this article presents the Internet of Things (IoT) assisted automated guided vehicle (IoT-AGV) scheme. IoT-AGV scheme discusses the implementation of an autonomous vehicle traffic control program at crossings. The traffic knowledge operator is ready to retrieve details from the sensor utilizing quick communication through a mobile network to measure optimum travel time and transmit the information collected to automated cars. In an automated guided vehicle (AGV) scheme, the automotive-into-loop model is introduced to eliminate delays. Error indicator integrates various hurdle imbalance statistics calculated from the sensor based on the road slide. A deep neural network focuses on a minimal collection of the most critical features, eliminating the fitting problem. This aids determine the error producing sensor data and alleviate them from fusion to enhance the target's accuracy. The experimental results show that the suggested system has been validated by the images from BIT vehicle datasets and enhances the accuracy ratio of 96.22% to measure optimum travel time and transmit the information collected to automated guided vehicles. [ABSTRACT FROM AUTHOR]