Search

When car following is controlled by human drivers (i.e., by their behavior), the traffic system does not meet stability conditions. In order to ensure the safety and reliability of self-driving vehicles, an additional hazard warning system should be incorporated into the adaptive control system in order to prevent any possible unavoidable collisions. The time to contact is a reasonable indicator of potential collisions. This research examines systems and solutions developed in this field to determine collision times and uses various alarms in self-driving cars that prevent collisions with obstacles. In the proposed analysis, we have tried to classify the various techniques and methods, including image processing, machine learning, deep learning, sensors, and so on, based on the solutions we have investigated. Challenges, future research directions, and open problems in this important field are also highlighted in the paper.

Cloud computing leads to efficient resource allocation for network users. In order to achieve efficient allocation, many research activities have been conducted so far. Some researchers focus on classical optimisation theory techniques (such as multi-objective optimisation, evolutionary optimisation, game theory, etc.) to satisfy network providers and network users’ service-level agreement (SLA) requirements. Normally, in a cloud data centre network (CDCN), it is difficult to jointly satisfy both the cloud provider and cloud customer’ utilities, and this leads to complex combinatorial problems, which are usually NP-hard. Recently, machine learning and artificial intelligence techniques have received much attention from the networking community because of their capability to solve complicated networking problems. In the current work, at first, the holistic utility satisfaction for the cloud data centre provider and customers is formulated as a reinforcement learning (RL) problem with a specific reward function, which is a convex summation of users’ utility functions and cloud provider’s utility. The user utility functions are modelled as a function of cloud virtualised resources (such as storage, CPU, RAM), connection bandwidth, and also, the network-based expected packet loss and round-trip time factors associated with the cloud users. The cloud provider utility function is modelled as a function of resource prices and energy dissipation costs. Afterwards, a Q-learning implementation of the mentioned RL algorithm is introduced, which is able to converge to the optimal solution in an online and fast manner. The simulation results exhibit the enhanced convergence speed and computational complexity properties of the proposed method in comparison with similar approaches from the joint cloud customer/provider utility satisfaction perspective. To evaluate the scalability property of the proposed method, the results are also repeated for different cloud user population scenarios (small, medium, and large).