Back to Search Start Over

Enhancing Autonomous Driving Navigation Using Soft Actor-Critic.

Authors :
Elallid, Badr Ben
Benamar, Nabil
Bagaa, Miloud
Hadjadj-Aoul, Yassine
Source :
Future Internet; Jul2024, Vol. 16 Issue 7, p238, 16p
Publication Year :
2024

Abstract

Autonomous vehicles have gained extensive attention in recent years, both in academia and industry. For these self-driving vehicles, decision-making in urban environments poses significant challenges due to the unpredictable behavior of traffic participants and intricate road layouts. While existing decision-making approaches based on Deep Reinforcement Learning (DRL) show potential for tackling urban driving situations, they suffer from slow convergence, especially in complex scenarios with high mobility. In this paper, we present a new approach based on the Soft Actor-Critic (SAC) algorithm to control the autonomous vehicle to enter roundabouts smoothly and safely and ensure it reaches its destination without delay. For this, we introduce a destination vector concatenated with extracted features using Convolutional Neural Networks (CNN). To evaluate the performance of our model, we conducted extensive experiments in the CARLA simulator and compared it with the Deep Q-Network (DQN) and Proximal Policy Optimization (PPO) models. Qualitative results reveal that our model converges rapidly and achieves a high success rate in scenarios with high traffic compared to the DQN and PPO models. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
19995903
Volume :
16
Issue :
7
Database :
Complementary Index
Journal :
Future Internet
Publication Type :
Academic Journal
Accession number :
178699694
Full Text :
https://doi.org/10.3390/fi16070238