Back to Search Start Over

Autonomous Robotic Systems with Artificial Intelligence Technology Using a Deep Q Network-Based Approach for Goal-Oriented 2D Arm Control.

Authors :
Bashabsheh, Murad
Source :
Journal of Robotics & Control (JRC); 2024, Vol. 5 Issue 6, p1872-1887, 16p
Publication Year :
2024

Abstract

Accurate control robotic arms in twodimensional environments present significant challenges, particularly in dynamic, real-time applications. Traditional model-based approaches require substantial system modeling, rendering them computationally extensive. This paper presents an adaptive Artificial Intelligence (AI)-driven approach through the use of Deep Q-Networks (DQN) control for a two-link robotic arm thus supporting better scalability. The DQN algorithm, a model-free Reinforcement Learning (RL) technique, allows the robotic arm to independently learn optimal control strategies by interaction with the environment and adapting to dynamic conditions. The task of the robot established reaches a specific target (red point) within a limited number of episodes. Key components of the methodology contain problem statement, DQN architecture, representation of the state and action spaces, a reward function, and the training process. Experimental results indicate that the DQN agent effectively learns to find optimal actions with high accuracy and robustness in guiding the arm to the target. The performance steadily improves during initial training, followed by stabilization, indicating an effective control policy. This study contributes to the knowledge of reinforcement learning in robotic control tasks and demonstrates, in particular, the potential of DQN for solving complex, goal-oriented tasks with minimal prior modeling. Compared to conventional control approaches, the DQN-driven one reveals higher flexibility, scalability, and efficiency. Although carried out in a simplified 2D environment, the novelty of this research lies in its emphasis on enabling the robotic arm to accomplish goaloriented reaching tasks, lays a strong foundation for future applications in industrial automation and service robotics. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
27155056
Volume :
5
Issue :
6
Database :
Complementary Index
Journal :
Journal of Robotics & Control (JRC)
Publication Type :
Academic Journal
Accession number :
182174544
Full Text :
https://doi.org/10.18196/jrc.v5i6.23850