1. Autonomous underwater vehicle control using reinforcement learning policy search methods
- Author
-
El-Fakdi Sencianes, Andrés, Carreras Pérez, Marc, Palomeras Rovira, Narcís, and Ridao Rodríguez, Pere
- Subjects
Autonomous robots -- Control systems ,Aprenentatge per reforç ,Reinforcement learning ,Submersibles -- Control systems ,Robots autònoms -- Sistemes de control ,Vehicles submergibles -- Sistemes de control - Abstract
Autonomous underwater vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of subsea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an autonomous robot. The system is characterized by the use of reinforcement learning direct policy search methods (RLDPS) for learning the internal state/action mapping of some behaviors. We demonstrate its feasibility with simulated experiments using the model of our underwater robot URIS in a target following task
- Published
- 2010