Back to Search Start Over

Robust interplanetary trajectory design under multiple uncertainties via meta-reinforcement learning.

Authors :
Federici, Lorenzo
Zavoli, Alessandro
Source :
Acta Astronautica. Jan2024, Vol. 214, p147-158. 12p.
Publication Year :
2024

Abstract

This paper focuses on the application of meta-reinforcement learning to the robust design of low-thrust interplanetary trajectories in the presence of multiple uncertainties. A closed-loop control policy is used to optimally steer the spacecraft to a final target state despite the considered perturbations. The control policy is approximated by a deep recurrent neural network, trained by policy-gradient reinforcement learning on a collection of environments featuring mixed sources of uncertainty, namely dynamic uncertainty and control execution errors. The recurrent network is able to build an internal representation of the distribution of environments, thus better adapting the control to the different stochastic scenarios. The results in terms of optimality, constraint handling, and robustness on a fuel-optimal low-thrust transfer between Earth and Mars are compared with those obtained via a traditional reinforcement learning approach based on a feed-forward neural network. • In interplanetary space missions, the spacecraft trajectory is affected by multiple uncertainties. • Meta-reinforcement learning can be applied seamlessly to any uncertainty and dynamic model. • A recurrent neural network is used as a history-dependent closed-loop control policy. • The network is trained on a low-thrust transfer featuring dynamic uncertainties and control execution errors. • Meta-reinforcement learning shows improved performance and robustness compared to standard reinforcement learning. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00945765
Volume :
214
Database :
Academic Search Index
Journal :
Acta Astronautica
Publication Type :
Academic Journal
Accession number :
174015491
Full Text :
https://doi.org/10.1016/j.actaastro.2023.10.018