Back to Search
Start Over
Improved model-free H∞ control for batch processes via off-policy 2D game Q-learning.
- Source :
-
International Journal of Control . Oct2023, Vol. 96 Issue 10, p2447-2463. 17p. - Publication Year :
- 2023
-
Abstract
- To eliminate the requirement of the precise model for model-based control methods, an improved modelfree H∞ control method is designed for batch processes with unknown dynamics and disturbances. Firstly, both the zero-sum game value function and the Q-function are presented as two-dimensional (2D) forms, and their relation is analyzed to obtain the model-free Bellman equation. Secondly, an on policy 2D game Q-learning method is proposed for learning the optimal gains of the designed H∞ controller. On this basis, the behavior control policy and the behavior disturbance policy are individually applied by developing an off-policy 2D game Q-learning method. Subsequently, the strict proof about the convergence and the unbiasedness of the off-policy approach are given. Finally, the simulation results of injection velocity manifest the validity and effectivity of the proposed algorithm. [ABSTRACT FROM AUTHOR]
- Subjects :
- *BATCH processing
*ZERO sum games
*BOUSSINESQ equations
*GAMES
Subjects
Details
- Language :
- English
- ISSN :
- 00207179
- Volume :
- 96
- Issue :
- 10
- Database :
- Academic Search Index
- Journal :
- International Journal of Control
- Publication Type :
- Academic Journal
- Accession number :
- 171899170
- Full Text :
- https://doi.org/10.1080/00207179.2022.2097957