Back to Search Start Over

Heat Conduction Control Using Deep Q-Learning Approach with Physics-Informed Neural Networks

Authors :
Nelson D. Gonçalves
Jhonny de Sá Rodrigues
Source :
Metrology, Vol 4, Iss 3, Pp 489-505 (2024)
Publication Year :
2024
Publisher :
MDPI AG, 2024.

Abstract

As modern systems become more complex, their control strategy no longer relies only on measurement data from probes; it also requires information from mathematical models for non-measurable places. On the other hand, those mathematical models can lead to unbearable computation times due to their own complexity, making the control process non-viable. To overcome this problem, it is possible to implement any kind of surrogate model that enables the computation of such estimates within an acceptable time frame, which allows for making decisions. Using a Physics-Informed Neural Network as a surrogate model, it is possible to compute the temperature distribution at each time step, replacing the need for running direct numerical simulations. This approach enables the use of a Deep Reinforcement Learning algorithm to train a control strategy. On this work, we considered a one-dimensional heat conduction problem, in which temperature distribution feeds a control system. Such control system has the objective of reacing and maintaining constant temperature value at a specific location of the 1D problem by activating a heat source; the desired location somehow cannot be directly measured so, the PINN approach allows to estimate its temperature with a minimum computational workload. With this approach, the control training becomes much faster without the need of performing numerical simulations or laboratory measurements.

Details

Language :
English
ISSN :
26738244
Volume :
4
Issue :
3
Database :
Directory of Open Access Journals
Journal :
Metrology
Publication Type :
Academic Journal
Accession number :
edsdoj.2e62ec8a78342b7b2e3d0e8561e7325
Document Type :
article
Full Text :
https://doi.org/10.3390/metrology4030030