1. Reinforcement Learning-Based Control of DC-DC Buck Converter Considering Controller Time Delay
- Author
-
Donghun Lee, Bongseok Kim, Soonhyung Kwon, Ngoc-Duc Nguyen, Min Kyu Sim, and Young Il Lee
- Subjects
DC-DC synchronous buck converter ,real-time deep reinforcement learning (RTDRL) ,digital signal processor (DSP) ,optimal control ,Electrical engineering. Electronics. Nuclear engineering ,TK1-9971 - Abstract
Non-linearities and unmodeled dynamics in the control system inevitably degrade the quality and reliability of voltage stabilization performance in DC-DC buck converters. Reinforcement Learning (RL) is an emerging method to mitigate this issue. However, traditional RL typically necessitates significant computational resources and specialized processing units, thus being an economically unreasonable option. This paper proposes a high-performance RL-based method even suitable for a cost-effective Digital Signal Processor (DSP). To address the significant challenge of time delay in a DSP when training the RL agent, this paper adopts a Real-Time Deep Reinforcement Learning (RTDRL) approach that creates an augmented virtual decision process to eliminate the delay effect. The performance is validated through software simulation (PLECS) and an actual system, through which the proposed approach demonstrated superior performance compared to existing benchmarks, including existing approaches and artificial intelligence.
- Published
- 2024
- Full Text
- View/download PDF