Back to Search Start Over

Robust Energy Management Policies for Solar Microgrids via Reinforcement Learning

Authors :
Gerald Jones
Xueping Li
Yulin Sun
Source :
Energies, Vol 17, Iss 12, p 2821 (2024)
Publication Year :
2024
Publisher :
MDPI AG, 2024.

Abstract

As the integration of renewable energy expands, effective energy system management becomes increasingly crucial. Distributed renewable generation microgrids offer green energy and resilience. Combining them with energy storage and a suitable energy management system (EMS) is essential due to the variability in renewable energy generation. Reinforcement learning (RL)-based EMSs have shown promising results in handling these complexities. However, concerns about policy robustness arise with the growing number of grid intermittent disruptions or disconnections from the main utility. This study investigates the resilience of RL-based EMSs to unforeseen grid disconnections when trained in grid-connected scenarios. Specifically, we evaluate the resilience of policies derived from advantage actor–critic (A2C) and proximal policy optimization (PPO) networks trained in both grid-connected and uncertain grid-connectivity scenarios. Stochastic models, incorporating solar energy and load uncertainties and utilizing real-world data, are employed in the simulation. Our findings indicate that grid-trained PPO and A2C excel in cost coverage, with PPO performing better. However, in isolated or uncertain connectivity scenarios, the demand coverage performance hierarchy shifts. The disruption-trained A2C model achieves the best demand coverage when islanded, whereas the grid-connected A2C network performs best in an uncertain grid connectivity scenario. This study enhances the understanding of the resilience of RL-based solutions using varied training methods and provides an analysis of the EMS policies generated.

Details

Language :
English
ISSN :
17122821 and 19961073
Volume :
17
Issue :
12
Database :
Directory of Open Access Journals
Journal :
Energies
Publication Type :
Academic Journal
Accession number :
edsdoj.282c0a72a6e442d29003bc99fd4b7d7c
Document Type :
article
Full Text :
https://doi.org/10.3390/en17122821