Search

The home energy management system (HEMS), which utilizes multi-modal data from multiple sensors to generate the knowledge about decision making, is essential to the optimization of home energy management efficiency. Load scheduling based on HEMS can improve the utilization efficiency of multi-modal data and derived knowledge, achieve power supply-demand balance, and reduce users’ electricity costs. This paper proposes a distributed load optimization scheduling method for the load scheduling problem in HEMS based on multi-modal data-driven algorithm. Additionally, a two-stage data-driven optimization method is proposed, including a first-stage optimization model based on minimizing electricity costs and a second-stage optimization model based on minimizing system load fluctuations. In the first stage, cost self-optimization is performed based on energy storage devices. In the second stage, a load optimization instruction is issued by the control center, and each user optimizes the load fluctuations based on the system load data. Compared to centralized control methods, this approach reduces the computational overhead of the control center. Finally, simulation experiments based on load scheduling in the HEMS are conducted. The results of the first optimization stage show that when the battery capacity integrated into the system increases from 3.68 kWh to 6.68 kWh, user costs can be reduced from 57.572 cents to 42.064 cents. It is not only evident that the proposed method can effectively save users on electricity costs, but the introduction of larger capacity batteries also lowers these costs. The second stage of load fluctuation optimization results show that the proposed method can effectively optimize the usage data of a group of users and decrease the absolute peak-valley difference by 8.8%.

The growing scale of electric vehicles (EVs) brings continuous challenges to the energy trading market. In the process of grid-connected charging of EVs, disorderly charging behavior of a large number of EVs will have a substantial impact on the grid load. Aiming to solve the problem of optimal scheduling for charging and discharging of EVs, this paper first establishes a model for the charging and discharging scheduling of EVs involving the grid, charging equipment, and EVs. Then, the established scheduling model is described as a partially observable Markov decision process (POMDP) in the multi-agent environment. This paper proposes an optimization objective that comprehensively considers various factors such as the cost of charging and discharging EVs, grid load stability, and user usage requirements. Finally, this paper introduces the long short-term memory enhanced multi-agent deep deterministic policy gra dient (LEMADDPG) algorithm to obtain the optimal scheduling strategy of EVs. Simulation results prove that the proposed LEMADDPG algorithm can obtain the fastest convergence speed, the smallest fluctuation and the highest cumulative reward compared with traditional deep deterministic policy gradient and DQN algorithms.

Demand response technologies can achieve the objective of optimizing resource allocation and ensuring efficient operation of the smart grid by motivating the energy users to change their power usage behavior. However, the increasing uncertainty of smart grid environment brings great challenges to the development of demand response technique. In this study, we build a long short-term memory (LSTM) network as a load forecasting model to predict user load data in order to obtain accurate consumption behavior of energy users. Then, we utilize a Stackelberg game model based on the load forecasting model to dynamically optimize the electricity prices set by power suppliers at different times, enhancing the efficiency of demand response between users and suppliers. Extensive simulation experiments demonstrate that the LSTM-based load forecasting model achieves an accuracy of up to 96.37% in predicting user load demand. And the game model reduces the overall expenditure of users by 30% compared with the general pricing model.

The smart grid, as a cyber-physical system, is vulnerable to attacks due to the diversified and open environment. The false data injection attack (FDIA) can threaten the grid security by constructing and injecting the falsified attack vector to bypass the system detection. Due to the diversity of attacks, it is impractical to detect FDIAs by fixed methods. This paper proposed a false data injection attack model and countering detection methods based on deep reinforcement learning (DRL). First, we studied an attack model under the assumption of unlimited attack resources and information of complete topology. Different types of FDIAs are also enumerated. Then, we formulated the attack detection problem as a Markov decision process (MDP). A deep reinforcement learning-based method is proposed to detect FDIAs with a combined dynamic-static detection mechanism. To address the sparse reward problem, experiences with discrepant rewards are stored in different replay buffers to achieve efficiency. Moreover, the state space is extended by considering the most recent states to improve the perception capability. Simulations were performed on IEEE 9,14,30, and 57-bus systems, proving the validation of attack model and efficiency of detection method. Results proved efficacy of the detection method in different scenarios.

With the green-oriented transition of energy, electric vehicles (EVs) are being developed rapidly to replace fuel vehicles. In the face of large-scale EV access to the grid, real-time and effective charging management has become a key problem. Considering the charging characteristics of different EVs, we propose a real-time scheduling framework for charging stations with an electric vehicle aggregator (EVA) as the decision-making body. However, with multiple optimization objectives, it is challenging to formulate a real-time strategy to ensure each participant’s interests. Moreover, the uncertainty of renewable energy generation and user demand makes it difficult to establish the optimization model. In this paper, we model charging scheduling as a Markov decision process (MDP) based on deep reinforcement learning (DRL) to avoid the afore-mentioned problems. With a continuous action space, the MDP model is solved by the twin delayed deep deterministic policy gradient algorithm (TD3). While ensuring the maximum benefit of the EVA, we also ensure minimal fluctuation in the microgrid exchange power. To verify the effectiveness of the proposed method, we set up two comparative experiments, using the disorder charging method and deep deterministic policy gradient (DDPG) method, respectively. The results show that the strategy obtained by TD3 is optimal, which can reduce power purchase cost by 10.9% and reduce power fluctuations by 69.4%.