Search

This chapter provides an overview of deep learning techniques for improving the spatial resolution of MRI, ranging from convolutional neural networks, generative adversarial networks, to more advanced models including transformers, diffusion models, and implicit neural representations. Our exploration extends beyond the methodologies to scrutinize the impact of super-resolved images on clinical and neuroscientific assessments. We also cover various practical topics such as network architectures, image evaluation metrics, network loss functions, and training data specifics, including downsampling methods for simulating low-resolution images and dataset selection. Finally, we discuss existing challenges and potential future directions regarding the feasibility and reliability of deep learning-based MRI super-resolution, with the aim to facilitate its wider adoption to benefit various clinical and neuroscientific applications., Comment: A book chapter in Machine Learning in MRI: From methods to clinical translation

This paper introduces the design and implementation of PyOptInterface, a modeling language for mathematical optimization embedded in Python programming language. PyOptInterface uses lightweight and compact data structure to bridge high-level entities in optimization models like variables and constraints to internal indices of optimizers efficiently. It supports a variety of optimization solvers and a range of common problem classes. We provide benchmarks to exhibit the competitive performance of PyOptInterface compared with other state-of-the-art modeling languages., Comment: 10 pages

Regulating the proper carbon-aware intervention policy is one of the keys to emission alleviation in the distribution network, whose basis lies in effectively attributing the emission responsibility using emission factors. This paper establishes the distribution locational marginal emission (DLME) to calculate the marginal change of emission from the marginal change of both active and reactive load demand for incentivizing carbon alleviation. It first formulates the day-head distribution network scheduling model based on the second-order cone program (SOCP). The emission propagation and responsibility are analyzed from demand to supply to system emission. Considering the complex and implicit mapping of the SOCP-based scheduling model, the implicit theorem is leveraged to exploit the optimal condition of SOCP. The corresponding SOCP-based implicit derivation approach is proposed to calculate the DLMEs effectively in a model-based way. Comprehensive numerical studies are conducted to verify the superiority of the proposed method by comparing its calculation efficacy to the conventional marginal estimation approach, assessing its effectiveness in carbon alleviation with comparison to the average emission factors, and evaluating its carbon alleviation ability of reactive DLME.

3D multi-slab acquisitions are an appealing approach for diffusion MRI because they are compatible with the imaging regime delivering optimal SNR efficiency. In conventional 3D multi-slab imaging, shot-to-shot phase variations caused by motion pose challenges due to the use of multi-shot k-space acquisition. Navigator acquisition after each imaging echo is typically employed to correct phase variations, which prolongs scan time and increases the specific absorption rate (SAR). The aim of this study is to develop a highly efficient, self-navigated method to correct for phase variations in 3D multi-slab diffusion MRI without explicitly acquiring navigators. The sampling of each shot is carefully designed to intersect with the central kz plane of each slab, and the multi-shot sampling is optimized for self-navigation performance while retaining decent reconstruction quality. The central kz intersections from all shots are jointly used to reconstruct a 2D phase map for each shot using a structured low-rank constrained reconstruction that leverages the redundancy in shot and coil dimensions. The phase maps are used to eliminate the shot-to-shot phase inconsistency in the final 3D multi-shot reconstruction. We demonstrate the method's efficacy using retrospective simulations and prospectively acquired in-vivo experiments at 1.22 mm and 1.09 mm isotropic resolutions. Compared to conventional navigated 3D multi-slab imaging, the proposed self-navigated method achieves comparable image quality while shortening the scan time by 31.7% and improving the SNR efficiency by 15.5%. The proposed method produces comparable quality of DTI and white matter tractography to conventional navigated 3D multi-slab acquisition with a much shorter scan time., Comment: 10 pages, 11 figures, 2 tables. This work has been submitted to the IEEE for possible publication

In this paper, the intra-day multi-interval rolling-window joint dispatch and pricing of energy and reserve is studied under increasing volatile and uncertain renewable generations. A look-ahead energy-reserve co-optimization model is proposed for the rolling-window dispatch, where possible contingencies and load/renewable forecast errors over the look-ahead window are modeled as several scenario trajectories, while generation, especially its ramp, is jointly scheduled with reserve to minimize the expected system cost considering these scenarios. Based on the proposed model, marginal prices of energy and reserve are derived, which incorporate shadow prices of generators' individual ramping capability limits to eliminate their possible ramping-induced opportunity costs or arbitrages. We prove that under mild conditions, the proposed market design provides dispatch-following incentives to generators without the need for out-of-the-market uplifts, and truthful-bidding incentives of price-taking generators can be guaranteed as well. Some discussions are also made on how to fit the proposed framework into current market practice. These findings are validated in numerical simulations.

The development of energy conversion techniques enhances the coupling between the gas network and power system. However, challenges remain in the joint optimal dispatch of electricity-gas systems. The dynamic model of the gas network, described by partial differential equations, is complex and computationally demanding for power system operators. Furthermore, information privacy concerns and limited accessibility to detailed gas network models by power system operators necessitate quantifying the equivalent energy storage capacity of gas networks. This paper proposes a multi-port energy storage model with time-varying capacity to represent the dynamic gas state transformation and operational constraints in a compact and intuitive form. The model can be easily integrated into the optimal dispatch problem of the power system. Test cases demonstrate that the proposed model ensures feasible control strategies and significantly reduces the computational burden while maintaining high accuracy in the joint optimal dispatch of electricity-gas systems. In contrast, the existing static equivalent model fails to capture the full flexibility of the gas network and may yield infeasible results., Comment: 12 pages, 8 figures

Prediction plays a vital role in the active distribution network voltage regulation under the high penetration of photovoltaics. Current prediction models aim at minimizing individual prediction errors but overlook their collective impacts on downstream decision-making. Hence, this paper proposes a safety-aware semi-end-to-end coordinated decision model to bridge the gap from the downstream voltage regulation to the upstream multiple prediction models in a coordinated differential way. The semi-end-to-end model maps the input features to the optimal var decisions via prediction, decision-making, and decision-evaluating layers. It leverages the neural network and the second-order cone program (SOCP) to formulate the stochastic PV/load predictions and the var decision-making/evaluating separately. Then the var decision quality is evaluated via the weighted sum of the power loss for economy and the voltage violation penalty for safety, denoted by regulation loss. Based on the regulation loss and prediction errors, this paper proposes the hybrid loss and hybrid stochastic gradient descent algorithm to back-propagate the gradients of the hybrid loss with respect to multiple predictions for enhancing decision quality. Case studies verify the effectiveness of the proposed model with lower power loss for economy and lower voltage violation rate for safety awareness.

Storage-concerned Optimal Power Flow (OPF) with complementarity constraints is highly non-convex and intractable. In this paper, we propose two generalized sufficient conditions which guarantee no simultaneous charging and discharging (SCD) in the relaxed multi-period OPF excluding the complementarity constraints. Moreover, we prove that the regions on the locational marginal prices (LMPs) formed by the proposed two conditions both contain the other existing representative ones. We also generalize the application premise of sufficient conditions from the positive electricity price requirements to the negative electricity price scenarios. In contrast to participating solely in the energy dispatch, we highlight that offering reserve services can broaden the application range of relaxation conditions for storages. The case studies verify the exactness and advantages of the proposed conditions.

Purpose: This study aims to propose a model-based reconstruction algorithm for simultaneous multi-slab diffusion MRI acquired with blipped-CAIPI gradients (blipped-SMSlab), which can also incorporate distortion correction. Methods: We formulate blipped-SMSlab in a 4D k-space with kz gradients for the intra-slab slice encoding and km (blipped-CAIPI) gradients for the inter-slab encoding. Because kz and km gradients share the same physical axis, the blipped-CAIPI gradients introduce phase interference in the z-km domain while motion induces phase variations in the kz-m domain. Thus, our previous k-space-based reconstruction would need multiple steps to transform data back and forth between k-space and image space for phase correction. Here we propose a model-based hybrid-space reconstruction algorithm to correct the phase errors simultaneously. Moreover, the proposed algorithm is combined with distortion correction, and jointly reconstructs data acquired with the blip-up/down acquisition to reduce the g-factor penalty. Results: The blipped-CAIPI-induced phase interference is corrected by the hybrid-space reconstruction. Blipped-CAIPI can reduce the g-factor penalty compared to the non-blipped acquisition in the basic reconstruction. Additionally, the joint reconstruction simultaneously corrects the image distortions and improves the 1/g-factors by around 50%. Furthermore, through the joint reconstruction, SMSlab acquisitions without the blipped-CAIPI gradients also show comparable correction performance with blipped-SMSlab. Conclusion: The proposed model-based hybrid-space reconstruction can reconstruct blipped-SMSlab diffusion MRI successfully. Its extension to a joint reconstruction of the blip-up/down acquisition can correct EPI distortions and further reduce the g-factor penalty compared with the separate reconstruction., Comment: 10 figures+tables, 8 supplementary figures

With numerous distributed energy resources (DERs) integrated into the distribution networks (DNs), the coordinated economic dispatch (C-ED) is essential for the integrated transmission and distribution grids. For large scale power grids, the centralized C-ED meets high computational burden and information privacy issues. To tackle these issues, this paper proposes a spatio-temporal decomposition algorithm to solve the C-ED in a distributed and parallel manner. In the temporal dimension, the multi-period economic dispatch (ED) of transmission grid (TG) is decomposed to several subproblems by introducing auxiliary variables and overlapping time intervals to deal with the temporal coupling constraints. Besides, an accelerated alternative direction method of multipliers (A-ADMM) based temporal decomposition algorithm with the warm-start strategy, is developed to solve the ED subproblems of TG in parallel. In the spatial dimension, a multi-parametric programming projection based spatial decomposition algorithm is developed to coordinate the ED problems of TG and DNs in a distributed manner. To further improve the convergence performance of the spatial decomposition algorithm, the aggregate equivalence approach is used for determining the feasible range of boundary variables of TG and DNs. Moreover, we prove that the proposed spatio-temporal decomposition method can obtain the optimal solution for bilevel convex optimization problems with continuously differentiable objectives and constraints. Numerical tests are conducted on three systems with different scales, demonstrating the high computational efficiency and scalability of the proposed spatio-temporal decomposition method.

The main goal of distribution network (DN) expansion planning is essentially to achieve minimal investment constrained with specified reliability requirements. The reliability-constrained distribution network planning (RcDNP) problem can be cast an instance of mixed-integer linear programming (MILP) which involves ultra-heavy computation burden especially for large scale DNs. In this paper, we propose a parallel computing-based acceleration algorithm for solve RcDNP problem. The RcDNP is decomposed into a backbone grid and several lateral grid problems with coordination. Then a parallelizable augmented Lagrangian algorithm with acceleration strategy is developed to solve the coordination planning problems. In this method, the lateral grid problems are solved in parallel through coordinating with the backbone grid planning problem. To address the presence of nonconvexity, Gauss-Seidel iteration is adopted on the convex hull of the feasible region constructed by the decomposition method. Under mild conditions, the optimality and convergence of this algorithm is proven. The numerical tests show the proposed method can significantly reduce the computation time and make the RcDNP applicable for real-world problems.

The issues of uncertainty and frequency security could become significantly serious in power systems with the high penetration of volatile inverter-based renewables (IBRs). These issues make it necessary to consider the uncertainty and frequency-related constraints in the economic dispatch (ED) programs. However, existing ED studies rarely proactively optimize the control parameters of inverter-based resources related to fast regulation (e.g., virtual inertia and droop coefficients) in cooperation with other dispatchable resources to improve the system frequency security and dispatch reliability. This paper first proposes a joint chance-constrained economic dispatch model that jointly optimizes the frequency-related inverter control, the system up/down reserves, and base-point power for the minimal total operational cost. In the proposed model, multiple dispatchable resources including thermal units, dispatchable IBRs and energy storage are considered, and the (virtual) inertias, the regulation reserve allocations and the base-point power are coordinated. To ensure the system reliability, the joint chance-constraint formulation is also adopted. Additionally, since the traditional sample average approximation (SAA) method cost much computational burden, a novel mix-SAA (MSAA) method is proposed to transform the original intractable model into a linear model that can be efficiently solved via commercial solvers. The case studies validated the satisfactory efficacy of the proposed ED model and the efficiency of the MSAA.

To stabilize the frequency of the renewable energy sources (RESs) dominated power system, frequency supports are required by RESs through virtual inertia emulation or droop control in the newly published grid codes. Since the long-term RES prediction involves significant errors, we need online configure the frequency control parameters of RESs in a rolling manner to improve the operation economics under the premise of stabilizing system frequency. To address this concern, this paper proposes a frequency constrained stochastic look-ahead power dispatch (FCS-LAPD) model to formulate the frequency control parameters of RESs and Energy Storage Systems (ESSs) as scheduling variables, which can optimally allocate the virtual inertia and droop coefficient of RESs and ESSs. In this FCS-LAPD model, the uncertainties of RESs are characterized using Gaussian Mixture Model (GMM). The required reserves are determined by frequency control parameters, and the reserve cost coefficients are adjusted properly to allocate the reserves according to the predicted power generation. Due to the nonlinearity of the frequency nadir constraint, a convex hull approximation method is proposed to linearize it with guaranteed feasibility. The proposed FCS-LAPD is ultimately cast as an instance of quadratic programming and can be efficiently solved. Case studies on modified IEEE 24-bus system and a provincial power system in China are conducted to show the effectiveness of the proposed model.

Integrated energy systems (IESs), in which various energy flows are interconnected and coordinated to release potential flexibility for more efficient and secure operation, have drawn increasing attention in recent years. In this article, an integrated energy management system (IEMS) that performs online analysis and optimization on coupling energy flows in an IES is comprehensively introduced. From the theory perspective, an energy circuit method (ECM) that models natural gas networks and heating networks in the frequency domain is discussed. This method extends the electric circuit modeling of power systems to IESs and enables the IEMS to manage large-scale IESs. From the implementation perspective, the architecture design and function development of the IEMS are presented. Tutorial examples with illustrative case studies are provided to demonstrate its functions of dynamic state estimation, energy flow analysis, security assessment and control, and optimal energy flow. From the application perspective, real-world engineering demonstrations that apply IEMSs in managing building-scale, park-scale, and city-scale IESs are reported. The economic and environmental benefits obtained in these demonstration projects indicate that the IEMS has broad application prospects for a low/zero-carbon future energy system.

With more energy networks being interconnected to form integrated energy systems (IESs), the optimal energy flow (OEF) problem has drawn increasing attention. Extant studies on OEF models mostly utilize the finite difference method (FDM) to address partial-differential-equation (PDE) constraints related to the dynamics in natural gas networks (NGNs) and district heating networks (DHNs). However, this time-domain approach suffers from a heavy computational burden with regard to achieving high finite-difference accuracy. In this paper, a novel OEF model that formulates NGN and DHN constraints in the frequency domain and corresponding model compaction techniques for efficient solving are contributed. First, an energy circuit method (ECM) that algebraizes the PDEs of NGNs and DHNs in the frequency domain is introduced. Then, an ECM-based OEF model is formulated, which contains fewer variables and constraints than an FDM-based OEF model and thereby yields better solving efficiency. Finally, variable space projection is employed to remove implicit variables, by which another constraint generation algorithm is enabled to remove redundant constraints. These two techniques further compact the OEF model and bring about a second improvement in solving efficiency. Numerical tests on actual systems indicate the final OEF model reduces variables and constraints by more than 95% and improves the solving efficiency by more than 10 times. In conclusion, the proposed OEF model and solving techniques well meet the optimization needs of large-scale IESs.

In [1], a single-period co-optimization model of energy and reserve is considered to better illustrate the properties of the co-optimization model and the associated market mechanism. To make the discussion more general, in this paper, the single-period co-optimization model (II) in [1] will be extended into a one-shot multi-period co-optimization model, where the coupling of ramping and reserve in multi-period operations will be considered. Also, the multi-period pricing approach and settlement process associated with the multi-period co-optimization model will be discussed. In addition, in case study, the average system total costs of the proposed multi-period model and the multi-period traditional model are compared, and the effectiveness of some market properties in multi-period operation is tested., Comment: 2 figures

We consider some crucial problems related to the secure and reliable operation of power systems with high renewable penetrations: how much reserve should we procure, how should reserve resources distribute among different locations, and how should we price reserve and charge uncertainty sources. These issues have so far been largely addressed empirically. In this paper, we first develop a scenario-oriented energy-reserve co-optimization model, which directly connects reserve procurement with possible outages and load/renewable power fluctuations without the need for empirical reserve requirements. Accordingly, reserve can be optimally procured system-wide to handle all possible future uncertainties with the minimum expected system total cost. Based on the proposed model, marginal pricing approaches are developed for energy and reserve, respectively. Locational uniform pricing is established for energy, and the similar property is also established for the combination of reserve and re-dispatch. In addition, properties of cost recovery for generators and revenue adequacy for the system operator are also proven., Comment: 12 pages, 6 figures

In Volt/Var control (VVC) of active distribution networks(ADNs), both slow timescale discrete devices (STDDs) and fast timescale continuous devices (FTCDs) are involved. The STDDs such as on-load tap changers (OLTC) and FTCDs such as distributed generators should be coordinated in time sequence. Such VCC is formulated as a two-timescale optimization problem to jointly optimize FTCDs and STDDs in ADNs. Traditional optimization methods are heavily based on accurate models of the system, but sometimes impractical because of their unaffordable effort on modelling. In this paper, a novel bi-level off-policy reinforcement learning (RL) algorithm is proposed to solve this problem in a model-free manner. A Bi-level Markov decision process (BMDP) is defined to describe the two-timescale VVC problem and separate agents are set up for the slow and fast timescale sub-problems. For the fast timescale sub-problem, we adopt an off-policy RL method soft actor-critic with high sample efficiency. For the slow one, we develop an off-policy multi-discrete soft actor-critic (MDSAC) algorithm to address the curse of dimensionality with various STDDs. To mitigate the non-stationary issue existing the two agents' learning processes, we propose a multi-timescale off-policy correction (MTOPC) method by adopting importance sampling technique. Comprehensive numerical studies not only demonstrate that the proposed method can achieve stable and satisfactory optimization of both STDDs and FTCDs without any model information, but also support that the proposed method outperforms existing two-timescale VVC methods., Comment: 10 pages, 8 figures

As wind power penetration increases, the wind farms are required by newly released grid codes to provide frequency regulation service. The most critical challenge is how to formulate the dynamic model of wind farm for dynamic control, since it is essentially is nonlinear and there are huge amount of parameters to be maintained frequently. This paper proposes a data-driven model predictive control (data-driven MPC) method to make wind farms participate primary frequency regulation. In this method,a specialized dynamic mode decomposition (SDMD) algorithm is developed, which can linearly approximate the dynamics of wind farm from measurements based on Koopman operator theory.Compared with the existing extended dynamic mode decomposition (EDMD) method,this tailored SDMD has two advantages: 1) fully capturing the nonlinear transients of wind turbine dynamics with good accuracy under a wide range of working conditions; 2) much less computational burden with model dimensionality reduction. Based on the recursively updated linear dynamic model, a model predictive control solution is implemented. The simulation results show this model-free solution can dynamically optimize wind turbine generators' active power to track the frequency response requirement from system operator and minimize the rotor speed distortion.

We propose a scenario-oriented approach for energy-reserve joint procurement and pricing for electricity market. In this model, without the empirical reserve requirements, reserve is procured according to all possible contingencies and load/renewable generation fluctuations with the minimum expected system total cost. The innovative locational marginal pricing approach for loads, generations and reserve and the associated settlement process are proposed. We show that payments from loads, payments to generators and congestion rent will reach their balance in the basecase as well as in all scenarios, so that revenue adequacy can be guaranteed for the system operator.

For active distribution networks (ADNs) integrated with massive inverter-based energy resources, it is impractical to maintain the accurate model and deploy measurements at all nodes due to the large-scale of ADNs. Thus, current models of ADNs are usually involving significant errors or even unknown. Moreover, ADNs are usually partially observable since only a few measurements are available at pilot nodes or nodes with significant users. To provide a practical Volt/Var control (VVC) strategy for such networks, a data-driven VVC method is proposed in this paper. Firstly, the system response policy, approximating the relationship between the control variables and states of monitoring nodes, is estimated by a recursive regression closed-form solution. Then, based on real-time measurements and the newly updated system response policy, a VVC strategy with convergence guarantee is realized. Since the recursive regression solution is embedded in the control stage, a data-driven closed-loop VVC framework is established. The effectiveness of the proposed method is validated in an unbalanced distribution system considering nonlinear loads where not only the rapid and self-adaptive voltage regulation is realized but also system-wide optimization is achieved., Comment: accepted by CSEE Journal of Power and Energy Systems and published in June 2021

In this paper, a novel quadratic convex optimal power flow model, namely, MDOPF, is proposed to determine the optimal dispatches of distributed generators. Based on the results of MDOPF, two price mechanisms, distribution locational marginal price (DLMP) and distribution locational price (DLP), are analyzed. For DLMP, an explicit method is developed to calculate the marginal loss that does not require a backward/forward sweep algorithm and thus reduces the computational complexity. However, the marginal loss component in DLMP will cause over-collection of losses (OCL). To address this issue, DLP is defined, which contains two components, the energy cost component and loss component, where the loss component is determined by the proposed loss allocation method (LAM). Numerical tests show that the proposed MDOPF has a better accuracy than existing OPF models based on linear power flow equations. In addition, the proposed marginal loss method and DLMP algorithm have satisfactory accuracy compared with benchmarks provided by ACOPF, and the proposed DLP can eliminate OCL.

Multilevel, multiarea, and hierarchically interconnected electrical power grids confront substantial challenges with the increasing integration of many volatile energy resources. The traditional isolated operation of interconnected power grids is uneconomical due to a lack of coordination; it may result in severe accidents that affect operational safety. However, the centralized operation of interconnected power grids is impractical, considering the operational independence and information privacy of each power grid. This paper proposes a nested decomposition method for the coordinated operation of hierarchical electrical power grids, which can achieve global optimization by iterating among upper- and lower-level power grids with exchange of boundary information alone. During each iteration, a projection function, which embodies the optimal objective value of a lower-level power grid projected onto its boundary variable space, is computed with second-order exactness. Thus, the proposed method can be applied widely to nonlinear continuous optimizations and can converge much more rapidly than existing decomposition methods. We conducted numerical tests of coordinated operation examples with a trilevel power grid that demonstrate the validity and performance of the proposed method., Comment: 27 pages

This paper presents a cold-start linear branch flow model named modified DistFlow. In modified DistFlow, the active and reactive power are replaced by their ratios to voltage magnitude as state variables, so that errors introduced by conventional branch flow linearization approaches due to their complete ignoring of the quadratic term are reduced. Based on the path-branch incidence matrix, branch power flows and nodal voltage magnitudes can be obtained in a non-iterative and explicit manner. Subsequently, the proposed modified DistFlow model is applied to the problem of reactive power optimization and network reconfiguration, transforming it into a mixed-integer quadratic programming (MIQP). Simulations show that the proposed modified DistFlow has a better accuracy than existing cold-start linear branch flow models for distribution networks, and the resulting MIQP model for reactive power optimization and network reconfiguration is much more computationally efficient than existing benchmarks.

To manage huge amount of flexible distributed energy resources (DERs) in the distribution networks, the virtual power plant (VPP) is introduced in industry. The VPP can optimally dispatch these resources in a cluster way and provide flexibility for the power system operation as a whole. Most existing works formulate the equivalent power flexibility of the aggregating DERs as deterministic optimization models without considering their uncertainties. In this paper, we introduce the stochastic power flexibility range (PFR) to describe the power flexibility of VPP, which is formulated as a chance constrained optimization model. In this model, both operational constraints and the randomness of DERs' output are incorporated, and a combined model and data-driven solution is proposed to obtain the stochastic PFR and cost function of VPP. Finally, numerical tests are conducted to verify the correctness and efficiency of the proposed method., Comment: 9 pages, 6 figures

The distributed Volt/Var control (VVC) methods have been widely studied for active distribution networks(ADNs), which is based on perfect model and real-time P2P communication. However, the model is always incomplete with significant parameter errors and such P2P communication system is hard to maintain. In this paper, we propose an online multi-agent reinforcement learning and decentralized control framework (OLDC) for VVC. In this framework, the VVC problem is formulated as a constrained Markov game and we propose a novel multi-agent constrained soft actor-critic (MACSAC) reinforcement learning algorithm. MACSAC is used to train the control agents online, so the accurate ADN model is no longer needed. Then, the trained agents can realize decentralized optimal control using local measurements without real-time P2P communication. The OLDC with MACSAC has shown extraordinary flexibility, efficiency and robustness to various computing and communication conditions. Numerical simulations on IEEE test cases not only demonstrate that the proposed MACSAC outperforms the state-of-art learning algorithms, but also support the superiority of our OLDC framework in the online application., Comment: 11 pages; submitted to IEEE Transaction on Smart Grid on 2020.6.4

Model-based Vol/VAR optimization method is widely used to eliminate voltage violations and reduce network losses. However, the parameters of active distribution networks(ADNs) are not onsite identified, so significant errors may be involved in the model and make the model-based method infeasible. To cope with this critical issue, we propose a novel two-stage deep reinforcement learning (DRL) method to improve the voltage profile by regulating inverter-based energy resources, which consists of offline stage and online stage. In the offline stage, a highly efficient adversarial reinforcement learning algorithm is developed to train an offline agent robust to the model mismatch. In the sequential online stage, we transfer the offline agent safely as the online agent to perform continuous learning and controlling online with significantly improved safety and efficiency. Numerical simulations on IEEE test cases not only demonstrate that the proposed adversarial reinforcement learning algorithm outperforms the state-of-art algorithm, but also show that our proposed two-stage method achieves much better performance than the existing DRL based methods in the online application., Comment: 8 pages

State estimation (SE) of distribution networks heavily relies on pseudo measurements that introduce significant errors, since real-time measurements are insufficient. Interval SE models are regularly used, where true values of system states are supposed to be within the estimated ranges. However, conventional interval SE algorithms cannot consider the correlations of same interval variables in different terms of constraints, which results in overly conservative estimation results. In this paper, we propose a Linear Programming (LP) Contractor algorithm that uses a relative distance measure (RDM) interval operation to solve this problem. In the proposed model, measurement errors are assumed to be bounded into given sets, thus converting the state variables to RDM variables. In this case, the SE model is a non-convex model, and the solution credibility cannot be guaranteed. Therefore, each nonlinear measurement equation in the model is transformed into dual inequality linear equations using the mean value theorem. The SE model is finally reformulated as a linear programming contractor that iteratively narrows the upper and lower bounds of the system state variables. Numerical tests on IEEE three-phase distribution networks show that the proposed method outperforms the conventional interval-constrained propagation, modified Krawczyk-operator and optimization based interval SE methods.

Since distribution system operator (DSO) cannot directly control prosumers with controllable resources,this paper proposes an optimal dispatch method of using three-phase distribution locational marginal prices (DLMPs) as effective economic signals to incentivize prosumers' behaviors. In the proposed three-phase DLMP model, DLMPs for both active power and reactive power are calculated. To alleviate the imbalance, congestions and voltage violations in active distribution networks (ADNs),the DSO and prosumers should be coordinated. We develop such a coordinated control scheme for the DSO and prosumers,in which the DSO generates and broadcasts three-phase DLMPs as price signals to induce prosumers' behaviors. We prove that given the DLMPs for active power and reactive power as settlement prices, the optimal dispatch of the ADN will also maximize the surplus of prosumers. Therefore, the power output of rational prosumers will match the optimal dispatch,resulting in better operational conditions of ADNs. Then the three-phase imbalance,congestions and voltage violations will be well reduced. Numerical tests demonstrate the effectiveness of the proposed approach.

The dynamic dispatch (DD) of battery energy storage systems (BESSs) in microgrids integrated with volatile energy resources is essentially a multiperiod stochastic optimization problem (MSOP). Because the life span of a BESS is significantly affected by its charging and discharging behaviors, its lifecycle degradation costs should be incorporated into the DD model of BESSs, which makes it non-convex. In general, this MSOP is intractable. To solve this problem, we propose a reinforcement learning (RL) solution augmented with Monte-Carlo tree search (MCTS) and domain knowledge expressed as dispatching rules. In this solution, the Q-learning with function approximation is employed as the basic learning architecture that allows multistep bootstrapping and continuous policy learning. To improve the computation efficiency of randomized multistep simulations, we employed the MCTS to estimate the expected maximum action values. Moreover, we embedded a few dispatching rules in RL as probabilistic logics to reduce infeasible action explorations, which can improve the quality of the data-driven solution. Numerical test results show the proposed algorithm outperforms other baseline RL algorithms in all cases tested.

To capture the stochastic characteristics of renewable energy generation output, the chance-constrained unit commitment (CCUC) model is widely used. Conventionally, analytical solution for CCUC is usually based on simplified probability assumption or neglecting some operational constraints, otherwise scenar-io-based methods are used to approximate probability with heavy computation burden. In this paper, Gaussian mixture model (GMM) is employed to characterize the correlation between wind farms and probability distribution of their forecast errors. In our model, chance constraints including reserve sufficiency and branch power flow bounds are ensured to be satisfied with pre-determined probability. To solve this CCUC problem, we propose a Newton method based procedure to acquire the quantiles and transform chance constraints into deterministic constraints. Therefore, the CCUC model is efficiently solved as a mixed-integer quadratic programming problem. Numerical tests are performed on several systems to illustrate efficiency and scalability of the proposed method.

Real-time power dispatch (RTD) can coordinate wind farms, automatic generation control (AGC) units and non AGC units. In RTD, the probable wind power forecast errors (WPFE) should be appropriately formulated to ensure system security with high probability and minimize operational cost. Previous studies and our onsite tests show that Cauchy distribution (CD) effectively fits the leptokurtic feature of small timescale WPFE distributions. In this paper, we propose a chance-constrained real time dispatch (CCRTD) model with the WPFE represented by CD. Since the CD is stable and has promising mathematical characteristics, the proposed CCRTD model can be analytically transformed to a convex optimization problem considering the dependence among wind farms outputs. Moreover, the proposed model incorporates an affine control strategy compatible with AGC systems. This strategy makes the CCRTD adaptively take into account both the additional power ramping requirement and power variation on transmission lines caused by WPFE in RTD stage. Numerical test results show that the proposed method is reliable and effective. Meanwhile it is very efficient and suitable for real-time application.

Human thinking requires the brain to understand the meaning of language expression and to properly organize the thoughts flow using the language. However, current natural language processing models are primarily limited in the word probability estimation. Here, we proposed a Language guided imagination (LGI) network to incrementally learn the meaning and usage of numerous words and syntaxes, aiming to form a human-like machine thinking process. LGI contains three subsystems: (1) vision system that contains an encoder to disentangle the input or imagined scenarios into abstract population representations, and an imagination decoder to reconstruct imagined scenario from higher level representations; (2) Language system, that contains a binarizer to transfer symbol texts into binary vectors, an IPS (mimicking the human IntraParietal Sulcus, implemented by an LSTM) to extract the quantity information from the input texts, and a textizer to convert binary vectors into text symbols; (3) a PFC (mimicking the human PreFrontal Cortex, implemented by an LSTM) to combine inputs of both language and vision representations, and predict text symbols and manipulated images accordingly. LGI has incrementally learned eight different syntaxes (or tasks), with which a machine thinking loop has been formed and validated by the proper interaction between language and vision system. The paper provides a new architecture to let the machine learn, understand and use language in a human-like way that could ultimately enable a machine to construct fictitious 'mental' scenario and possess intelligence.

Currently, most district heating networks are running in a heat-setting mode, limiting the adjustment of the electrical power of combined heat and power (CHP) units. By considering the electrical power system (EPS) and district heating system (DHS) together, the peak regulatory capability of CHP units can be improved and renewable energy accommodation can be promoted. In this paper, a tractable integrated heat and electricity dispatch (IHED) model is described that addresses the thermal dynamic characteristics of pipelines and buildings to increase flexibility. To deal with the complexity of the optimization model, a water mass method (WMM) for pipeline thermal dynamics is proposed. Benefiting from the WMM, the proposed IHED model is an ordinary, non-linear model. An iterative algorithm based on the generalized Benders decomposition, and a sequential approach combined with the iterative algorithm and IPOPT, are proposed to solve the IHED model. Compared with a steady state model without thermal dynamics, considering the thermal dynamic characteristics in the DHS can further expand the peak regulatory capabilities of CHP units. The WMM is tested in the thermal dynamic simulations compared to an existing node method and a commercial simulation software. And the proposed solution strategy is verified in a small-scale system and a practical system. The simulation results of case studies are discussed to demonstrate the feasibility and economy of the dispatch model proposed here.

To settle a large-scale integration of renewable distributed generations (DGs), it requires to assess the maximal DG hosting capacity of active distribution networks (ADNs). For fully exploiting the ability of ADNs to accommodate DG, this paper proposes a robust comprehensive DG capacity assessment method considering three-phase power flow modelling and active network management (ANM) techniques. The two-stage adjustable robust optimization is employed to tackle the uncertainties of load demands and DG outputs. With our method, system planners can obtain the maximum penetration level of DGs with their optimal sizing and sitting decisions. Meanwhile, the robust optimal ANM schemes can be generated for each operation time period, including network reconfiguration, on-load-tap-changers regulation, and reactive power compensation. In addition, a three-step optimization algorithm is proposed to enhance the accuracy of DG capacity assessment results. The optimality and robustness of our method are validated via numerical tests on an unbalanced IEEE 33-bus distribution system.

Convex relaxation methods have been studied and used extensively to obtain an optimal solution to the optimal power flow (OPF) problem. Meanwhile, convex relaxed power flow equations are also prerequisites for efficiently solving a wide range of problems in power systems including mixed-integer nonlinear programming (MINLP) and distributed optimization. When the exactness of convex relaxations is not guaranteed, it is important to recover a feasible solution for the convex relaxation methods. This paper presents an alternative convex optimization (ACP) approach that can efficiently recover a feasible solution from the result of second-order cone programming (SOCP) relaxed OPF in mesh networks. The OPF problem is first formulated as a difference-of-convex (DC) programming problem, then efficiently solved by a penalty convex concave procedure (CCP). CCP iteratively linearizes the concave parts of the power flow constraints and solves a convex approximation of the DCP problem. Numerical tests show that the proposed method can find a global or near-global optimal solution to the AC OPF problem, and outperforms those semidefinite programming (SDP) based algorithms., Comment: 8 pages

As a typical approach of demand response (DR), direct load control (DLC) enables load service entity (LSE) to adjust electricity usage of home-end customers for peak shaving during DLC event. Households are connected in low voltage distribution networks, which is three phase unbalanced. However, existing works have not considered the network constraints and operational constraints of three phase unbalanced distribution systems, thus may ending up with decisions that deviate from reality or even infeasible in real world. This paper proposes residential DLC considering associated constraints of three phase unbalanced distribution networks. Numerical tests on a modified IEEE benchmark system demonstrate the effectiveness of the method., Comment: accepted by 2017 PES general meeting