Search

We study N-player finite games with costs perturbed due to time-varying disturbances in the underlying system and to that end we propose the concept of Robust Correlated Equilibrium that generalizes the definition of Correlated Equilibrium. Conditions under which the Robust Correlated Equilibrium exists are specified and a decentralized algorithm for learning strategies that are optimal in the sense of Robust Correlated Equilibrium is proposed. The primary contribution of the paper is the convergence analysis of the algorithm and to that end, we propose an extension of the celebrated Blackwell's Approachability theorem to games with costs that are not just time-average as in the original Blackwell's Approachability Theorem but also include time-average of previous algorithm iterates. The designed algorithm is applied to a practical water distribution network with pumps being the controllers and their costs being perturbed by uncertain consumption by consumers. Simulation results show that each controller achieves no regret and empirical distributions converge to the Robust Correlated Equilibrium., Comment: Preprint submitted to Automatica

© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, Many traditional control solutions in urban drainage networks suffer from unmodelled nonlinear effects such as rain and wastewater infiltrating the system. These effects are challenging and often too complex to capture through physical modelling without using a high number of flow sensors. In this article, we use level sensors and design a stochastic model predictive controller by combining nominal dynamics (hydraulics) with unknown nonlinearities (hydrology) modelled as Gaussian processes. The Gaussian process model provides residual uncertainties trained via the level measurements and captures the effect of the hydrologic load and the transport dynamics in the network. To show the practical effectiveness of the approach, we present the improvement of the closed-loop control performance on an experimental laboratory setup using real rain and wastewater flow data., Peer Reviewed, Postprint (author's final draft)

© 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting /republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works, Real-time control (RTC) of urban drainage networks (UDNs) is a complex task where transport flows are non-pressurized and therefore impose flow-dependent time delays in the system. Unfortunately, the installation of flow sensors is economically out of reach at most utilities, although knowing volumes and flows are essential to optimize system operation. In this article, we formulate joint parameter and state estimation based on level sensors deployed inside manholes and basins in the network. We describe the flow dynamics on the main pipelines by the level variations inside manholes, characterized by a system of coupled partial differential equations (PDEs). These dynamics are approximated with kinematic waves where the network model is established with the water levels being the system states. Moving horizon estimation (MHE) is developed where the states and parameters are obtained via the levels and estimated flow data, utilizing the topological layout of the network. The obtained model complexity is kept within practically achievable limits, suitable for nonlinear predictive control. The effectiveness of the control and estimation method is demonstrated on a high-fidelity model of a drainage network, acting as virtual reality. We use real rain and wastewater flow data and test the controller against the uncertainty in the disturbance forecasts., Peer Reviewed, Postprint (author's final draft)