Search

We introduce and analyze a new finite-difference scheme, relying on the theta-method, for solving monotone second-order mean field games. These games consist of a coupled system of the Fokker-Planck and the Hamilton-Jacobi-Bellman equation. The theta-method is used for discretizing the diffusion terms: we approximate them with a convex combination of an implicit and an explicit term. On contrast, we use an explicit centered scheme for the first-order terms. Assuming that the running cost is strongly convex and regular, we first prove the monotonicity and the stability of our theta-scheme, under a CFL condition. Taking advantage of the regularity of the solution of the continuous problem, we estimate the consistency error of the theta-scheme. Our main result is a convergence rate of order $\mathcal{O}(h^r)$ for the theta-scheme, where $h$ is the step length of the space variable and $r \in (0,1)$ is related to the H\"older continuity of the solution of the continuous problem and some of its derivatives., Comment: 35 pages

We address a large-scale and nonconvex optimization problem, involving an aggregative term. This term can be interpreted as the sum of the contributions of N agents to some common good, with N large. We investigate a relaxation of this problem, obtained by randomization. The relaxation gap is proved to converge to zeros as N goes to infinity, independently of the dimension of the aggregate. We propose a stochastic method to construct an approximate minimizer of the original problem, given an approximate solution of the randomized problem. McDiarmid's concentration inequality is used to quantify the probability of success of the method. We consider the Frank-Wolfe (FW) algorithm for the resolution of the randomized problem. Each iteration of the algorithm requires to solve a subproblem which can be decomposed into N independent optimization problems. A sublinear convergence rate is obtained for the FW algorithm. In order to handle the memory overflow problem possibly caused by the FW algorithm, we propose a stochastic Frank-Wolfe (SFW) algorithm, which ensures the convergence in both expectation and probability senses. Numerical experiments on a mixed-integer quadratic program illustrate the efficiency of the method., Comment: 33 pages, 3 figures

We apply the generalized conditional gradient algorithm to potential mean field games and we show its well-posedeness. It turns out that this method can be interpreted as a learning method called fictitious play. More precisely, each step of the generalized conditional gradient method amounts to compute the best-response of the representative agent, for a predicted value of the coupling terms of the game. We show that for the learning sequence $\delta_k = 2/(k+2)$, the potential cost converges in $O(1/k)$, the exploitability and the variables of the problem (distribution, congestion, price, value function and control terms) converge in $O(1/\sqrt{k})$, for specific norms.

We propose and investigate a general class of discrete time and finite state space mean field game (MFG) problems with potential structure. Our model incorporates interactions through a congestion term and a price variable. It also allows hard constraints on the distribution of the agents. We analyze the connection between the MFG problem and two optimal control problems in duality. We present two families of numerical methods and detail their implementation: (i) primal-dual proximal methods (and their extension with nonlinear proximity operators), (ii) the alternating direction method of multipliers (ADMM) and a variant called ADM-G. We give some convergence results. Numerical results are provided for two examples with hard constraints.

We consider the framework of convex high dimensional stochastic control problems, in which the controls are aggregated in the cost function. As first contribution, we introduce a modified problem, whose optimal control is under some reasonable assumptions an $\varepsilon$-optimal solution of the original problem. As second contribution, we present a decentralized algorithm whose convergence to the solution of the modified problem is established. Finally, we study the application of the developed tools in an engineering context, studying a coordination problem for large populations of domestic thermostatically controlled loads (TCLs), Comment: 24 pages

We propose and investigate a discrete-time mean field game model involving risk-averse agents. The model under study is a coupled system of dynamic programming equations with a Kolmogorov equation. The agents' risk aversion is modeled by composite risk measures. The existence of a solution to the coupled system is obtained with a fixed point approach. The corresponding feedback control allows to construct an approximate Nash equilibrium for a related dynamic game with finitely many players., Comment: 26 pages

In this paper we consider an optimal control problem governed by a semilinear heat equation with bilinear control-state terms and subject to control and state constraints. The state constraints are of integral type, the integral being with respect to the space variable. The control is multidimensional. The cost functional is of a tracking type and contains a linear term in the control variables. We derive second order sufficient conditions relying on the Goh transform. The appendix provides an example illustrating the applicability of our results., Comment: This is the second part of a work on optimality conditions for a control problem of a semilinear heat equation. More precisely, the full version, available arXiv:1906.00237, has been divided in two, resulting in arXiv:1906.00237v2 (that corresponds to Part I) and the current manuscript (which is Part II)

In this paper we consider an optimal control problem governed by a semilinear heat equation with bilinear control-state terms and subject to control and state constraints. The state constraints are of integral type, the integral being with respect to the space variable. The control is multidimensional. The cost functional is of a tracking type and contains a linear term in the control variables. We derive second order necessary conditions relying on the concept of alternative costates and quasi-radial critical directions. The appendix provides an example illustrating the applicability of our results., Comment: This is the first part of a work on optimality conditions for a control problem of a semilinear heat equation. More precisely, the full version, available at arXiv:1906.00237v1, has been divided in two, resulting in the current manuscript (that corresponds to Part I) and arXiv:1909.05056 (which is Part II)

An existence result for a class of mean field games of controls is provided. In the considered model, the cost functional to be minimized by each agent involves a price depending at a given time on the controls of all agents and a congestion term. The existence of a classical solution is demonstrated with the Leray-Schauder theorem; the proof relies in particular on a priori bounds for the solution, which are obtained with the help of a potential formulation of the problem.

In this article we propose a shooting algorithm for a class of optimal control problems for which all control variables appear linearly. The shooting system has, in the general case, more equations than unknowns and the Gauss-Newton method is used to compute a zero of the shooting function. This shooting algorithm is locally quadratically convergent if the derivative of the shooting function is one-to-one at the solution. The main result of this paper is to show that the latter holds whenever a sufficient condition for weak optimality is satisfied. We note that this condition is very close to a second order necessary condition. For the case when the shooting system can be reduced to one having the same number of unknowns and equations (square system) we prove that the mentioned sufficient condition guarantees the stability of the optimal solution under small perturbations and the invertibility of the Jacobian matrix of the shooting function associated to the perturbed problem. We present numerical tests that validate our method., Comment: No. RR-7763 (2011); Journal of Optimization, Theory and Applications, published as 'Online first', January 2013

This paper deals with optimal control problems of integral equations, with initial-final and running state constraints. The order of a running state constraint is defined in the setting of integral dynamics, and we work here with constraints of arbitrary high orders. First and second-order necessary conditions of optimality are obtained, as well as second-order sufficient conditions.

This work presents a stochastic dynamic programming (SDP) algorithm that aims at minimizing an economic criteria based on the total energy consumption of a range extender electric vehicle (REEV). This algorithm integrates information from the REEV's navigation system in order to obtain some information about future expected vehicle speed. The model of the vehicle's energetic system, which consists of a high-voltage (HV) battery, the main energy source, and an internal combustion engine (ICE), working as an auxiliary energy source), is written as a hybrid dynamical system and the associated optimization problem in the hybrid optimal control framework. The hybrid optimal control problem includes two important physical constraints on the ICE, namely, an activation delay and a decision lag. Three methods for the inclusion of such physical constraints are studied. After introducing the SDP algorithm formulation we comment on numerical results of the stochastic algorithm and its deterministic counterpart.

This paper deals with optimal control problems for systems affine in the control variable. We consider nonnegativity constraints on the control, and finitely many equality and inequality constraints on the final state. First, we obtain second order necessary optimality conditions. Secondly, we derive a second order sufficient condition for the scalar control case., Comment: 41 pages