Search

This paper examines mean field linear-quadratic-Gaussian (LQG) social optimum control with volatility-uncertain common noise. The diffusion terms in the dynamics of agents contain an unknown volatility process driven by a common noise. We apply a robust optimization approach in which all agents view volatility uncertainty as an adversarial player. Based on the principle of person-by-person optimality and a two-step-duality technique for stochastic variational analysis, we construct an auxiliary optimal control problem for a representative agent. Through solving this problem combined with a consistent mean field approximation, we design a set of decentralized strategies, which are further shown to be asymptotically social optimal by perturbation analysis.

The paper studies the open-loop saddle point and the open-loop lower and upper values, as well as their relationship for two-person zero-sum stochastic linear-quadratic (LQ, for short) differential games with deterministic coefficients. It derives a necessary condition for the finiteness of the open-loop lower and upper values and a sufficient condition for the existence of an open-loop saddle point. It turns out that under the sufficient condition, a strongly regular solution to the associated Riccati equation uniquely exists, in terms of which a closed-loop representation is further established for the open-loop saddle point. Examples are presented to show that the finiteness of the open-loop lower and upper values does not ensure the existence of an open-loop saddle point in general. But for the classical deterministic LQ game, these two issues are equivalent and both imply the solvability of the Riccati equation, for which an explicit representation of the solution is obtained., Comment: 26 pages

We introduce new parametrized classes of shape admissible domains in R^n , n $\ge$ 2, and prove that they are compact with respect to the convergence in the sense of characteristic functions, the Hausdorff sense, the sense of compacts and the weak convergence of their boundary volumes. The domains in these classes are bounded ($\epsilon$, $\infty$)-domains with possibly fractal boundaries that can have parts of any non-uniform Hausdorff dimension greater or equal to n -- 1 and less than n. We prove the existence of optimal shapes in such classes for maximum energy dissipation in the framework of linear acous-tics. A by-product of our proof is the result that the class of bounded ($\epsilon$, $\infty$)-domains with fixed $\epsilon$ is stable under Hausdorff convergence. An additional and related result is the Mosco convergence of Robin-type energy functionals on converging domains.

In statistical decision theory involving a single decision-maker, an information structure is said to be better than another one if for any cost function involving a hidden state variable and an action variable which is restricted to be conditionally independent from the state given some measurement, the solution value under the former is not worse than that under the latter. For finite spaces, a theorem due to Blackwell leads to a complete characterization on when one information structure is better than another. For stochastic games, in general, such an ordering is not possible since additional information can lead to equilibria perturbations with positive or negative values to a player. However, for zero-sum games in a finite probability space, P\k{e}ski introduced a complete characterization of ordering of information structures. In this paper, we obtain an infinite dimensional (standard Borel) generalization of P\k{e}ski's result. A corollary is that more information cannot hurt a decision maker taking part in a zero-sum game. We establish two supporting results which are essential and explicit though modest improvements on prior literature: (i) a partial converse to Blackwell's ordering in the standard Borel setup and (ii) an existence result for equilibria in zero-sum games with incomplete information., Comment: To appear in SIAM Journal on Control and Optimization. A short conference version appeared at the 2020 IEEE International Symposium on Information Theory

An optimal ergodic control problem (EC problem, for short) is investigated for a linear stochastic differential equation with quadratic cost functional. Constant nonhomogeneous terms, not all zero, appear in the state equation, which lead to the asymptotic limit of the state non-zero. Under the stabilizability condition, for any (admissible) closed-loop strategy, an invariant measure is proved to exist, which makes the ergodic cost functional well-defined and the EC problem well-formulated. Sufficient conditions, including those allowing the weighting matrices of cost functional to be indefinite, are introduced for finiteness and solvability for the EC problem. Some comparisons are made between the solvability of EC problem and the closed-loop solvability of stochastic linear quadratic optimal control problem in the infinite horizon. Regularized EC problem is introduced to be used to obtain the optimal value of the EC problem.

We introduce a mean field game model for pedestrians moving in a given domain and choosing their trajectories so as to minimize a cost including a penalization on the difference between their own velocity and that of the other agents they meet. We prove existence of an equilibrium in a Lagrangian setting by using its variational structure, and then study its properties and regularity.

International audience; We consider a continuous time stochastic optimal control problem under both equality and inequality constraints on the expectation of some functionals of the controlled process. Under a qualification condition, we show that the problem is in duality with an optimization problem involving the Lagrange multiplier associated with the constraints. Then by convex analysis techniques, we provide a general existence result and some a priori estimation of the dual optimizers. We further provide a necessary and sufficient optimality condition for the initial constrained control problem. The same results are also obtained for a discrete time constrained control problem. Moreover, under additional regularity conditions, it is proved that the discrete time control problem converges to the continuous time problem, possibly with a convergence rate. This convergence result can be used to obtain numerical algorithms to approximate the continuous time control problem, which we illustrate by two simple numerical examples.

Controlling the shape and position of moving and pinned droplets on a solid surface is an important feature often found in microfluidic applications. In this work, we consider a well investigated phase field model including contact line dynamics as the state system for an (open-loop) optimal control problem. Here the spatially and temporally changeable contact angles between droplet and solid are considered as the control variables. We consider a suitable, energy stable, time discrete version of the state equation in our optimal control problem. We discuss regularity of the solution to the time discrete state equation and its continuity and differentiability properties. Furthermore, we show existence of solutions and state first order optimality conditions to the optimal control problem. We illustrate our results by actively pushing a droplet uphill against gravity in an optimal way.

A linear control system with quadratic cost functional over infinite time horizon is considered without assuming controllability/stabilizability condition and the global integrability condition for the nonhomogeneous term of the state equation and the weight functions in the linear terms in the running cost rate function. Classical approaches do not apply for such kind of problems. Existence and non-existence of overtaking optimal controls in various cases are established. Some concrete examples are presented. These results show that the overtaking optimality approach can be used to solve some of the above-mentioned problems and at the same time, the limitation of this approach is also revealed.

We prove a small-gain theorem for interconnections of $n$ nonlinear heterogeneous input-to-state stable (ISS) control systems of a general nature, covering partial, delay and ordinary differential equations. Furthermore, for the same class of control systems, we derive small-gain theorems for asymptotic gain, uniform global stability and weak input-to-state stability properties. We show that our technique is applicable for different formulations of ISS property (summation, maximum, semimaximum) and discuss tightness of achieved small-gain theorems. Finally, we introduce variations of uniform asymptotic gain and uniform limit properties, which are particularly useful for small-gain arguments and characterize ISS in terms of these notions., Accepted to SICON, 2021

In this paper, we study an optimal control problem for a macroscopic mechanical tumour model based on the phase field approach. The model couples a Cahn--Hilliard type equation to a system of linear elasticity and a reaction-diffusion equation for a nutrient concentration. By taking advantage of previous analytical well-posedness results established by the authors, we seek optimal controls in the form of a boundary nutrient supply, as well as concentrations of cytotoxic and antiangiogenic drugs that minimise a cost functional involving mechanical stresses. Special attention is given to sparsity effects, where with the inclusion of convex non-differentiable regularisation terms to the cost functional, we can infer from the first-order optimality conditions that the optimal drug concentrations can vanish on certain time intervals., 26 pages

In this paper we establish an observability inequality for the heat equation with bounded potentials on the whole space. Roughly speaking, such a kind of inequality says that the total energy of solutions can be controlled by the energy localized in a subdomain, which is equidistributed over the whole space. The proof of this inequality is mainly adapted from the parabolic frequency function method, which plays an important role in proving the unique continuation property for solutions of parabolic equations. As an immediate application, we show that the null controllability holds for the heat equation with bounded potentials on the whole space., Comment: Welcome for any comment

We address the variational formulation of the risk-sensitive reward problem for non-degenerate diffusions on $\mathbb{R}^d$ controlled through the drift. We establish a variational formula on the whole space and also show that the risk-sensitive value equals the generalized principal eigenvalue of the semilinear operator. This can be viewed as a controlled version of the variational formulas for principal eigenvalues of diffusion operators arising in large deviations. We also revisit the average risk-sensitive minimization problem and by employing a gradient estimate developed in this paper, we extend earlier results to unbounded drifts and running costs., Comment: 29 pages

Let $X,Y$ be Banach spaces, $(S_t)_{t \geq 0}$ a $C_0$-semigroup on $X$, $-A$ the corresponding infinitesimal generator on $X$, $C$ a bounded linear operator from $X$ to $Y$, and $T > 0$. We consider the system \[ \dot{x}(t) = -Ax(t), \quad y(t) = Cx(t) \quad t\in (0,T], \quad x(0) = x_0 \in X. \] We provide sufficient conditions such that this system satisfies a final state observability estimate in $L_r ((0,T) ; Y)$, $r \in [1,\infty]$. These sufficient conditions are given by an uncertainty relation and a dissipation estimate. Our approach unifies and generalizes the respective advantages from earlier results obtained in the context of Hilbert spaces. As an application we consider the example where $A$ is an elliptic operator in $L_p(\mathbb{R}^d)$ for $1

In this article, the shape optimization of a linear elastic body subject to frictional (Tresca) contact is investigated. Due to the projection operators involved in the formulation of the contact problem, the solution is not shape differentiable in general. Moreover, shape optimization of the contact zone requires the computation of the gap between the bodies in contact, as well as its shape derivative. Working with directional derivatives, sufficient conditions for shape differentiability are derived. %The problem is addressed in the general framework of two bodies with smooth boundaries. Then, some numerical results, obtained with a gradient descent algorithm based on those shape derivatives, are presented., Comment: Preprint

We study the controlled dynamics of the {\it ensembles of points} of a Riemannian manifold $M$. Parameterized ensemble of points of $M$ is the image of a continuous map $\gamma:\Theta \to M$, where $\Theta$ is a compact set of parameters. The dynamics of ensembles is defined by the action $\gamma(\theta) \mapsto P_t(\gamma(\theta))$ of the semigroup of diffeomorphisms $P_t:M \to M, \ t \in \mathbb{R}$, generated by the controlled equation $\dot{x}=f(x,u(t))$ on $M$. Therefore any control system on $M$ defines a control system on (generally infinite-dimensional) space $\mathcal{E}_\Theta(M)$ of the ensembles of points. We wish to establish criteria of controllability for such control systems. As in our previous work ([1]) we seek to adapt the Lie-algebraic approach of geometric control theory to the infinite-dimensional setting. We study the case of finite ensembles and prove genericity of exact controllability property for them. We also find sufficient approximate controllability criterion for continual ensembles and prove a result on motion planning in the space of flows on $M$. We discuss the relation of the obtained controllability criteria to various versions of Rashevsky-Chow theorem for finite- and infinite-dimensional manifolds., Comment: 24 pages

In this paper, we establish spectral inequalities on measurable sets of positive Lebesgue measure for the Stokes operator, as well as an observability inequalities on space-time measurable sets of positive measure for non-stationary Stokes system. Furthermore, we provide their applications in the theory of shape optimization and time optimal control problems.

International audience; We are concerned with the design of Model Predictive Control (MPC) schemes such that asymptotic stability of the resulting closed loop is guaranteed even if the linearization at the desired set point fails to be stabilizable. Therefore, we propose to construct the stage cost based on the homogeneous approximation and rigorously show that applying MPC yields an asymp-totically stable closed-loop behavior if the homogeneous approximation is asymptotically null controllable. To this end, we verify cost controllability-a condition relating the current state, the stage cost, and the growth of the value function w.r.t. time-for this class of systems in order to provide stability and performance guarantees for the proposed MPC scheme without stabilizing terminal costs or constraints.

For sequential stochastic control problems with standard Borel measurement and control action spaces, we introduce a general (universally applicable) dynamic programming formulation, establish its well-posedness, and provide new existence results for optimal policies. Our dynamic program builds in part on Witsenhausen's standard form, but with a different formulation for the state, action, and transition dynamics. Using recent results on measurability properties of strategic measures in decentralized control, we obtain a standard Borel controlled Markov model. This allows for a well-defined dynamic programming recursion through universal measurability properties of the value functions for each time stage. In addition, new existence results are obtained for optimal policies in decentralized stochastic control. These state that for a static team with independent measurements, it suffices for the cost function to be continuous (only) in the actions for the existence of an optimal policy under mild compactness (or tightness) conditions. These also apply to dynamic teams which admit static reductions with independent measurements through a change of measure transformation. We show through a counterexample that weaker conditions may not lead to existence of an optimal team policy. The paper's existence results generalize those previously reported in the literature. A summary of and comparison with previously reported results and some applications are presented., To appear in SIAM Journal on Control and Optimization

We address the variational problem for the generalized principal eigenvalue on $\mathbb{R}^d$ of linear and semilinear elliptic operators associated with nondegenerate diffusions controlled through the drift. We establish the Collatz-Wielandt formula for potentials that vanish at infinity under minimal hypotheses, and also for general potentials under blanket geometric ergodicity assumptions. We also present associated results having the flavor of a refined maximum principle., Comment: 19 pages

In this paper we study a bilinear optimal control problem associated to a 3D chemo-repulsion model with linear production. We prove the existence of weak solutions and we establish a regularity criterion to get global in time strong solutions. As a consequence, we deduce the existence of a global optimal solution with bilinear control and, using a Lagrange multipliers theorem, we derive first-order optimality conditions for local optimal solutions., 41 pages. arXiv admin note: text overlap with arXiv:1806.10076

In this paper a priori error estimates are derived for full discretization (in space and time) of time-optimal control problems. Various convergence results for the optimal time and the control variable are proved under different assumptions. Especially the case of bang-bang controls is investigated. Numerical examples are provided to illustrate the results.

This paper studies Markov decision processes (MDPs) with atomless initial state distributions and atomless transition probabilities. Such MDPs are called atomless. The initial state distribution is considered to be fixed. We show that for discounted MDPs with bounded one-step reward vector-functions, for each policy there exists a deterministic (that is, nonrandomized and stationary) policy with the same performance vector. This fact is proved in the paper for a more general class of uniformly absorbing MDPs with expected total rewards, and then it is extended under certain assumptions to MDPs with unbounded rewards. For problems with multiple criteria and constraints, the results of this paper imply that for atomless MDPs studied in this paper it is sufficient to consider only deterministic policies, while without the atomless assumption it is well-known that randomized policies can outperform deterministic ones. We also provide an example of an MDP demonstrating that if a vector measure is defined on a standard Borel space, then Lyapunov's convexity theorem is a special case of the described results.

We study an infinite-horizon discrete-time optimal stopping problem under non-exponential discounting. A new method, which we call the iterative approach, is developed to find subgame perfect Nash equilibria. When the discount function induces decreasing impatience, we establish the existence of an equilibrium through fixed-point iterations. Moreover, we show that there exists a unique optimal equilibrium, which generates larger value than any other equilibrium does at all times. To the best of our knowledge, this is the first time a dominating subgame perfect Nash equilibrium is shown to exist in the literature of time-inconsistency.

We study Mean Field stochastic control problems where the cost function and the state dynamics depend upon the joint distribution of the controlled state and the control process. We prove suitable versions of the Pontryagin stochastic maximum principle, both in necessary and in sufficient form, which extend the known conditions to this general framework. Furthermore, we suggest a variational approach to study a weak formulation of these control problems. We show a natural connection between this weak formulation and optimal transport on path space, which inspires a novel discretization scheme., Comment: We changed the title, added an example, and suggest a discretization scheme

In a framework close to the one developed by Holmstr\"om and Milgrom [44], we study the optimal contracting scheme between a Principal and several Agents. Each hired Agent is in charge of one project, and can make efforts towards managing his own project, as well as impact (positively or negatively) the projects of the other Agents. Considering economic Agents in competition with relative performance concerns, we derive the optimal contracts in both first best and moral hazard settings. The enhanced resolution methodology relies heavily on the connection between Nash equilibria and multidimensional quadratic BSDEs. The optimal contracts are linear and each agent is paid a fixed proportion of the terminal value of all the projects of the firm. Besides, each Agent receives his reservation utility, and those with high competitive appetence are assigned less volatile projects, and shall even receive help from the other Agents. From the principal point of view, it is in the firm interest in our model to strongly diversify the competitive appetence of the Agents., Comment: 36 pages

In this paper, we design Dirichlet-Neumann boundary feedback controllers for the Korteweg-de Vries (KdV) equation that act at the right endpoint of the domain. The length of the domain is allowed to be critical. Constructing backstepping controllers that act at the right endpoint of the domain is more challenging than its left endpoint counterpart. The standard application of the backstepping method fails, because corresponding kernel models become overdetermined. In order to deal with this difficulty, we introduce the pseudo-backstepping method, which uses a pseudo-kernel that satisfies all but one desirable boundary condition. Moreover, various norms of the pseudo-kernel can be controlled through a parameter in one of its boundary conditions. We prove that the boundary controllers constructed via this pseudo-kernel still exponentially stabilize the system with the cost of a low exponential rate of decay. We show that a single Dirichlet controller is sufficient for exponential stabilization with a slower rate of decay. We also consider a second order feedback law acting at the right Dirichlet boundary condition. We show that this approach works if the main equation includes only the third order term, while the same problem remains open if the main equation involves the first order and/or the nonlinear term(s). At the end of the paper, we give numerical simulations to illustrate the main result., Comment: 23 pages, 11 figures, 1 table. In this version, an additional reference has been added and discussed within the text. Also some typos were corrected

Synchronization in networks of coupled oscillators is a widely studied topic with extensive scientific and engineering applications. In this paper, we study the frequency synchronization problem for networks of Kuramoto oscillators with arbitrary topology and heterogeneous edge weights. We propose a novel equivalent transcription for the equilibrium synchronization equation. Using this transcription, we develop a power series expansion to compute the synchronized solution of the Kuramoto model as well as a sufficient condition for the strong convergence of this series expansion. Truncating the power series provides (i) an efficient approximation scheme for computing the synchronized solution, and (ii) a simple-to-check, statistically-correct hierarchy of increasingly accurate synchronization tests. This hierarchy of tests provides a theoretical foundation for and generalizes the best-known approximate synchronization test in the literature. Our numerical experiments illustrate the accuracy and the computational efficiency of the truncated series approximation compared to existing iterative methods and existing synchronization tests.

S. Hansen and E. Zuazua [SIAM J. Cont. Optim., 1995] studied the problem of exact controllability of two strings connected by a point mass with constant physical coefficients. In this paper we study the same problem with variable physical coefficients. This system is generated by the following equations $$\rho(x) u_{tt}=(\sigma(x) u_{x})_{x}-q(x)u,~~~~x\in (-1,0)\cup (0,1),~t>0,$$ $$Mu_{tt}(0,t)+\sigma_{1}(0)u_{x}(0^{-},t)-\sigma_{2}(0)u_{x}(0^{+},t)=0,~~~t>0,$$ with Dirichlet boundary condition on the left end and a control acts on the right end. We prove that this system is exactly controllable in an asymmetric space for the control time $T> 2\int_{-1}^{1}(\frac{\rho(x)}{\sigma(x)})^{\frac{1}{2}}dx$. We establish the equivalence between a suitable asymmetric norm of the initial data and the $L^{2}(0,T)$-norm of $u_{x}(1,t)$. Our approach is mainly based on a detailed spectral analysis and the theory of divided differences. More precisely, we prove that the spectral gap tends to zero with a precise asymptotic estimate., Comment: 34pages and 0 figures

We propose an approximation scheme for a class of semilinear parabolic equations that are convex and coercive in their gradients. Such equations arise often in pricing and portfolio management in incomplete markets and, more broadly, are directly connected to the representation of solutions to backward stochastic differential equations. The proposed scheme is based on splitting the equation in two parts, the first corresponding to a linear parabolic equation and the second to a Hamilton-Jacobi equation. The solutions of these two equations are approximated using, respectively, the Feynman-Kac and the Hopf-Lax formulae. We establish the convergence of the scheme and determine the convergence rate, combining Krylov's shaking coefficients technique and Barles-Jakobsen's optimal switching approximation., Comment: 24 pages

We consider an infinite horizon optimal control problem for a continuous-time Markov chain $X$ in a finite set $I$ with noise-free partial observation. The observation process is defined as $Y_t = h(X_t)$, $t \geq 0$, where $h$ is a given map defined on $I$. The observation is noise-free in the sense that the only source of randomness is the process $X$ itself. The aim is to minimize a discounted cost functional and study the associated value function $V$. After transforming the control problem with partial observation into one with complete observation (the separated problem) using filtering equations, we provide a link between the value function $v$ associated with the latter control problem and the original value function $V$. Then, we present two different characterizations of $v$ (and indirectly of $V$): on one hand as the unique fixed point of a suitably defined contraction mapping and on the other hand as the unique constrained viscosity solution (in the sense of Soner) of a HJB integro-differential equation. Under suitable assumptions, we finally prove the existence of an optimal control

We consider a class of linear-quadratic-Gaussian mean-field games with a major agent and considerable heterogeneous minor agents in the presence of mean-field interactions. The individual admissible controls are constrained in closed convex subsets $\Gamma_{k}$ of $\mathbb{R}^{m}.$ The decentralized strategies for individual agents and consistency condition system are represented in an unified manner through a class of mean-field forward-backward stochastic differential equations involving projection operators on $\Gamma_{k}$. The well-posedness of consistency system is established in both the local and global cases by the contraction mapping and discounting method respectively. Related $\varepsilon-$Nash equilibrium property is also verified., Comment: 40 pages

With the development of robotics, there are growing needs for real time motion planning. However, due to obstacles in the environment, the planning problem is highly non-convex, which makes it difficult to achieve real time computation using existing non-convex optimization algorithms. This paper introduces the convex feasible set algorithm (CFS) which is a fast algorithm for non-convex optimization problems that have convex costs and non-convex constraints. The idea is to find a convex feasible set for the original problem and iteratively solve a sequence of subproblems using the convex constraints. The feasibility and the convergence of the proposed algorithm are proved in the paper. The application of this method on motion planning for mobile robots is discussed. The simulations demonstrate the effectiveness of the proposed algorithm., in SIAM Journal on Control and Optimization

This paper presents the equivalence between minimal time and minimal norm control problems for internally controlled heat equations. The target is an arbitrarily fixed bounded, closed and convex set with a nonempty interior in the state space. This study differs from [G. Wang and E. Zuazua, \textit{On the equivalence of minimal time and minimal norm controls for internally controlled heat equations}, SIAM J. Control Optim., 50 (2012), pp. 2938-2958] where the target set is the origin in the state space. When the target set is the origin or a ball, centered at the origin, the minimal norm and the minimal time functions are continuous and strictly decreasing, and they are inverses of each other. However, when the target is located in other place of the state space, the minimal norm function may be no longer monotonous and the range of the minimal time function may not be connected. These cause the main difficulty in our study. We overcome this difficulty by borrowing some idea from the classical raising sun lemma (see, for instance, Lemma 3.5 and Figure 5 on Pages 121-122 in [E. M. Stein and R. Shakarchi, \textit{Real Analysis: Measure Theory, Integration, and Hilbert Spaces}, Princeton University Press, 2005]).

In this paper we study the fully nonlinear stochastic Hamilton-Jacobi-Bellman (HJB) equation for the optimal stochastic control problem of stochastic differential equations with random coefficients. The notion of viscosity solution is introduced, and we prove that the value function of the optimal stochastic control problem is the maximal viscosity solution of the associated stochastic HJB equation. For the superparabolic cases when the diffusion coefficients are deterministic functions of time, states and controls, the uniqueness is addressed as well., Comment: 24 pages

For a zero-sum stochastic game which does not satisfy the Isaacs condition, we provide a value function representation for an Isaacs-type equation whose Hamiltonian lies in between the lower and upper Hamiltonians, as a convex combination of the two. For the general case (i.e. the convex combination is time and state dependent) our representation amounts to a random change of the rules of the game, to allow each player at any moment to see the other player's action or not, according to a coin toss with probabilities of heads and tails given by the convex combination appearing in the PDE. If the combination is state independent, then the rules can be set all in advance, in a deterministic way. This means that tossing the coin along the game, or tossing it repeatedly right at the beginning leads to the same value. The representations are asymptotic, over time discretizations. Space discretization is possible as well, leading to similar results., Comment: Preliminary version

We study the optimal control of general stochastic McKean-Vlasov equation. Such problem is motivated originally from the asymptotic formulation of cooperative equilibrium for a large population of particles (players) in mean-field interaction under common noise. Our first main result is to state a dynamic programming principle for the value function in the Wasserstein space of probability measures, which is proved from a flow property of the conditional law of the controlled state process. Next, by relying on the notion of differentiability with respect to probability measures due to P.L. Lions [32], and It{\^o}'s formula along a flow of conditional measures, we derive the dynamic programming Hamilton-Jacobi-Bellman equation, and prove the viscosity property together with a uniqueness result for the value function. Finally, we solve explicitly the linear-quadratic stochastic McKean-Vlasov control problem and give an application to an interbank systemic risk model with common noise., Comment: 33 pages, to appear in SIAM Journal on Control and Optimization

We construct two error feedback controllers for robust output tracking and disturbance rejection of a regular linear system with nonsmooth reference and disturbance signals. We show that for sufficiently smooth signals the output converges to the reference at a rate that depends on the behaviour of the transfer function of the plant on the imaginary axis. In addition, we construct a controller that can be designed to achieve robustness with respect to a given class of uncertainties in the system, and present a novel controller structure for output tracking and disturbance rejection without the robustness requirement. We also generalize the internal model principle for regular linear systems with boundary disturbance and for controllers with unbounded input and output operators. The construction of controllers is illustrated with an example where we consider output tracking of a nonsmooth periodic reference signal for a two-dimensional heat equation with boundary control and observation, and with periodic disturbances on the boundary., Comment: 30 pages, 3 figures, to appear in SIAM Journal on Control & Optimization

A time-inconsistent stochastic optimal control problem with a recursive cost functional is studied. Equilibrium strategy is introduced, which is time-consistent and locally approximately optimal. By means of multiperson hierarchical differential games associated with partitions of the time interval, a family of approximate equilibrium strategy is constructed, and by sending the mesh size of the time interval partition to zero, an equilibrium Hamilton--Jacobi--Bellman (HJB) equation is derived through which the equilibrium value function can be identified and the equilibrium strategy can be obtained. Moreover, a well-posedness result of the equilibrium HJB equation is established under certain conditions, and a verification theorem is proved. Finally, an illustrative example is presented, and some comparisons of different definitions of equilibrium strategy are put in order.

This paper is the second part of our series of work to establish pointwise second-order necessary conditions for stochastic optimal controls. In this part, we consider the general cases, i.e., the control region is allowed to be nonconvex, and the control variable enters into both the drift and the diffusion terms of the control systems. By introducing four variational equations and four adjoint equations, we obtain the desired necessary conditions for stochastic singular optimal controls in the sense of Pontryagin-type maximum principle., Comment: 49 pages

The paper deals with a problem of control of a system characterized by the fact that the influence of controls on the dynamics of certain functions of state variables (called observables) is relatively weak and the rates of change of these observables are much slower than the rates of change of the state variables themselves. The contributions of the paper are twofold. Firstly, the averaged system whose solutions approximate the trajectories of the slow observables is introduced, and it is shown that the optimal value of the problem of optimal control with time discounting criterion considered on the solutions of the system with slow observables (this problem is referred to as perturbed) converges to the optimal value of the corresponding problem of optimal control of the averaged system. Secondly, a way how an asymptotically optimal control of the perturbed problem can be constructed on the basis of an optimal solution of the averaged problem is indicated, sufficient and necessary optimality conditions for the averaged problem are stated, and a way how a near optimal solution of the latter can be constructed numerically is outlined (the construction being illustrated with an example)., 40 pages, 4 figures

Motivated by a control problem of a certain queueing network we consider a control problem where the dynamics is constrained in the nonnegative orthant $\mathbb{R}_+$ of the $d$-dimensional Euclidean space and controlled by the reflections at the faces/boundaries. We define a discounted value function associated to this problem and show that the value function is a viscosity solution to a certain HJB equation in $\mathbb{R}_+$ with nonlinear Neumann type boundary condition. Under certain conditions, we also characterize this value function as the unique solution to this HJB equation., Comment: 32 pages, To appear in SICON

A new approach to solving two-point boundary value problems for a wave equation is developed. This new approach exploits the principle of stationary action to reformulate and solve such problems in the framework of optimal control. In particular, an infinite dimensional optimal control problem is posed so that the wave equation dynamics and temporal boundary data of interest are captured via the characteristics of the associated Hamiltonian and choice of terminal payoff respectively. In order to solve this optimal control problem for any such terminal payoff, and hence solve any two-point boundary value problem corresponding to the boundary data encapsulated by that terminal payoff, a fundamental solution to the optimal control problem is constructed. Specifically, the optimal control problem corresponding to any given terminal payoff can be solved via a max-plus convolution of this fundamental solution with the specified terminal payoff. Crucially, the fundamental solution is shown to be a quadratic functional that is defined with respect to the unique solution of a set of operator differential equations, and computable using spectral methods. An example is presented in which this fundamental solution is computed and applied to solve a two-point boundary value problem for the wave equation of interest., 30 pages, 5 figures, journal version submitted January 2015

For 1-D parabolic PDEs with disturbances at both boundaries and distributed disturbances we provide ISS estimates in various norms. Due to the lack of an ISS Lyapunov functional for boundary disturbances, the proof methodology uses (i) an eigenfunction expansion of the solution, and (ii) a finite-difference scheme. The ISS estimate for the sup-norm leads to a refinement of the well-known maximum principle for the heat equation. Finally, the obtained results are applied to quasi-static thermoelasticity models that involve nonlocal boundary conditions. Small-gain conditions that guarantee the global exponential stability of the zero solution for such models are derived., 32 pages, submitted to SIAM Journal on Control and Optimization for possible publication

For the minimization of a nonlinear cost functional $j$ under convex constraints the relaxed projected gradient process $\varphi_{k+1} = \varphi_{k} + \alpha_k(P_H(\varphi_{k}-\lambda_k \nabla_H j(\varphi_{k}))-\varphi_{k})$ is a well known method. The analysis is classically performed in a Hilbert space $H$. We generalize this method to functionals $j$ which are differentiable in a Banach space. Thus it is possible to perform e.g. an $L^2$ gradient method if $j$ is only differentiable in $L^\infty$. We show global convergence using Armijo backtracking in $\alpha_k$ and allow the inner product and the scaling $\lambda_k$ to change in every iteration. As application we present a structural topology optimization problem based on a phase field model, where the reduced cost functional $j$ is differentiable in $H^1\cap L^\infty$. The presented numerical results using the $H^1$ inner product and a pointwise chosen metric including second order information show the expected mesh independency in the iteration numbers. The latter yields an additional, drastic decrease in iteration numbers as well as in computation time. Moreover we present numerical results using a BFGS update of the $H^1$ inner product for further optimization problems based on phase field models.

We study a class of mean-field stochastic differential equations driven by a fractional Brownian motion with Hurst parameter $H\in(1/2,1)$ and a related stochastic control problem. We derive a Pontryagin type maximum principle and the associated adjoint mean-field backward stochastic differential equation driven by a classical Brownian motion, and we prove that under certain assumptions, which generalise the classical ones, the necessary condition for the optimality of an admissible control is also sufficient., Comment: 34 pages

We introduce a data-driven order reduction method for nonlinear control systems, drawing on recent progress in machine learning and statistical dimensionality reduction. The method rests on the assumption that the nonlinear system behaves linearly when lifted into a high (or infinite) dimensional feature space where balanced truncation may be carried out implicitly. This leads to a nonlinear reduction map which can be combined with a representation of the system belonging to a reproducing kernel Hilbert space to give a closed, reduced order dynamical system which captures the essential input-output characteristics of the original model. Empirical simulations illustrating the approach are also provided., Rewritten to improve readability. arXiv admin note: text overlap with arXiv:1011.2952

We revisit a stochastic control problem of optimally modifying the underlying spectrally negative Levy process. A strategy must be absolutely continuous with respect to the Lebesgue measure, and the objective is to minimize the total costs of the running and controlling costs. Under the assumption that the running cost function is convex, we show the optimality of a refraction strategy. We also obtain the convergence of the optimal refraction strategies and the value functions, as the control set is enlarged, to those in the relaxed case without the absolutely continuous assumption. Numerical results are further given to confirm these analytical results., Comment: Forthcoming in SIAM Journal on Control and Optimization

International audience; We consider the optimal control problem of minimizing some quadratic functional over all possible solutions of an internally controlled multi-dimensional heat equation with a periodic terminal state constraint. This problem has a unique optimal solution, which can be characterized by an optimality system derived from the Pontryagin maximum principle. We define two approximations of this optimal control problem. The first one is an impulse approximation, and consists of considering a system of linear heat equations with impulse control. The second one is obtained by the sample-and-hold procedure applied to the control, resulting into a sampled-data approximation of the controlled heat equation. We prove that both problems have a unique optimal solution, and we establish precise error estimates for the optimal controls and optimal states of the initial problem with respect to its impulse and sampled-data approximations.

This paper is concerned with a stochastic linear quadratic (LQ, for short) optimal control problem. The notions of open-loop and closed-loop solvabilities are introduced. A simple example shows that these two solvabilities are different. Closed-loop solvability is established by means of solvability of the corresponding Riccati equation, which is implied by the uniform convexity of the quadratic cost functional. Conditions ensuring the convexity of the cost functional are discussed, including the issue that how negative the control weighting matrix-valued function R(s) can be. Finiteness of the LQ problem is characterized by the convergence of the solutions to a family of Riccati equations. Then, a minimizing sequence, whose convergence is equivalent to the open-loop solvability of the problem, is constructed. Finally, an illustrative example is presented., Comment: 40 pages