Search

This paper is devoted to the problem of indefinite stochastic linear quadratic (LQ) optimal control by piecewise constant controls in an infinite horizon case. By restricting the set of admissible controls to the class of piecewise constant stochastic processes, we reformulated the above control problem under the setting of systems modeled by Itô differential equations controlled by impulses. We show that the solution in a state feedback form of the indefinite stochastic LQ control problem is equivalent to the existence of a global stabilizing solution associated to a class of backward matrix linear differential equations with a Riccati type jumping operators. [ABSTRACT FROM AUTHOR]

In this paper, we solve a stochastic linear quadratic tracking problem. The controlled dynamical system is modeled by a system of linear Itô differential equations subject to jump Markov perturbations. We consider the case when there are two decision-makers and each of them wants to minimize the deviation of a preferential output of the controlled dynamical system from a given reference signal. We assume that the two decision-makers do not cooperate. Under these conditions, we state the considered tracking problem as a problem of finding a Nash equilibrium strategy for a stochastic differential game. Explicit formulae of a Nash equilibrium strategy are provided. To this end, we use the solutions of two given terminal value problems (TVPs). The first TVP is associated with a hybrid system formed by two backward nonlinear differential equations coupled by two algebraic nonlinear equations. The second TVP is associated with a hybrid system formed by two backward linear differential equations coupled by two algebraic linear equations. [ABSTRACT FROM AUTHOR]

We investigate a problem to solve the linear quadratic tracking problem for stochastic systems controlled by impulses. Two optimal control problems are investigated where the different objective functions are minimized. Explicit formulae for optimal controls are developed. The optimal controllers are computed based on the solution of the backward jump matrix Lyapunov type linear differential equations. [ABSTRACT FROM AUTHOR]

An optimal control problem for a system of linear Itô differential equations with two fast time scales and Markovian jumping is considered. The asymptotic structure for the stabilizing solution satisfying a sign condition for the coupled stochastic algebraic Riccati equations is derived. Furthermore, a near optimal control whose gain matrices do not depend upon small parameters is discussed. [ABSTRACT FROM AUTHOR]

This paper considers two general concepts of dichotomy for noninvertible and nonautonomous linear discrete-time systems in Banach spaces. These concepts use two types of dichotomy projections sequences (invariant and strongly invariant) and generalize some well-known dichotomy concepts (uniform, nonuniform, exponential, and polynomial). In the particular case of strongly invariant dichotomy projections, we present characterizations of these sequences and connections with other dichotomy concepts existent in the literature. Some illustrative examples clarify the implications between these concepts. [ABSTRACT FROM AUTHOR]

The problem of sampled-data Nash equilibrium strategy in a state feedback setting for a stochastic linear quadratic differential game is addressed. It is assumed that the admissible strategies are constant on the interval between two measurements. The original problem is converted into an equivalent one for a linear stochastic system with finite jumps. This new formulation of the problem allows us to derive necessary and sufficient conditions for the existence of a sampled-data Nash equilibrium strategy in a state feedback form. These conditions are expressed in terms of solvability of a system of interconnected matrix linear differential equations with finite jumps and subject to some algebraic constraints. We provide explicit formulae of the gain matrices of the Nash equilibrium strategy in the class of piece-wise constant strategies in a state feedback form. The gain matrices of the feedback Nash equilibrium strategy are computed based on the solution of the considered system of matrix linear differential equations with finite jumps. For the implementation of these strategies only measurements at discrete-time instances of the states of the dynamical system are required. Finally, we show that under some additional assumptions regarding the sign of the weights matrices in the performance criteria of the two players, there exists a unique piecewise Nash equilibrium strategy in a state feedback form if the maximal length of the sampling period is sufficiently small. [ABSTRACT FROM AUTHOR]