Search

We consider optimal control problems for a system governed by a stochastic differential equation driven by a d-dimensional Brownian motion where both the drift and the diffusion coefficient are controlled. It is well known that without additional convexity conditions the strict control problem does not admit an optimal control. To overcome this difficulty, we consider the relaxed model, in which admissible controls are measure-valued processes and the relaxed state process is governed by a stochastic differential equation driven by a continuous orthogonal martingale measure. This relaxed model admits an optimal control that can be approximated by a sequence of strict controls by the so-called chattering lemma. We establish optimality necessary conditions, in terms of two adjoint processes, extending Peng's maximum principle to relaxed control problems. We show that relaxing the drift and diffusion martingale parts directly as in deterministic control does not lead to a true relaxed model as the obtained controlled dynamics is not continuous in the control variable. [ABSTRACT FROM AUTHOR]

This paper focuses on a stochastic goodwill model involving a single manufacturer and a single retailer in a supply chain, in which both quality level and goodwill level are governed by stochastic differential equations. In both the linear-quadratic Stackelberg game and linear-quadratic cooperative game, explicit expressions are obtained for the optimal quality improvement efforts level of the manufacturer, the optimal advertising efforts level of the retailer as well as the optimal profit of the supply chain. We also derive the expectation and variance values for quality and goodwill levels, respectively. The distribution of incremental profit and subsidy are analysed in the cooperative game via the utility theory. Finally, several numerical experiments are reported to show the influence of decay rates and white noise disturbance of the quality and goodwill levels on the expectation of quality and goodwill levels. [ABSTRACT FROM AUTHOR]

A controlled discrete-time stochastic process is proposed as a model for the state of a machine. In the proposed model, normal and random wear of the machine are considered. The random wear of the machine during a time unit can be either a discrete or a continuous random variable. The objective is to find a control policy that maximises the profits generated by the machine over its useful lifetime. In this problem, the optimiser must decide whether to do or not to do the maintenance work on the machine at each time unit. The significance of the paper is that the final time in the optimal control problem is a random variable denoting the first time the machine must be replaced. To obtain the optimal control, one can try to solve the dynamic programming equation, which reduces to a difference or an integral equation, satisfied by the value function. Finally, particular cases are solved exactly, or approximately, and explicitly to demonstrate and validate the proposed model. [ABSTRACT FROM AUTHOR]

We present a pair of adjoint optimal control problems characterizing a class of time-symmetric stochastic processes defined on random time intervals. The associated PDEs are of free-boundary type. The particularity of our approach is that it involves two adjoint optimal stopping times adapted to a pair of filtrations, the traditional increasing one and another, decreasing. They are the keys of the time symmetry of the construction, which can be regarded as a generalization of 'Schrödinger's problem' (1931–1932) to space-time domains. The relation with the notion of 'Hidden diffusions' is also described. [ABSTRACT FROM AUTHOR]

This paper analyzes the limiting behavior of stochastic linear-quadratic optimal control problems in finite time-horizon [0, T] as T → ∞. The so-called turnpike properties are established for such problems, under stabilizability condition which is weaker than the controllability, normally imposed in the similar problem for ordinary differential systems. In dealing with the turnpike problem, a crucial issue is to determine the corresponding static optimization problem. Intuitively mimicking the deterministic situations, it seems to be natural to include both the drift and the diffusion expressions of the state equation to be zero as constraints in the static optimization problem. However, this would lead us to a wrong direction. It is found that the correct static problem should contain the diffusion as a part of the objective function, which reveals a deep feature of the stochastic turnpike problem. [ABSTRACT FROM AUTHOR]

In this paper we study optimal trading strategies in a financial market in which stock returns depend on a hidden Gaussian mean reverting drift process. Investors obtain information on that drift by observing stock returns. Moreover, expert opinions in the form of signals about the current state of the drift arriving at fixed and known dates are included in the analysis. Drift estimates are based on Kalman filter techniques. They are used to transform a power utility maximization problem under partial information into an optimization problem under full information where the state variable is the filter of the drift. The dynamic programming equation for this problem is studied and closed-form solutions for the value function and the optimal trading strategy of an investor are derived. They allow to quantify the monetary value of information delivered by the expert opinions. We illustrate our theoretical findings by results of extensive numerical experiments. [ABSTRACT FROM AUTHOR]

We consider an investor that trades continuously and wants to liquidate an initial asset position within a prescribed time interval. As a consequence of his trading activity, during the execution of the liquidation order, the investor has no guarantees that the placed order is executed immediately; it may go unfilled, partially filled or filled in excess. The uncertainty in the execution affects the trading activity of the investor and the asset share price dynamics generating additional sources of noise: the execution risk and the price impact risk, respectively. Assuming the two sources of noise correlated and driven by the cumulative effect of the investor trading strategy, we study the problem of finding the optimal liquidation strategy adopted by the investor in order to maximize the expected revenue resulting from the liquidation. The mathematical model of the liquidation problem presented here extends the model of Almgren and Chriss [Optimal execution of portfolio transactions. J. Risk, 2000, 3(2), 5–39] to include execution and price impact risks. The liquidation problem is modeled as a linear quadratic stochastic optimal control problem with the finite horizon and, under some assumptions about the functional form for the magnitude of execution and price impact risks, is solved explicitly. The derived solution coincides with the optimal trading strategy obtained in the absence of execution uncertainty for an asset price with a modified growth rate. This suggests that the uncertainty in the execution modifies the directional view of the investor about the future growth rate of the asset price. [ABSTRACT FROM AUTHOR]

This paper is to establish a sufficient maximum principle for one kind of stochastic optimal control problem with three types of delays: a discrete delay, a moving-average delay and a noisy memory. The main features of this research include the introduction of a unified adjoint equation and a simple method to get the adjoint process. One kind of optimal consumption problem and its special cases are studied as illustrative examples, for which the adjoint equations are solved with two different approaches and the optimal consumption strategies are obtained. [ABSTRACT FROM AUTHOR]

This article is devoted to studying the topological structure of a solution set for Clarke subdifferential type fractional non-instantaneous impulsive differential inclusion driven by Poisson jumps. Initially, for proving the solvability result, we use a nonlinear alternative of Leray–Schauder fixed point theorem, Gronwall inequality, stochastic analysis, a measure of noncompactness, and the multivalued analysis. Furthermore, the mild solution set for the proposed problem is demonstrated with nonemptyness, compactness, and, moreover, R δ -set. By employing Balder's theorem, the existence of optimal control is derived. At last, an application is provided to validate the developed theoretical results. [ABSTRACT FROM AUTHOR]

We consider a stochastic control problem in the case where the set of the control domain is convex, and the system is governed by fractional Brownian motion with Hurst parameter H ∈ (1 2 , 1) {H\in(\frac{1}{2},1)} and standard Wiener motion. The criterion to be minimized is in the general form, with initial cost. We derive a stochastic maximum principle of optimality by using two famous approaches. The first one is the Doss–Sussmann transformation and the second one is the Malliavin derivative. [ABSTRACT FROM AUTHOR]

We prove a general existence result in stochastic optimal control in discrete time, where controls, taking values in conditional metric spaces, depend on the current information and past decisions. The general form of the problem lies beyond the scope of standard techniques in stochastic control theory, the main novelty is a formalization in conditional metric space and the use of conditional analysis. We illustrate the existence result by several examples such as wealth-dependent utility maximization under risk constraints and utility maximization with a conditional dimension. We also provide a discussion as to how our methods compare to techniques based on random sets. [ABSTRACT FROM AUTHOR]

This paper presents reduced-order nonlinear filtering schemes based on a theoretical framework that combines stochastic dimensional reduction and nonlinear filtering. Here, dimensional reduction is achieved for estimating the slow-scale process in a multiscale environment by constructing a filter using stochastic averaging results. The nonlinear filter is approximated numerically using the ensemble Kalman filter and particle filter. The particle filter is further adapted to the complexities of inherently chaotic signals. In particle filters, an ensemble of particles is used to represent the distribution of the state of the hidden signal. The ensemble is updated using observation data to obtain the best representation of the conditional density of the true state variables given observations. Particle methods suffer from the "curse of dimensionality," an issue of particle degeneracy within a sample, which increases exponentially with system dimension. Hence, particle filtering in high dimensions can benefit from some form of dimensional reduction. A control is superimposed on particle dynamics to drive particles to locations most representative of observations, in other words, to construct a better prior density. The control is determined by solving a classical stochastic optimization problem and implemented in the particle filter using importance sampling techniques. [ABSTRACT FROM AUTHOR]

We consider the problem of determining an optimal strategy for electricity injection that faces an uncertain power demand stream. This demand stream is modeled via an Ornstein–Uhlenbeck process with an additional jump component, whereas the power flow is represented by the linear transport equation. We analytically determine the optimal amount of power supply for different levels of available information and compare the results to each other. For numerical purposes, we reformulate the original problem in terms of the cost function such that classical optimization solvers can be directly applied. The computational results are illustrated for different scenarios. [ABSTRACT FROM AUTHOR]

We consider the controlled stochastic Navier–Stokes equations in a bounded multidimensional domain, where the noise term allows jumps. In order to prove existence and uniqueness of an optimal control w.r.t. a given control problem, we first need to show the existence and uniqueness of a local mild solution of the considered controlled stochastic Navier–Stokes equations. We then discuss the control problem, where the related cost functional includes stopping times dependent on controls. Based on the continuity of the cost functional, we can apply existence and uniqueness results provided in [4], which enables us to show that a unique optimal control exists. [ABSTRACT FROM AUTHOR]

We consider a Barenblatt parabolic equationArising from a financial stochastic optimal control model. In this model, the control variablel, which is bounded and lies in [0,M], should be chosen to optimize the objective function to take the maximum value. From the problem, it can be seen thatlshould be either 0 orM, which depends on whethervxis greater than 1 or not. We divide the domain into two parts, {vx> 1} and {vx⩽ 1}. Thus, the junction of the two regions, that is, free boundary, has particular financial implications. It can be expressed as a functional formh(t). In this article, we not only prove the existence and uniqueness of the solution to this equation, but we also study the property of the free boundaryh(t). We show thath(t) is a differentiable, nondecreasing function. We also present the shapes ofh(t) in different cases. The most difficult point is to prove the concavity of the value function by stochastic analysis. [ABSTRACT FROM AUTHOR]

In this paper we propose and study a continuous-time stochastic model of optimal allocation for a defined contribution pension fund with a minimum guarantee. We adopt the point of view of a fund manager maximizing the expected utility from the fund wealth over an infinite horizon. In our model the dynamics of wealth takes directly into account the flows of contributions and benefits, and the level of wealth is constrained to stay above a 'solvency level.' The fund manager can invest in a riskless asset and in a risky asset, but borrowing and short selling are prohibited. We concentrate the analysis on the effect of the solvency constraint, analyzing in particular what happens when the fund wealth reaches the allowed minimum value represented by the solvency level. The model is naturally formulated as an optimal stochastic control problem with state constraints and is treated by the dynamic programming approach. We show that the value function of the problem is a regular solution of the associated Hamilton-Jacobi-Bellman equation. Then we apply verification techniques to get the optimal allocation strategy in feedback form and to study its properties. We finally give a special example with explicit solution. [ABSTRACT FROM AUTHOR]

Abstract: As a main step in the numerical solution of control problems in continuous time, the controlled process is approximated by sequences of controlled Markov chains, thus discretising time and space. A new feature in this context is to allow for delay in the dynamics. The existence of an optimal strategy with respect to the cost functional can be guaranteed in the class of relaxed controls. Weak convergence of the approximating extended Markov chains to the original process together with convergence of the associated optimal strategies is established. [Copyright &y& Elsevier]