Search

This paper examines an optimal control problem with a probabilistic criterion for retaining the trajectories of a discrete-time stochastic system in given sets. The dynamic programming method is employed for obtaining the isobells of levels 1 and 0 of the Bellman function, two-sided estimates for the right-hand side of the dynamic programming equation, two-sided estimates for the Bellman function, and the optimal-value function of the probabilistic criterion. These results are then used for deriving an approximate formula for the optimal control. As an illustrative example the problem of keeping an inverted pendulum in the neighborhood of an unstable equilibrium is considered. [ABSTRACT FROM AUTHOR]

Consideration was given to the design of the optimal control of the general discrete stochastic system with a criterion as the probability of the state vector sojourn in the given sets at each time instant. Derived were relations of the dynamic programming enabling one to establish an optimal solution in the class of Markov strategies without extension of the state vector with subsequent reduction to an equivalent problem with the probabilistic terminal criterion. Consideration was given to the problem of one-parameter correction of the flying vehicle trajectory. An analytical solution was established. [ABSTRACT FROM AUTHOR]