Back to Search
Start Over
Stochastic control of systems with control multiplicative noise using second order FBSDEs
- Source :
- ACC
- Publication Year :
- 2017
- Publisher :
- IEEE, 2017.
-
Abstract
- The Hamilton Jacobi Bellman (HJB) PDE for the stochastic optimal control (SOC) problem for diffusion SDE dynamics which have affine controls and state and control multiplicative noise is a second order fully nonlinear PDE. The previously known linearly solvable optimal control framework as well as the first order forward backward SDEs (FBSDEs) frameworks therefore have a characteristic inadequacy to support sampling algorithms for this SOC problem. We present the framework of second order FBSDEs for solving this SOC problem in this paper. We derive the nonlinear Feynman Kac representation of the second order fully nonlinear HJB PDE corresponding to diffusions with state and control multiplicative noise. The Feynman Kac representation enables a sampling based scheme for solving this SOC problem. This scheme is then leveraged to develop a least squares Monte Carlo regression based algorithm for implementations. The algorithm is validated by examples of simulated control of an underactuated system and comparison against an analytical characterization.
- Subjects :
- Stochastic control
0209 industrial biotechnology
Mathematical optimization
010102 general mathematics
MathematicsofComputing_NUMERICALANALYSIS
Mathematics::Optimization and Control
Hamilton–Jacobi–Bellman equation
02 engineering and technology
Optimal control
01 natural sciences
Hamilton–Jacobi equation
Multiplicative noise
Dynamic programming
symbols.namesake
Nonlinear system
020901 industrial engineering & automation
symbols
0101 mathematics
Mathematics
Gibbs sampling
Subjects
Details
- Database :
- OpenAIRE
- Journal :
- 2017 American Control Conference (ACC)
- Accession number :
- edsair.doi...........a1fd3e8db984fa7903b088baec945d80