Back to Search Start Over

On the time discretization of stochastic optimal control problems: The dynamic programming approach

Authors :
Joseph Frédéric Bonnans
Francisco J. Silva
Justina Gianatti
Controle, Optimisation, modèles, Méthodes et Applications pour les Systèmes Dynamiques non linéaires (COMMANDS)
Centre de Mathématiques Appliquées - Ecole Polytechnique (CMAP)
École polytechnique (X)-Centre National de la Recherche Scientifique (CNRS)-École polytechnique (X)-Centre National de la Recherche Scientifique (CNRS)-Inria Saclay - Ile de France
Institut National de Recherche en Informatique et en Automatique (Inria)-Institut National de Recherche en Informatique et en Automatique (Inria)
Centro Franco Argentino de Ciencias de la Información y de Sistemas [Rosario] (CIFASIS)
Consejo Nacional de Investigaciones Científicas y Técnicas [Buenos Aires] (CONICET)-Universidad Nacional de Rosario [Santa Fe]
Mathématiques & Sécurité de l'information (XLIM-MATHIS)
XLIM (XLIM)
Université de Limoges (UNILIM)-Centre National de la Recherche Scientifique (CNRS)-Université de Limoges (UNILIM)-Centre National de la Recherche Scientifique (CNRS)
The first and second author thank the Laboratoire de Finance des Marchés de l’Energie for its support. The first and third authors thank the support from project iCODE :'Large-scale systems and Smart grids: distributed decision making and from the Gaspar Monge Program for Optimization and Operation Research (PGMO). The second author was also supported by Centro Internacional Franco Argentino de Ciencias de la Informacion y de Sistemas (CIFASI).
Source :
ESAIM: Control, Optimisation and Calculus of Variations, ESAIM: Control, Optimisation and Calculus of Variations, EDP Sciences, 2019, ⟨10.1051/cocv/2018045⟩, ESAIM: Control, Optimisation and Calculus of Variations, 2019, ⟨10.1051/cocv/2018045⟩, CONICET Digital (CONICET), Consejo Nacional de Investigaciones Científicas y Técnicas, instacron:CONICET
Publication Year :
2019
Publisher :
EDP Sciences, 2019.

Abstract

In this work, we consider the time discretization of stochastic optimal control problems. Under general assumptions on the data, we prove the convergence of the value functions associated with the discrete time problems to the value function of the original problem. Moreover, we prove that any sequence of optimal solutions of discrete problems is minimizing for the continuous one. As a consequence of the Dynamic Programming Principle for the discrete problems, the minimizing sequence can be taken in discrete time feedback form. Fil: Joseph Frédéric, Bonnans. Institut National de Recherche en Informatique et en Automatique; Francia. Centre National de la Recherche Scientifique; Francia. Université Paris-Saclay; Francia Fil: Gianatti, Justina. Consejo Nacional de Investigaciones Científicas y Técnicas. Centro Científico Tecnológico Conicet - Rosario. Centro Internacional Franco Argentino de Ciencias de la Información y de Sistemas. Universidad Nacional de Rosario. Centro Internacional Franco Argentino de Ciencias de la Información y de Sistemas; Argentina Fil: Silva, Francisco J.. Centre National de la Recherche Scientifique; Francia. Universite de Limoges; Francia

Details

ISSN :
12623377 and 12928119
Volume :
25
Database :
OpenAIRE
Journal :
ESAIM: Control, Optimisation and Calculus of Variations
Accession number :
edsair.doi.dedup.....37cd34f4330f2ff2e2e2922d93252624
Full Text :
https://doi.org/10.1051/cocv/2018045