Reinforcement learning and optimal control of discrete-time systems: Using natural decision methods to design optimal adaptive controllers

In this chapter, the use of principles of reinforcement learning to design a new class of feedback controllers for continuous-time dynamical systems is presented. This chapter also reviews current technology, showing that for discrete-time dynamical systems, reinforcement learning methods allow the solution of HJB design equations online, forward in time and without knowing the full system dynamics.