Search

In this paper, a stable reinforcement learning control approach using neural networks (NNs) is developed for the trajectory tracking of an n-link rigid robot manipulator. The considered systems are in discrete time form. The proposed controller design consists of two NNs. One is the critic network that is used to approximate the long-term cost function, whereas other is that the action NN is employed to generate the system input. Then, an optimal control input can be obtained compared with other robot manipulator systems. Using the Lyapunov approach, the tracking error and weight estimates are proven to be semi-global uniformly ultimately bounded. A simulation example is employed to illustrate the effectiveness of the proposed controller. [ABSTRACT FROM PUBLISHER]

In this paper, an adaptive control algorithm is proposed for a class of robot manipulator systems with unknown functions and dead-zone input by using a reinforcement learning scheme. The parameters of the dead zone are supposed to be unknown but bounded. The unknown functions can be approximated based on the neural networks, which is one part of the reinforcement learning scheme, namely an action network. The other part is called critic network which is used to approximate the reinforcement signal. Then, the prominent advantage of the proposed approach is that an optimal control input can be obtained by using two networks compared with the results of robot manipulator with dead zone: an additional term is given to compensate for the effect of the dead zone, and a special design procedure to solve the difficulties in constructing the controllers and adaptation laws. Based on the Lyapunov analysis theory, all the signals of the closed-loop system are proved to be bounded and the system output can track the reference signal to a bounded compact set. Finally, a simulation example is given to illustrate the effectiveness of the approach. [ABSTRACT FROM AUTHOR]