Handling occlusion in optical flow algorithms for object tracking

Abstract: In this paper, we study simple algorithms for tracking objects in a video sequence, based on the selection of landmark points representative of the moving objects in the first frame of the sequence to be analyzed. The movement of these points is estimated using a sparse optical-flow method. Methods of this kind are fast, but they are not very robust. Particularly, they are not able to handle the occlusion of the moving objects in the video. To improve the performance of optical flow-based methods, we propose the use of adaptive filters and neural networks to predict the expected instantaneous velocities of the objects, using the predicted velocities as indicators of the performance of the tracking algorithm. The efficiency of these strategies in handling occlusion problems are tested with a set of synthetic and real video sequences. [Copyright &y& Elsevier]