51. Research on Pedestrian Fall Action Recognition from Escalators
- Author
-
Zhiguo Yan, SongYang Wu, and Yufei Wu
- Subjects
Network architecture ,Computer science ,business.industry ,ComputingMethodologies_IMAGEPROCESSINGANDCOMPUTERVISION ,Optical flow ,Pattern recognition ,Pedestrian ,Task (project management) ,Class imbalance ,Key (cryptography) ,Action recognition ,RGB color model ,Artificial intelligence ,business - Abstract
Action recognition is a hot topic in computer vision and machine learning. The related applications are widely used in daily life. This paper conducts research on pedestrian fall detection methods from escalators based on TSN to recognize falling actions on the escalator and improve its performance. The recognition accuracy is closely related to the network architecture, the input data and parameter tuning. The popular input data of the network is mainly RGB images and optical flow and the classic network is two-stream and C3D. Instead of the traditional method, this paper uses limited samples and a feature fusion approach to find out falling pedestrians in class imbalance. The key and non-key frames are extracted from the video segments and sent to spatial networks and temporal ones relatively. With feature fusion and a series of optimization, the results showed that this method achieved higher accuracy, lower FAR and better performance effectively on both UCF101/HMDB51 datasets and pedestrian fall action recognition task compared with other popular action recognition methods.
- Published
- 2021
- Full Text
- View/download PDF