1. Improving action quality assessment with across-staged temporal reasoning on imbalanced data.
- Author
-
Lian, Pu-Xiang and Shao, Zhi-Gang
- Subjects
PROBABILITY density function ,RANK correlation (Statistics) ,HUMAN mechanics ,COMPUTER vision ,SQUARE root ,PSYCHOLOGICAL feedback - Abstract
Action quality assessment is a significant research domain in computer vision, aimed at evaluating the accuracy of human movement and providing feedback and guidance for training and rehabilitation. However, the uneven nature of the data, which has a significant impact on the labels with less samples, is not taken into consideration by the generally used approaches in this field. To address this issue, we propose using kernel density estimation (KDE) to recalculate the label density and weight the loss function by the reciprocal of the square root of each label density. Additionally, we divide the entire motion into three sub-stages, including the takeoff, aerial movement, and entry for diving, and connect the three stages using an across-staged temporal reasoning module (ASTRM). Our approach achieves a performance of 0.9222 Spearman correlation coefficient (ρ ) and 0.3304 (× 100) Relative ℓ 2 -distance (R - ℓ 2 ) on the FineDiving dataset, demonstrating competitiveness compared to other methods. Furthermore, numerous comprehensive ablation experiments validate the effectiveness of the methods and modules we adopted. [ABSTRACT FROM AUTHOR]
- Published
- 2023
- Full Text
- View/download PDF