Back to Search Start Over

Self-Supervised Action Representation Learning Based on Asymmetric Skeleton Data Augmentation.

Authors :
Zhou, Hualing
Li, Xi
Xu, Dahong
Liu, Hong
Guo, Jianping
Zhang, Yihan
Source :
Sensors (14248220); Nov2022, Vol. 22 Issue 22, p8989, 14p
Publication Year :
2022

Abstract

Contrastive learning has received increasing attention in the field of skeleton-based action representations in recent years. Most contrastive learning methods use simple augmentation strategies to construct pairs of positive samples. When using such pairs of positive samples to learn action representations, deeper feature information cannot be learned, thus affecting the performance of downstream tasks. To solve the problem of insufficient learning ability, we propose an asymmetric data augmentation strategy and attempt to apply it to the training of 3D skeleton-based action representations. First, we carefully study the different characteristics presented by different skeleton views and choose a specific augmentation method for a certain view. Second, specific augmentation methods are incorporated into the left and right branches of the asymmetric data augmentation pipeline to increase the convergence difficulty of the contrastive learning task, thereby significantly improving the quality of the learned action representations. Finally, since many methods directly act on the joint view, the augmented samples are quite different from the original samples. We use random probability activation to transform the joint view to avoid extreme augmentation of the joint view. Extensive experiments on NTU RGB + D datasets show that our method is effective. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
14248220
Volume :
22
Issue :
22
Database :
Complementary Index
Journal :
Sensors (14248220)
Publication Type :
Academic Journal
Accession number :
160466162
Full Text :
https://doi.org/10.3390/s22228989