1. A semi-supervised deep learning algorithm combining consistency regularization and manifold regularization
- Author
-
Jie WANG, Songyan ZHANG, and Jiye LIANG
- Subjects
semi-supervised deep learning ,consistency regularization ,manifold regularization ,smoothness constraint ,Electronic computers. Computer science ,QA75.5-76.95 - Abstract
Semi-supervised learning has been widely used in big data analysis.Currently, one of the hot research topics in semisupervised deep learning is consistency-based methods.However, such methods do not take into account the manifold structure of the data, which may cause a portion of similar samples to get very different outputs, resulting in degraded classifier performance.To address this problem, a semi-supervised deep learning algorithm that combines consistency regularization with manifold regularization was proposed.The algorithm imposed a consistency constraint on the model while constructing a graph and adding a smoothing loss to achieve smoothing within the local neighborhood of each sample point and between adjacent (connected) sample points, thus improving the generalization performance of the semisupervised learning algorithm.The results on several image and text datasets show that the proposed algorithm is more effective compared with other semi-supervised deep learning algorithms.
- Published
- 2022
- Full Text
- View/download PDF