Back to Search Start Over

Three-way decision-based tri-training with entropy minimization.

Authors :
Pan, Linchao
Gao, Can
Zhou, Jie
Source :
Information Sciences. Sep2022, Vol. 610, p33-51. 19p.
Publication Year :
2022

Abstract

• A measure of semi-supervised neighborhood mutual information is developed to evaluate the significance of attributes in partially labeled data. • A three-way decision-based multiview tri-training model with entropy minimization is proposed to learn from partially labeled data. • The effectiveness of the proposed model is theoretically analyzed. The three-way decision (TWD) theory is an effective methodology and philosophy for thinking in three and has been successfully applied to knowledge reasoning and decision making. However, limited research has been devoted to learning from partially labeled data with discrete and continuous attributes using TWD. In this study, we propose a TWD-based tri-training model for partially labeled data with heterogeneous attributes. First, a measure of semi-supervised neighborhood mutual information is defined, based on which a heuristic algorithm is developed to generate an optimal semi-supervised reduct of partially labeled data. Then, a tri-training model is trained on the original view along with two views transformed by data discretization and principal component analysis, and the strategy of TWD with entropy minimization is further introduced to classify unlabeled data into useful, uncertain, and useless samples, whereas the multiview tri-training model is iteratively retrained on only a certain number of useful samples with low entropy to improve the performance. Finally, the effectiveness of the proposed model is theoretically analyzed from the perspective of noise learning. The experimental results of semi-supervised attribute reduction and semi-supervised classification on UCI datasets show that our method is effective in handling partially labeled data and outperforms supervised models trained on all data with full supervision. [ABSTRACT FROM AUTHOR]

Details

Language :
English
ISSN :
00200255
Volume :
610
Database :
Academic Search Index
Journal :
Information Sciences
Publication Type :
Periodical
Accession number :
158863467
Full Text :
https://doi.org/10.1016/j.ins.2022.07.133