Back to Search Start Over

Learning Loss Functions for Semi-supervised Learning via Discriminative Adversarial Networks

Authors :
Santos, Cicero Nogueira dos
Wadhawan, Kahini
Zhou, Bowen
Publication Year :
2017

Abstract

We propose discriminative adversarial networks (DAN) for semi-supervised learning and loss function learning. Our DAN approach builds upon generative adversarial networks (GANs) and conditional GANs but includes the key differentiator of using two discriminators instead of a generator and a discriminator. DAN can be seen as a framework to learn loss functions for predictors that also implements semi-supervised learning in a straightforward manner. We propose instantiations of DAN for two different prediction tasks: classification and ranking. Our experimental results on three datasets of different tasks demonstrate that DAN is a promising framework for both semi-supervised learning and learning loss functions for predictors. For all tasks, the semi-supervised capability of DAN can significantly boost the predictor performance for small labeled sets with minor architecture changes across tasks. Moreover, the loss functions automatically learned by DANs are very competitive and usually outperform the standard pairwise and negative log-likelihood loss functions for both semi-supervised and supervised learning.<br />Comment: 11 pages

Subjects

Subjects :
Computer Science - Learning

Details

Database :
arXiv
Publication Type :
Report
Accession number :
edsarx.1707.02198
Document Type :
Working Paper