Search

When training samples are scarce, the semantic embedding technique, i. e., describing class labels with attributes, provides a condition to generate visual features for unseen objects by transferring the knowledge from seen objects. However, semantic descriptions are usually obtained in an external paradigm, such as manual annotation, resulting in weak consistency between descriptions and visual features. In this paper, we refine the coarse-grained semantic description for any-shot learning tasks, i. e., zero-shot learning (ZSL), generalized zero-shot learning (GZSL), and few-shot learning (FSL). A new model, namely, the semantic refinement Wasserstein generative adversarial network (SRWGAN) model, is designed with the proposed multihead representation and hierarchical alignment techniques. Unlike conventional methods, semantic refinement is performed with the aim of identifying a bias-eliminated condition for disjoint-class feature generation and is applicable in both inductive and transductive settings. We extensively evaluate model performance on six benchmark datasets and observe state-of-the-art results for any-shot learning; e. g., we obtain 70.2% harmonic accuracy for the Caltech UCSD Birds (CUB) dataset and 82.2% harmonic accuracy for the Oxford Flowers (FLO) dataset in the standard GZSL setting. Various visualizations are also provided to show the bias-eliminated generation of SRWGAN. Our code is available. [ABSTRACT FROM AUTHOR]

In industrial processes, soft sensor techniques are used to predict the hard-to-measure quality variables under the classic supervised learning paradigm. However, the data challenges, i. e., the widespread noises and inadequate labeled samples, usually make the data-driven sensors weak for application. In this paper, a simple but effective regularization method termed as adversarial smoothing regularization (ASR) is proposed, which measures the local smoothness of prediction around each input sample. By minimizing the divergence between the predictions for noisy and clean inputs, the proposed ASR regulates the learning model to be robust against local perturbation in a semi-supervised manner. Theoretical analysis explains the smoothing capability of ASR, and shows that it is helpful for the improvement of generalization performance. We also design a tri-regression framework to further use the information of unlabeled samples with pseudo labels and present the adversarial smoothing tri-regression (ASTR) model for soft sensor. Based on two industrial processes, comprehensive soft sensor experiments and noise tests are performed to show the robust semi-supervised learning capability of the proposed ASR and ASTR. • A new adversarial regularization is designed to measure the local smoothness around sample for robust modeling. • An adversarial tri-regression model is developed for soft sensor, which performs a semisupervised modeling. • The proposed technique could reduce the prediction variance and balance the prediction bias. • Experimental results on both simulated process and realistic process are provided. [ABSTRACT FROM AUTHOR]

In this article, a challenging fault diagnosis task is studied, in which no samples of the target faults are available for the model training. This scenario has hardly been studied in industrial research. But it is a common problem that massive fault samples are not available for the target faults, which limits the successes of conventional data-driven approaches in practical application. Here, we introduce the idea of zero-shot learning into the industry field, and tackle the zero-sample fault diagnosis task by proposing the fault description based attribute transfer method. Specifically, the method learns to determine the fault categories using the human-defined fault descriptions instead of the collected fault samples.The defined description consists of arbitrary attributes of the faults, including the fault positions, the consequences of the fault, and even the cause of the fault, etc. For the attribute knowledge of target faults, they can be prelearned and transferred from some readily available faults occurred in the same process. Afterwards, the target faults can be diagnosed based on the defined fault descriptions without the need for any additional data based training. Besides, the supervised principle component analysis is adopted in our method to extract the attribute related features to offer an effective attribute learning. We analyze and interpret the feasibility of the fault description based method theoretically. Also, the zero-sample fault diagnosis experiments are designed and conducted on the benchmark Tennessee–Eastman process and the real thermal power plant process to validate the effectiveness. The results show that it is indeed possible to diagnose target faults without their samples. [ABSTRACT FROM AUTHOR]