Search

This paper introduces an approach aiming to determine head pose healthiness of computer users. The main contributions of this paper are: 1) Image Quality Assessment (IQA) based Stacked Autoencoder (referred to as IQASAE) which adjusts the value of learning rate based on the quality of images; 2) Head Pose Healthiness Prediction (HPHP) framework which leverages the proposed IQASAE algorithm in combination with image processing operations; 3) A set of features suitable for face analysis applications; 4) Ontology-driven semantic framework which enables further exploiting pose estimation results within applications in synergy with healthcare expert domain knowledge about pose healthiness. Our framework was evaluated on both offline (BIWI and AFLW) and online (our own, collected using Arduino) datasets. Furthermore, it was compared to several state-of-art methods, including Multi-Layer Perceptron (MLP), CART, Random Forest, Convolutional Neural Networks (CNN), Temporal Deep Learning Model (TDLM), hybrid CNN with Support Vector Machine (SVM), Quatnet and Trinet. According to the achieved experimental results, it reaches accuracy up to 79.63% outperforming all of them, except Quatnet and Trinet. However, the main advantages of IQASAE compared to state-of-art methods are: 1) it does not require selection of features, so the processing time is reduced, 2) utilizing angle between chin and mouth reduces training time for SAE, 3) leveraging vector-based feature set to create training data resulted in a significant improvement, especially in offline facial images. [ABSTRACT FROM AUTHOR]

In this paper, the intrinsic characteristics of speech modulations are estimated to propose the instant modulation spectral features for efficient emotion recognition. This feature representation is based on single frequency filtering (SFF) technique and higher order nonlinear energy operator. The speech signal is decomposed into frequency sub-bands using SFF, and associated nonlinear energies are estimated with higher order nonlinear energy operator. Then, the feature vector is realized using cepstral analysis. The high-resolution property of SFF technique is exploited to extract the amplitude envelope of the speech signal at a selected frequency with good time-frequency resolution. The fourth order nonlinear energy operator provides noise robustness in estimating the modulation components. The proposed feature set is tested for the emotion recognition task using the i-vector model with the probabilistic linear discriminant scoring scheme, support vector machine and random forest classifiers. The results demonstrate that the performance of this feature representation is better than the widely used spectral and prosody features, achieving detection accuracy of 85.75% , 59.88% , and 65.78% on three emotional databases, EMODB, FAU-AIBO, and IEMOCAP, respectively. Further, the proposed features are found to be robust in the presence of additive white Gaussian and vehicular noises. [ABSTRACT FROM AUTHOR]

Fault prediction technology provides a way to reduce the loss caused by equipment failure. Currently, many efforts of failure prediction pay more attention to the fault trend and the remaining useful life. This paper devotes to predicting a specific failure mode of device in the future. We propose a two-step prediction method with two sub-models to predict the fault mode. The first model, named regression model, combines Attention-based-LSTM (Long Short-Term Memory) and Random Forest (RF) to predict time series trends, where wavelet packet analysis is adopted to extract elementary features of time series and form multivariable time series. Based on the status data forecasted by the first model, the second model, named classification model, combines Attention-based-LSTM and Extra-Tree (ET) to classify fault mode. The classified fault will occur in the device at some point in the future. In the regression model, Attention-based-LSTM performs deep level feature extraction of vibration sensor signals, and the result is fed to the last layer (i.e., an RF layer), which takes responsibility for predicting the future sequence. The future sequence is then provided to the classification model, where Attention-based-LSTM is used to extract implicit features, and ET classifier is used to accept these features and figure out the failure phenomenon. Our approach for predicting failure modes includes the severity and type of fault, which are rarely investigated synthetically. The experimental results of bearing data show that the sub-models can achieve high prediction accuracy and our method can predict the future failure mode with precision. [ABSTRACT FROM AUTHOR]