Search

Multimodal signal analysis based on sophisticated noninvasive sensors, efficient communication systems, and machine learning, have a rapidly increasing range of different applications. The present paper is devoted to pattern recognition and the analysis of physiological data acquired by heart rate and thermal camera sensors during rehabilitation. A total number of 56 experimental data sets, each 40 min long, of the heart rate and breathing temperature recorded on an exercise bike have been processed to determine the fitness level and possible medical disorders. The proposed general methodology combines machine learning methods for the detection of the changing temperature ranges of the thermal camera and adaptive image processing methods to evaluate the frequency of breathing. To determine the individual temperature values, a neural network model with the sigmoidal and the probabilistic transfer function in the first and the second layers are applied. Appropriate statistical methods are then used to find the correspondence between the exercise activity and selected physiological functions. The evaluated mean delay of 21 s of the heart rate drop related to the change of the activity level corresponds to results obtained in real cycling conditions. Further results include the average value of the change of the breathing temperature (167 s) and breathing frequency (49 s). [ABSTRACT FROM AUTHOR]

This paper presents methodology for the processing of GPS and heart rate signals acquired during long-term physical activities. The data analysed include geo-positioning and heart rate multichannel signals recorded for 272.2 h of cycling across the Andes mountains over a 5694-km long expedition. The proposed computational methods include multimodal data de-noising, visualization, and analysis in order to determine specific biomedical features. The results include the correspondence between the heart rate and slope for downhill and uphill cycling and the mean heart rate evolution on flat segments: a regression coefficient of -0.014 bpm/h related to time and 6.3 bpm/km related to altitude. The classification accuracy of selected cycling features by neural networks, support vector machine, and k-nearest neighbours methods is between 91.3% and 98.6%. The proposed methods allow the analysis of data during physical activities, enabling an efficient human-machine interaction. [ABSTRACT FROM AUTHOR]

The aim of this work is to develop methods that enable acoustic speech features to be predicted from mel-frequency cepstral coefficient (MFCC) vectors as may be encountered in distributed speech recognition architectures. The work begins with a detailed analysis of the multiple correlation between acoustic speech features and MFCC vectors. This confirms the existence of correlation, which is found to be higher when measured within specific phonemes rather than globally across all speech sounds. The correlation analysis leads to the development of a statistical method of predicting acoustic speech features from MFCC vectors that utilizes a network of hidden Markov models (HMMs) to localize prediction to specific phonemes. Within each HMM, the joint density of acoustic features and MFCC vectors is modeled and used to make a maximum a posteriori prediction. Experimental results are presented across a range of conditions, such as with speaker-dependent, gender-dependent, and gender-independent constraints, and these show that acoustic speech features can be predicted from MFCC vectors with good accuracy. A comparison is also made against an alternative scheme that substitutes the higher-order MFCCs with acoustic features for transmission. This delivers accurate acoustic features but at the expense of a significant reduction in speech recognition accuracy. [ABSTRACT FROM AUTHOR]

This paper presents a post-processing speech restoration module for enhancing the performance of conventional speech enhancement methods. The restoration module aims to retrieve parts of speech spectrum that may be lost to noise or suppressed when using conventional speech enhancement methods. The proposed restoration method utilizes a harmonic plus noise model (HNM) of speech to retrieve damaged speech structure. A modified HNM of speech is proposed where, instead of the conventional binary labeling of the signal in each subband as voiced or unvoiced, the concept of harmonicity is introduced which is more adaptable to the codebook mapping method used in the later stage of enhancement. To restore the lost or suppressed information, an HNM codebook mapping technique is proposed. The HNM codebook is trained on speaker-independent speech data. To reduce the sensitivity of the HNM codebook to speaker variability, a spectral energy normalization process is introduced. The proposed post-processing method is tested as an add-on module with several popular noise reduction methods. Evaluations of the performance gain obtained from the proposed post-processing are presented and compared to standard speech enhancement systems which show substantial improvement gains in perceptual quality. [ABSTRACT FROM AUTHOR]

In this paper, the probability distribution functions (pdf's) of the formant spaces of three major accents of the English language, namely, British Received Pronunciation (RP), General American, and Broad Australian, are modeled and compared. The statistical differences across the formant spaces of these accents are employed for accent conversion. An improved formant tracking method, based on linear prediction (LP) feature analysis and a two-dimensional hidden Markov model (2-D-HMM) of format trajectories, is used for estimation of the formant trajectories of vowels and diphthongs of each accent. Comparative analysis of the formant spaces of the three accents indicates that these accents are partly conveyed by the differences of the formants of vowels. The estimates of the probability distributions of the formants for each accent are used in a speech synthesis system for accent conversion. Accent synthesis, through modification of the acoustic parameters of speech, provides a means of assessing the perceptual contribution of each formant parameter on conveying an accent. The results of perceptual evaluations of accent conversion illustrate that formants play an important role in conveying accents. [ABSTRACT FROM AUTHOR]

This paper presents improvements in image gap restoration through the incorporation of edge-based directional interpolation within multi-scale pyramid transforms. Two types of image edges are reconstructed: 1) the local edges or textures, inferred from the gradients of the neighboring pixels and 2) the global edges between image objects or segments, inferred using a Canny detector. Through a process of pyramid transformation and downsampling, the image is progressively transformed into a series of reduced size layers until at the pyramid apex the gap size is one sample. At each layer, an edge skeleton image is extracted for edge-guided interpolation. The process is then reversed; from the apex, at each layer, the missing samples are estimated (an iterative method is used in the last stage of upsampling), up-sampled, and combined with the available samples of the next layer. Discrete cosine transform and a family of discrete wavelet transforms are utilized as alternatives for pyramid construction. Evaluations over a range of images, in regular and random loss pattern, at loss rates of up to 40%, demonstrate that the proposed method improves peak-signal-to-noise-ratio by 1-5 dB compared with a range of best published works.