Search

Pain-related emotions are a major barrier to effective self rehabilitation in chronic pain. Automated coaching systems capable of detecting these emotions are a potential solution. This paper lays the foundation for the development of such systems by making three contributions. First, through literature reviews, an overview of how pain is expressed in chronic pain and the motivation for detecting it in physical rehabilitation is provided. Second, a fully labelled multimodal dataset (named ‘EmoPain’) containing high resolution multiple-view face videos, head mounted and room audio signals, full body 3D motion capture and electromyographic signals from back muscles is supplied. Natural unconstrained pain related facial expressions and body movement behaviours were elicited from people with chronic pain carrying out physical exercises. Both instructed and non-instructed exercises were considered to reflect traditional scenarios of physiotherapist directed therapy and home-based self-directed therapy. Two sets of labels were assigned: level of pain from facial expressions annotated by eight raters and the occurrence of six pain-related body behaviours segmented by four experts. Third, through exploratory experiments grounded in the data, the factors and challenges in the automated recognition of such expressions and behaviour are described, the paper concludes by discussing potential avenues in the context of these findings also highlighting differences for the two exercise scenarios addressed. [ABSTRACT FROM PUBLISHER]

Active and passive mobile sensing has garnered much attention in recent years. In this paper, we focus on chronic pain measurement and management as a case application to exemplify the state of the art. We present a consolidated discussion on the leveraging of various sensing modalities along with modular server-side and on-device architectures required for this task. Modalities included are: activity monitoring from accelerometry and location sensing, audio analysis of speech, image processing for facial expressions as well as modern methods for effective patient self-reporting. We review examples that deliver actionable information to clinicians and patients while addressing privacy, usability, and computational constraints. We also discuss open challenges in the higher level inferencing of patient state and effective feedback with potential directions to address them. The methods and challenges presented here are also generalizable and relevant to a broad range of other applications in mobile sensing. [ABSTRACT FROM PUBLISHER]

Despite its importance in social interactions, laughter remains little studied in affective computing. Intelligent virtual agents are often blind to users’ laughter and unable to produce convincing laughter themselves. Respiratory, auditory, and facial laughter signals have been investigated but laughter-related body movements have received less attention. The aim of this study is threefold. First, to probe human laughter perception by analyzing patterns of categorisations of natural laughter animated on a minimal avatar. Results reveal that a low dimensional space can describe perception of laughter “types”. Second, to investigate observers’ perception of laughter (hilarious, social, awkward, fake, and non-laughter) based on animated avatars generated from natural and acted motion-capture data. Significant differences in torso and limb movements are found between animations perceived as laughter and those perceived as non-laughter. Hilarious laughter also differs from social laughter. Different body movement features were indicative of laughter in sitting and standing avatar postures. Third, to investigate automatic recognition of laughter to the same level of certainty as observers’ perceptions. Results show recognition rates of the Random Forest model approach human rating levels. Classification comparisons and feature importance analyses indicate an improvement in recognition of social laughter when localized features and nonlinear models are used. [ABSTRACT FROM PUBLISHER]

Accelerometry is a widely used sensing modality in human biomechanics due to its portability, non-invasiveness, and accuracy. However, difficulties lie in signal variability and interpretation in relation to biomechanical events. In walking, heel strike and toe off are primary gait events where robust and accurate detection is essential for gait-related applications. This paper describes a novel and generic event detection algorithm applicable to signals from tri-axial accelerometers placed on the foot, ankle, shank or waist. Data from healthy subjects undergoing multiple walking trials on flat and inclined, as well as smooth and tactile paving surfaces is acquired for experimentation. The benchmark timings at which heel strike and toe off occur, are determined using kinematic data recorded from a motion capture system. The algorithm extracts features from each of the acceleration signals using a continuous wavelet transform over a wide range of scales. A locality preserving embedding method is then applied to reduce the high dimensionality caused by the multiple scales while preserving salient features for classification. A simple Gaussian mixture model is then trained to classify each of the time samples into heel strike, toe off or no event categories. Results show good detection and temporal accuracies for different sensor locations and different walking terrains. [ABSTRACT FROM AUTHOR]

Plantar lesions induced by biomechanical dysfunction pose a considerable socioeconomic health care challenge, and failure to detect lesions early can have significant effects on patient prognoses. Most of the previous works on plantar lesion identification employed the analysis of biomechanical microenvironment variables like pressure and thermal fields. This paper focuses on foot kinematics and applies kernel principal component analysis (KPCA) for nonlinear dimensionality reduction of features, followed by Fisher's linear discriminant analysis for the classification of patients with different types of foot lesions, in order to establish an association between foot motion and lesion formation. Performance comparisons are made using leave-one-out cross-validation. Results show that the proposed method can lead to ∼94%correct classification rates, with a reduction of feature dimensionality from 2100 to 46, without any manual preprocessing or elaborate feature extraction methods. The results imply that foot kinematics contain information that is highly relevant to pathology classification and also that the nonlinear KPCA approach has considerable power in unraveling abstract biomechanical features into a relatively low dimensional pathology-relevant space. [ABSTRACT FROM AUTHOR]

Videofluoroscopy remains one of the mainstay methods for clinical swallowing assessment, yet its interpretation is both complex and subjective. This, in part, reflects the difficulties associated with estimation of bolus transit time through the oral and pharyngeal regions by visual inspection, and problems with consistent repeatability. This paper introduces a software-only framework that automatically determines the time taken for the bolus to cross 1-D anatomical landmarks representing the oral and pharyngeal region boundaries (Fig. 1). The user-steered delineation algorithm live-wire and straight-line annotators are used to demarcate the landmark on a frame prior to the swallow action. The rate of change of intensity of the pixels in each landmark is used as the detection feature for bolus presence that can be visualized on a spatiotemporal plot. Artifacts introduced by head and neck movement are removed by updating the landmark coordinates using affine parameters optimized by a genetic-algorithm-based registration method. Heuristics are applied to the spatiotemporal plot to identify the frames during which the bolus passes the landmark. Correlation coefficients between three observers visually inspecting twenty-four 5-mL single swallow clips did not exceed 0.42. Yet the same measurements taken using this framework on the same clips had correlation coefficients exceeding 0.87. [ABSTRACT FROM AUTHOR]