Search

We present a cloud-based multimodal dialogue platform for the remote assessment and monitoring of speech, facial and fine motor function in Parkinson's Disease (PD) at scale, along with a preliminary investigation of the efficacy of the various metrics automatically extracted by the platform. 22 healthy controls and 38 people with Parkinson's Disease (pPD) were instructed to complete four interactive sessions, spaced a week apart, on the platform. Each session involved a battery of tasks designed to elicit speech, facial movements and finger movements. We find that speech, facial kinematic and finger movement dexterity metrics show statistically significant differences between controls and pPD. We further investigate the sensitivity, specificity, reliability and generalisability of these metrics. Our results offer encouraging evidence for the utility of automatically-extracted audiovisual analytics in remote mon-itoring of PD and other movement disorders.

Control of speech formants is important for the production of distinguishable speech sounds and is achieved with both feedback and learned feedforward control. However, it is unclear whether the learning of feedforward control involves the mechanisms of feedback control. Speakers have been shown to compensate for unpredictable transient mid-utterance perturbations of pitch and loudness feedback, demonstrating online feedback control of these speech features. To determine whether similar feedback control mechanisms exist in the production of formants, responses to unpredictable vowel formant feedback perturbations were examined. Results showed similar within-trial compensatory responses to formant perturbations that were presented at utterance onset and mid-utterance. The relationship between online feedback compensation to unpredictable formant perturbations and sensorimotor adaptation to consistent formant perturbations was further examined. Within-trial online compensation responses were not correlated with across-trial sensorimotor adaptation. A detailed analysis of within-trial time course dynamics across trials during sensorimotor adaptation revealed that across-trial sensorimotor adaptation responses did not result from an incorporation of within-trial compensation response. These findings suggest that online feedback compensation and sensorimotor adaptation are governed by distinct neural mechanisms. These findings have important implications for models of speech motor control in terms of how feedback and feedforward control mechanisms are implemented.

A hallmark feature of speech motor control is its ability to learn to anticipate and compensate for persistent feedback alterations, a process referred to as sensorimotor adaptation. Because this process involves adjusting articulation to counter the perceived effects of altering acoustic feedback, there are a number of factors that affect it, including the complex relationship between acoustics and articulation and non-uniformities of speech perception. As a consequence, sensorimotor adaptation is hypothesised to vary as a function of the direction of the applied auditory feedback alteration in vowel formant space. This hypothesis was tested in two experiments where auditory feedback was altered in real time, shifting the frequency values of the first and second formants (F1 and F2) of participants' speech. Shifts were designed on a subject-by-subject basis and sensorimotor adaptation was quantified with respect to the direction of applied shift, normalised for individual speakers. Adaptation was indeed found to depend on the direction of the applied shift in vowel formant space, independent of shift magnitude. These findings have implications for models of sensorimotor adaptation of speech.

Cerebellar degeneration (CD) has deleterious effects on speech motor behavior. Recently, a dissociation between feedback and feedforward control of speaking was observed in CD: Whereas CD patients exhibited reduced adaptation across trials to consistent formant feedback alterations, they showed enhanced within-trial compensation for unpredictable formant feedback perturbations. In this study, it was found that CD patients exhibit abnormally increased within-trial vocal compensation responses to unpredictable pitch feedback perturbations. Taken together with recent findings, the results indicate that CD is associated with a general hypersensitivity to auditory feedback during speaking.

Accurate integration of sensory inputs and motor commands is essential to achieve successful behavioral goals. A robust model of sensorimotor integration is the pitch perturbation response, in which speakers respond rapidly to shifts of the pitch in their auditory feedback. In a previous study, we demonstrated abnormal sensorimotor integration in patients with Alzheimer's disease (AD) with an abnormally enhanced behavioral response to pitch perturbation. Here we examine the neural correlates of the abnormal pitch perturbation response in AD patients, using magnetoencephalographic imaging. The participants phonated the vowel /α/ while a real-time signal processor briefly perturbed the pitch (100 cents, 400 ms) of their auditory feedback. We examined the high-gamma band (65-150 Hz) responses during this task. AD patients showed significantly reduced left prefrontal activity during the early phase of perturbation and increased right middle temporal activity during the later phase of perturbation, compared to controls. Activity in these brain regions significantly correlated with the behavioral response. These results demonstrate that impaired prefrontal modulation of speech-motor-control network and additional recruitment of right temporal regions are significant mediators of aberrant sensorimotor integration in patients with AD. The abnormal neural integration mechanisms signify the contribution of cortical network dysfunction to cognitive and behavioral deficits in AD.

Speech and motor deficits are highly prevalent (>70%) in individuals with the 600 kb BP4-BP5 16p11.2 deletion; however, the mechanisms that drive these deficits are unclear, limiting our ability to target interventions and advance treatment. This study examined fundamental aspects of speech motor control in participants with the 16p11.2 deletion. To assess capacity for control of voice, we examined how accurately and quickly subjects changed the pitch of their voice within a trial to correct for a transient perturbation of the pitch of their auditory feedback. When compared to controls, 16p11.2 deletion carriers show an over-exaggerated pitch compensation response to unpredictable mid-vocalization pitch perturbations. We also examined sensorimotor adaptation of speech by assessing how subjects learned to adapt their sustained productions of formants (speech spectral peak frequencies important for vowel identity), in response to consistent changes in their auditory feedback during vowel production. Deletion carriers show reduced sensorimotor adaptation to sustained vowel identity changes in auditory feedback. These results together suggest that 16p11.2 deletion carriers have fundamental impairments in the basic mechanisms of speech motor control and these impairments may partially explain the deficits in speech and language in these individuals.

Speakers respond automatically and rapidly to compensate for brief perturbations of pitch in their auditory feedback. The specific adjustments in vocal output require integration of brain regions involved in speech-motor-control in order to detect the sensory-feedback error and implement the motor correction. Cortical regions involved in the pitch reflex phenomenon are highly vulnerable targets of network disruption in Alzheimer's disease (AD). We examined the pitch reflex in AD patients (n = 19) compared to an age-matched control group (n = 16). We measured the degree of behavioral compensation (peak compensation) and the extent of the adaptive response (pitch-response persistence). Healthy-controls reached a peak compensation of 18.7 ± 0.8 cents, and demonstrated a sustained compensation at 8.9 ± 0.69 cents. AD patients, in contrast, demonstrated a significantly elevated peak compensation (22.4 ± 1.2 cents, p < 0.05), and a reduced sustained response (pitch-response persistence, 4.5 ± 0.88 cents, p < 0.001). The degree of increased peak compensation predicted executive dysfunction, while the degree of impaired pitch-response persistence predicted memory dysfunction, in AD patients. The current study demonstrates pitch reflex as a sensitive behavioral index of impaired prefrontal modulation of sensorimotor integration, and compromised plasticity mechanisms of memory, in AD., (Copyright © 2017 Elsevier Inc. All rights reserved.)