Search

BackgroundThe Floodlight Open app is a digital health technology tool (DHTT) that comprises remote, smartphone sensor–based tests (daily activities) for assessing symptoms of multiple sclerosis (MS). User acquisition, engagement, and retention remain a barrier to successfully deploying such tools. ObjectiveThis study aims to quantitatively and qualitatively investigate key user experience (UX) factors associated with the Floodlight Open app. MethodsFloodlight Open is a global, open-access, digital-only study designed to understand the drivers and barriers in deploying a DHTT in a naturalistic setting without supervision and onboarding by a clinician. Daily activities included tests assessing cognition (Information Processing Speed and Information Processing Speed Digit–Digit), hand-motor function (Pinching Test and Draw a Shape Test), and postural stability and gait (Static Balance Test, U-Turn Test, and Two-Minute Walk Test [2MWT]). All daily activities except the 2MWT were taken in a fixed sequence. Qualitative UX was studied through semistructured interviews in a substudy of US participants with MS. The quantitative UX analysis investigated the impact of new UX design features on user engagement and retention in US participants for 3 separate test series: all daily activities included in the fixed sequence (DA), all daily activities included in the fixed sequence except the Static Balance Test and U-Turn Test (DAx), and the 2MWT. ResultsThe qualitative UX substudy (N=22) revealed the need for 2 new UX design features: a more seamless user journey during the activation process that eliminates the requirement of switching back and forth between the app and the email that the participants received upon registration, and configurable reminders and push notifications to help plan and remind the participants to complete their daily activities. Both UX design features were assessed in the quantitative UX analysis. Introducing the more seamless user journey (original user journey: n=608; more seamless user journey: n=481) improved the conversion rate of participants who enrolled in the study and proceeded to successfully activate the app from 53.9% (328/608) to 74.6% (359/481). Introducing reminders and push notifications (with reminders and notifications: n=350; without reminders and notifications: n=172) improved continuous usage time (proportion of participants with ≥3 consecutive days of usage: DA and DAx: ~30% vs ~12%; 2MWT: ~30% vs ~20%); test completion rates (maximum number of test series completed: DA: 279 vs 64; DAx: 283 vs 126; 2MWT: 302 vs 76); and user retention rates (at day 30: DA: 53/172, 30.8% vs 34/350, 9.7%; DAx: 53/172, 30.8% vs 60/350, 17.1%; 2MWT: 39/172, 22.6% vs 22/350, 6.2%). Inactivity times remained comparable. ConclusionsThe remote assessment of MS with DHTTs is a relatively nascent but growing field of research. The continued assessment and improvement of UX design features can play a crucial role in the successful long-term adoption of new DHTTs.

Abstract Floodlight Open was a global, open-access, digital-only study designed to understand the drivers and barriers in deployment and use of a smartphone app in a naturalistic setting and broad study population of people with and without multiple sclerosis (MS). The study utilised the Floodlight Open app: a ‘bring-your-own-device’ solution that remotely measures a user’s mood, cognition, hand motor function, and gait and postural stability via smartphone sensor-based tests requiring active user input (‘active tests’). Levels of mobility of study participants (‘life-space measurement’) were passively measured. Study data from these tests were made available via an open-access platform. Data from 1350 participants with self-declared MS and 1133 participants with self-declared non-MS from 17 countries across four continents were included in this report. Overall, MS participants provided active test data for a mean duration of 5.6 weeks or a mean duration of 19 non-consecutive days. This duration increased among MS participants who persisted beyond the first week to a mean of 10.3 weeks or 36.5 non-consecutive days. Passively collected life-space measurement data were generated by MS participants for a mean duration of 9.8 weeks or 50.6 non-consecutive days. This duration increased to 16.3 weeks/85.1 non-consecutive days among MS participants who persisted beyond the first week. Older age, self-declared MS disease status, and clinical supervision as part of concomitant clinical research were all significantly associated with higher persistence of the use of the Floodlight Open app. MS participants performed significantly worse than non-MS participants on four out of seven active tests. The findings from this multinational study inform future research to improve the dynamics of persistence of use of digital monitoring tools and further highlight challenges and opportunities in applying them to support MS clinical care.

Abstract Challenges in social communication is one of the core symptom domains in autism spectrum disorder (ASD). Novel therapies are under development to help individuals with these challenges, however the ability to show a benefit is dependent on a sensitive and reliable measure of treatment effect. Currently, measuring these deficits requires the use of time-consuming and subjective techniques. Objective measures extracted from natural conversations could be more ecologically relevant, and administered more frequently—perhaps giving them added sensitivity to change. While several studies have used automated analysis methods to study autistic speech, they require manual transcriptions. In order to bypass this time-consuming process, an automated speaker diarization algorithm must first be applied. In this paper, we are testing whether a speaker diarization algorithm can be applied to natural conversations between autistic individuals and their conversational partner in a natural setting at home over the course of a clinical trial. We calculated the average duration that a participant would speak for within their turn. We found a significant correlation between this feature and the Vineland Adaptive Behaviour Scales (VABS) expressive communication score (r = 0.51, p = 7 × 10–5). Our results show that natural conversations can be used to obtain measures of talkativeness, and that this measure can be derived automatically, thus showing the promise of objectively evaluating communication challenges in ASD.

BackgroundThe development of touchscreen-based assessments of upper extremity function could benefit people with multiple sclerosis (MS) by allowing convenient, quantitative assessment of their condition. The Pinching Test forms a part of the Floodlight smartphone app (F. Hoffmann-La Roche Ltd, Basel, Switzerland) for people with MS and was designed to capture upper extremity function. ObjectiveThis study aimed to evaluate the Pinching Test as a tool for remotely assessing upper extremity function in people with MS. MethodsUsing data from the 24-week, prospective feasibility study investigating the Floodlight Proof-of-Concept app for remotely assessing MS, we examined 13 pinching, 11 inertial measurement unit (IMU)–based, and 13 fatigability features of the Pinching Test. We assessed the test-retest reliability using intraclass correlation coefficients [second model, first type; ICC(2,1)], age- and sex-adjusted cross-sectional Spearman rank correlation, and known-groups validity (data aggregation: median [all features], SD [fatigability features]). ResultsWe evaluated data from 67 people with MS (mean Expanded Disability Status Scale [EDSS]: 2.4 [SD 1.4]) and 18 healthy controls. In this cohort of early MS, pinching features were reliable [ICC(2,1)=0.54-0.81]; correlated with standard clinical assessments, including the Nine-Hole Peg Test (9HPT) (|r|=0.26-0.54; 10/13 features), EDSS (|r|=0.25-0.36; 7/13 features), and the arm items of the 29-item Multiple Sclerosis Impact Scale (MSIS-29) (|r|=0.31-0.52; 7/13 features); and differentiated people with MS-Normal from people with MS-Abnormal (area under the curve: 0.68-0.78; 8/13 features). IMU-based features showed similar test-retest reliability [ICC(2,1)=0.47-0.84] but showed little correlations with standard clinical assessments. In contrast, fatigability features (SD aggregation) correlated with 9HPT time (|r|=0.26-0.61; 10/13 features), EDSS (|r|=0.26-0.41; 8/13 features), and MSIS-29 arm items (|r|=0.32-0.46; 7/13 features). ConclusionsThe Pinching Test provides a remote, objective, and granular assessment of upper extremity function in people with MS that can potentially complement standard clinical evaluation. Future studies will validate it in more advanced MS. Trial RegistrationClinicalTrials.gov NCT02952911; https://clinicaltrials.gov/study/NCT02952911

Abstract Objective To validate the smartphone sensor‐based Draw a Shape Test – a part of the Floodlight Proof‐of‐Concept app for remotely assessing multiple sclerosis‐related upper extremity impairment by tracing six different shapes. Methods People with multiple sclerosis, classified functionally normal/abnormal via their Nine‐Hole Peg Test time, and healthy controls participated in a 24‐week, nonrandomized study. Spatial (trace accuracy), temporal (mean and variability in linear, angular, and radial drawing velocities, and dwell time ratio), and spatiotemporal features (trace celerity) were cross‐sectionally analyzed for correlation with standard clinical and brain magnetic resonance imaging (normalized brain volume and total lesion volume) disease burden measures, and for capacity to differentiate people with multiple sclerosis from healthy controls. Results Data from 69 people with multiple sclerosis and 18 healthy controls were analyzed. Trace accuracy (all shapes), linear velocity variability (circle, figure‐of‐8, spiral shapes), and radial velocity variability (spiral shape) had a mostly fair/moderate‐to‐good correlation (|r| = 0.14–0.66) with all disease burden measures. Trace celerity also had mostly fair/moderate‐to‐good correlation (|r| = 0.18–0.41) with Nine‐Hole Peg Test performance, cerebellar functional system score, and brain magnetic resonance imaging. Furthermore, partial correlation analysis related these results to motor impairment. People with multiple sclerosis showed greater drawing velocity variability, though slower mean velocity, than healthy controls. Linear velocity (spiral shape) and angular velocity (circle shape) potentially differentiate functionally normal people with multiple sclerosis from healthy controls. Interpretation The Draw a Shape Test objectively assesses upper extremity impairment and correlates with all disease burden measures, thus aiding multiple sclerosis‐related upper extremity impairment characterization.

Abstract Digital health technologies enable remote and therefore frequent measurement of motor signs, potentially providing reliable and valid estimates of motor sign severity and progression in Parkinson’s disease (PD). The Roche PD Mobile Application v2 was developed to measure bradykinesia, bradyphrenia and speech, tremor, gait and balance. It comprises 10 smartphone active tests (with ½ tests administered daily), as well as daily passive monitoring via a smartphone and smartwatch. It was studied in 316 early-stage PD participants who performed daily active tests at home then carried a smartphone and wore a smartwatch throughout the day for passive monitoring (study NCT03100149). Here, we report baseline data. Adherence was excellent (96.29%). All pre-specified sensor features exhibited good-to-excellent test–retest reliability (median intraclass correlation coefficient = 0.9), and correlated with corresponding Movement Disorder Society–Unified Parkinson's Disease Rating Scale items (rho: 0.12–0.71). These findings demonstrate the preliminary reliability and validity of remote at-home quantification of motor sign severity with the Roche PD Mobile Application v2 in individuals with early PD.

Goal: Smartphone and wearable devices may act as powerful tools to remotely monitor physical function in people with neurodegenerative and autoimmune diseases from out-of-clinic environments. Detection of progression onset or worsening of symptoms is especially important in people living with multiple sclerosis (PwMS) in order to enable optimally adapted therapeutic strategies. MS symptoms typically follow subtle and fluctuating disease courses, patient-to-patient, and over time. Current in-clinic assessments are often too infrequently administered to reflect longitudinal changes in MS impairment that impact daily life. This work, therefore, explores how smartphones can administer daily two-minute walking assessments to monitor PwMS physical function at home. Methods: Remotely collected smartphone inertial sensor data was transformed through state-of-the-art Deep Convolutional Neural Networks, to estimate a participant's daily ambulatory-related disease severity, longitudinally over a 24-week study. Results: This study demonstrated that smartphone-based ambulatory severity outcomes could accurately estimate MS level of disability, as measured by the EDSS score ($r^{2}$: 0.56,$p< $0.001). Furthermore, longitudinal severity outcomes were shown to accurately reflect individual participants' level of disability over the study duration. Conclusion: Smartphone-based assessments, that can be performed by patients from their home environments, could greatly augment standard in-clinic outcomes for neurodegenerative diseases. The ability to understand the impact of disease on daily-life between clinical visits, through objective digital outcomes, paves the way forward to better measure and identify signs of disease progression that may be occurring out-of-clinic, to monitor how different patients respond to various treatments, and to ultimately enable the development of better, and more personalised care.

Abstract The emergence of digital technologies such as smartphones in healthcare applications have demonstrated the possibility of developing rich, continuous, and objective measures of multiple sclerosis (MS) disability that can be administered remotely and out-of-clinic. Deep Convolutional Neural Networks (DCNN) may capture a richer representation of healthy and MS-related ambulatory characteristics from the raw smartphone-based inertial sensor data than standard feature-based methodologies. To overcome the typical limitations associated with remotely generated health data, such as low subject numbers, sparsity, and heterogeneous data, a transfer learning (TL) model from similar large open-source datasets was proposed. Our TL framework leveraged the ambulatory information learned on human activity recognition (HAR) tasks collected from wearable smartphone sensor data. It was demonstrated that fine-tuning TL DCNN HAR models towards MS disease recognition tasks outperformed previous Support Vector Machine (SVM) feature-based methods, as well as DCNN models trained end-to-end, by upwards of 8–15%. A lack of transparency of “black-box” deep networks remains one of the largest stumbling blocks to the wider acceptance of deep learning for clinical applications. Ensuing work therefore aimed to visualise DCNN decisions attributed by relevance heatmaps using Layer-Wise Relevance Propagation (LRP). Through the LRP framework, the patterns captured from smartphone-based inertial sensor data that were reflective of those who are healthy versus people with MS (PwMS) could begin to be established and understood. Interpretations suggested that cadence-based measures, gait speed, and ambulation-related signal perturbations were distinct characteristics that distinguished MS disability from healthy participants. Robust and interpretable outcomes, generated from high-frequency out-of-clinic assessments, could greatly augment the current in-clinic assessment picture for PwMS, to inform better disease management techniques, and enable the development of better therapeutic interventions.

Background: In this systematic review we sought to characterize practice effects on traditional in-clinic or digital performance outcome measures commonly used in one of four neurologic disease areas (multiple sclerosis; Huntington's disease; Parkinson's disease; and Alzheimer's disease, mild cognitive impairment and other forms of dementia), describe mitigation strategies to minimize their impact on data interpretation and identify gaps to be addressed in future work. Methods: Fifty-eight original articles (49 from Embase and an additional 4 from PubMed and 5 from additional sources; cut-off date January 13, 2021) describing practice effects or their mitigation strategies were included. Results: Practice effects observed in healthy volunteers do not always translate to patients living with neurologic disorders. Mitigation strategies include reliable changes indices that account for practice effects or a run-in period. While the former requires data from a reference sample showing similar practice effects, the latter requires a sufficient number of tests in the run-in period to reach steady-state performance. However, many studies only included 2 or 3 test administrations, which is insufficient to define the number of tests needed in a run-in period. Discussion: Several gaps have been identified. In particular the assessment of practice effects on an individual patient level as well as the temporal dynamics of practice effects are largely unaddressed. Here, digital tests, which allow much higher testing frequency over prolonged periods of time, can be used in future work to gain a deeper understanding of practice effects and to develop new metrics for assessing and accounting for practice effects in clinical research and clinical trials.

BackgroundRemote monitoring of Huntington disease (HD) signs and symptoms using digital technologies may enhance early clinical diagnosis and tracking of disease progression, guide treatment decisions, and monitor response to disease-modifying agents. Several recent studies in neurodegenerative diseases have demonstrated the feasibility of digital symptom monitoring. ObjectiveThe aim of this study was to evaluate a novel smartwatch- and smartphone-based digital monitoring platform to remotely monitor signs and symptoms of HD. MethodsThis analysis aimed to determine the feasibility and reliability of the Roche HD Digital Monitoring Platform over a 4-week period and cross-sectional validity over a 2-week interval. Key criteria assessed were feasibility, evaluated by adherence and quality control failure rates; test-retest reliability; known-groups validity; and convergent validity of sensor-based measures with existing clinical measures. Data from 3 studies were used: the predrug screening phase of an open-label extension study evaluating tominersen (NCT03342053) and 2 untreated cohorts—the HD Natural History Study (NCT03664804) and the Digital-HD study. Across these studies, controls (n=20) and individuals with premanifest (n=20) or manifest (n=179) HD completed 6 motor and 2 cognitive tests at home and in the clinic. ResultsParticipants in the open-label extension study, the HD Natural History Study, and the Digital-HD study completed 89.95% (1164/1294), 72.01% (2025/2812), and 68.98% (1454/2108) of the active tests, respectively. All sensor-based features showed good to excellent test-retest reliability (intraclass correlation coefficient 0.89-0.98) and generally low quality control failure rates. Good overall convergent validity of sensor-derived features to Unified HD Rating Scale outcomes and good overall known-groups validity among controls, premanifest, and manifest participants were observed. Among participants with manifest HD, the digital cognitive tests demonstrated the strongest correlations with analogous in-clinic tests (Pearson correlation coefficient 0.79-0.90). ConclusionsThese results show the potential of the HD Digital Monitoring Platform to provide reliable, valid, continuous remote monitoring of HD symptoms, facilitating the evaluation of novel treatments and enhanced clinical monitoring and care for individuals with HD.

Innovative tools are urgently needed to accelerate the evaluation and subsequent approval of novel treatments that may slow, halt, or reverse the relentless progression of Parkinson disease (PD). Therapies that intervene early in the disease continuum are a priority for the many candidates in the drug development pipeline. There is a paucity of sensitive and objective, yet clinically interpretable, measures that can capture meaningful aspects of the disease. This poses a major challenge for the development of new therapies and is compounded by the considerable heterogeneity in clinical manifestations across patients and the fluctuating nature of many signs and symptoms of PD. Digital health technologies (DHT), such as smartphone applications, wearable sensors, and digital diaries, have the potential to address many of these gaps by enabling the objective, remote, and frequent measurement of PD signs and symptoms in natural living environments. The current climate of the COVID-19 pandemic creates a heightened sense of urgency for effective implementation of such strategies. In order for these technologies to be adopted in drug development studies, a regulatory-aligned consensus on best practices in implementing appropriate technologies, including the collection, processing, and interpretation of digital sensor data, is required. A growing number of collaborative initiatives are being launched to identify effective ways to advance the use of DHT in PD clinical trials. The Critical Path for Parkinson’s Consortium of the Critical Path Institute is highlighted as a case example where stakeholders collectively engaged regulatory agencies on the effective use of DHT in PD clinical trials. Global regulatory agencies, including the US Food and Drug Administration and the European Medicines Agency, are encouraging the efficiencies of data-driven engagements through multistakeholder consortia. To this end, we review how the advancement of DHT can be most effectively achieved by aligning knowledge, expertise, and data sharing in ways that maximize efficiencies.

Digital health technology tools (DHTT) are technologies such as apps, smartphones, and wearables that remotely acquire health-related information from individuals. They have the potential advantages of objectivity and sensitivity of measurement, richness of high-frequency sensor data, and opportunity for passive collection of health-related data. Thus, DHTTs promise to provide patient phenotyping at an order of granularity several times greater than is possible with traditional clinical research tools. While the conceptual development of novel DHTTs is keeping pace with technological and analytical advancements, an as yet unaddressed gap is how to develop robust and meaningful outcome measures based on sensor data. Here, we describe two roadmaps which were developed to generate outcome measures based on DHTT data: one using a data-centric approach and the second a patient-centric approach. The data-centric approach to develop digital outcome measures summarizes those sensor features maximally sensitive to the concept of interest, exemplified with the quantification of disease progression. The patient-centric approach summarizes those sensor features that are optimally relevant to patients’ functioning in everyday life. Both roadmaps are exemplified for use in tracking disease progression in observational and clinical interventional studies, and with a DHTT designed to evaluate motor symptom severity and symptom experience in Parkinson’s disease. Use cases other than disease progression (e.g., case-finding) are considered summarily. DHTT research requires methods to summarize sensor data into meaningful outcome measures. It is hoped that the concepts outlined here will encourage a scientific discourse and eventual consensus on the creation of novel digital outcome measures for both basic clinical research and clinical drug development.

Currently, no treatments available for Parkinson’s disease (PD) can slow PD progression. At the early stage of the disease, only a subset of individuals with PD progress quickly, while the majority have a slowly progressive form of the disease. In developing treatments that aim to slow PD progression, clinical trials aim to include individuals who are likely to progress faster, such that a treatment effect, if one exists, can be identified easier and earlier. The aim of the present study was to identify baseline predictors of clinical progression in early PD. We analyzed 12-month data acquired from the PASADENA trial Part 1 (NCT03100149, n = 76 participants who were allocated to the placebo arm and did not start symptomatic therapy) and the Parkinson’s Progression Markers Initiative (PPMI) study (n = 139 demographically and clinically matched participants). By using ridge regression models including clinical characteristics, imaging, and non-imaging biomarkers, we found that Hoehn and Yahr stage and dopamine transporter single-photon emission computed tomography specific binding ratios (Dat-SPECT SBR) in putamen ipsilateral to the side of motor symptom onset predicted PD progression at the early stage of the disease. Further studies are needed to confirm the validity of these predictors to identify with high accuracy individuals with early PD with a faster progression phenotype.

Background: Currently available treatments for Parkinson's disease (PD) do not slow clinical progression nor target alpha-synuclein, a key protein associated with the disease.Objective: The study objective was to evaluate the efficacy and safety of prasinezumab, a humanized monoclonal antibody that binds aggregated alpha-synuclein, in individuals with early PD.Methods: The PASADENA study is a multicenter, randomized, double-blind, placebo-controlled treatment study. Individuals with early PD, recruited across the US and Europe, received monthly intravenous doses of prasinezumab (1,500 or 4,500 mg) or placebo for a 52-week period (Part 1), followed by a 52-week extension (Part 2) in which all participants received active treatment. Key inclusion criteria were: aged 40–80 years; Hoehn & Yahr (H&Y) Stage I or II; time from diagnosis ≤2 years; having bradykinesia plus one other cardinal sign of PD (e.g., resting tremor, rigidity); DAT-SPECT imaging consistent with PD; and either treatment naïve or on a stable monoamine oxidase B (MAO-B) inhibitor dose. Study design assumptions for sample size and study duration were built using a patient cohort from the Parkinson's Progression Marker Initiative (PPMI). In this report, baseline characteristics are compared between the treatment-naïve and MAO-B inhibitor-treated PASADENA cohorts and between the PASADENA and PPMI populations.Results: Of the 443 patients screened, 316 were enrolled into the PASADENA study between June 2017 and November 2018, with an average age of 59.9 years and 67.4% being male. Mean time from diagnosis at baseline was 10.11 months, with 75.3% in H&Y Stage II. Baseline motor and non-motor symptoms (assessed using Movement Disorder Society—Unified Parkinson's Disease Rating Scale [MDS-UPDRS]) were similar in severity between the MAO-B inhibitor-treated and treatment-naïve PASADENA cohorts (MDS-UPDRS sum of Parts I + II + III [standard deviation (SD)]; 30.21 [11.96], 32.10 [13.20], respectively). The overall PASADENA population (63.6% treatment naïve and 36.4% on MAO-B inhibitor) showed a similar severity in MDS-UPDRS scores (e.g., MDS-UPDRS sum of Parts I + II + III [SD]; 31.41 [12.78], 32.63 [13.04], respectively) to the PPMI cohort (all treatment naïve).Conclusions: The PASADENA study population is suitable to investigate the potential of prasinezumab to slow disease progression in individuals with early PD.Trial Registration: NCT03100149.

Abstract Background Avoidance to look others in the eye is a characteristic symptom of Autism Spectrum Disorders (ASD), and it has been hypothesised that quantitative monitoring of gaze patterns could be useful to objectively evaluate treatments. However, tools to measure gaze behaviour on a regular basis at a manageable cost are missing. In this paper, we investigated whether a smartphone-based tool could address this problem. Specifically, we assessed the accuracy with which the phone-based, state-of-the-art eye-tracking algorithm iTracker can distinguish between gaze towards the eyes and the mouth of a face displayed on the smartphone screen. This might allow mobile, longitudinal monitoring of gaze aversion behaviour in ASD patients in the future. Results We simulated a smartphone application in which subjects were shown an image on the screen and their gaze was analysed using iTracker. We evaluated the accuracy of our set-up across three tasks in a cohort of 17 healthy volunteers. In the first two tasks, subjects were shown different-sized images of a face and asked to alternate their gaze focus between the eyes and the mouth. In the last task, participants were asked to trace out a circle on the screen with their eyes. We confirm that iTracker can recapitulate the true gaze patterns, and capture relative position of gaze correctly, even on a different phone system to what it was trained on. Subject-specific bias can be corrected using an error model informed from the calibration data. We compare two calibration methods and observe that a linear model performs better than a previously proposed support vector regression-based method. Conclusions Under controlled conditions it is possible to reliably distinguish between gaze towards the eyes and the mouth with a smartphone-based set-up. However, future research will be required to improve the robustness of the system to roll angle of the phone and distance between the user and the screen to allow deployment in a home setting. We conclude that a smartphone-based gaze-monitoring tool provides promising opportunities for more quantitative monitoring of ASD.

BackgroundWe aimed to develop a Human Activity Recognition (HAR) model using a wrist-worn device to assess patient activity in relation to negative symptoms of schizophrenia.MethodsData were analyzed in a randomized, three-way cross-over, proof-of-mechanism study (ClinicalTrials.gov: NCT02824055) comparing two doses of RG7203 with placebo, given as adjunct to stable antipsychotic treatment in patients with chronic schizophrenia and moderate levels of negative symptoms. Baseline negative symptoms were assessed using the Positive and Negative Syndrome Scale (PANSS) and Brief Negative Symptom Scale (BNSS). Patients were given a GeneActiv™ wrist-worn actigraphy device to wear over a 15-week period. For this analysis, actigraphy data and behavioral and clinical assessments obtained during placebo treatment were used. Motivated behavior was evaluated with a computerized effort-choice task. A trained HAR model was used to classify activity and an activity–time ratio was derived. Gesture events and features were inferred from the HAR-detected activities and the acceleration signal.ResultsThirty-three patients were enrolled: mean (±SD) age 36.6 ± 7 years; mean (±SD) baseline PANSS negative symptom factor score 23.0 ± 3.5; and mean (±SD) baseline BNSS total score 36.0 ± 11.5. Activity data were collected for 31 patients with a median monitoring time of 1,859 h per patient, equating to ~11 weeks or 74% monitoring ratio. The trained HAR model demonstrated >95% accuracy in separating ambulatory and stationary activities. A positive correlation was seen between the activity–time ratio and the percent of high-effort choices (Spearman r = 0.58; P = 0.002) in the effort-choice task. Median daily gesture counts correlated negatively with the BNSS total score (Spearman r = −0.44; P = 0.03), specifically with the diminished expression sub-score (Spearman r = −0.42; P = 0.03). Gesture features also correlated negatively with the BNSS total score and diminished expression sub-scores. Activity measures showed similar correlations with PANSS negative symptom factor but did not reach significance.ConclusionOur findings support the use of wrist-worn devices to derive activity and gesture-based digital outcome measures for patients with schizophrenia with negative symptoms in a clinical trial setting.

There is increasing interest in the development and deployment of digital solutions to improve patient care and facilitate monitoring in medical practice, e.g., by remote observation of disease symptoms in the patients’ home environment. Digital health solutions today range from non-regulated wellness applications and research-grade exploratory instruments to regulated software as a medical device (SaMD). This paper discusses the considerations and complexities in developing innovative, effective, and validated SaMD for multiple sclerosis (MS). The development of SaMD requires a formalised approach (design control), inclusive of technical verification and analytical validation to ensure reliability. SaMD must be clinically evaluated, characterised for benefit and risk, and must conform to regulatory requirements associated with device classification. Cybersecurity and data privacy are also critical. Careful consideration of patient and provider needs throughout the design and testing process help developers overcome challenges of adoption in medical practice. Here, we explore the development pathway for SaMD in MS, leveraging experiences from the development of Floodlight™ MS, a continually evolving bundled solution of SaMD for remote functional assessment of MS. The development process will be charted while reflecting on common challenges in the digital space, with a view to providing insights for future developers.

In this work, we propose a Bluetooth low energy (BLE) beacon-based algorithm to enable remote measurement of the social behavior of the participants of an observational Autism Spectrum Disorder (ASD) clinical trial (NCT03611075). We have developed a mobile application for a smartphone and a smartwatch to collect beacon signals from BLE beacon sensors as well as to store information about the participants’ household rooms. Our goal is to collect beacon information about the time the participants spent in different rooms of their household to infer sociability information. We applied the same technology and setup in an internal experiment with healthy volunteers to evaluate the accuracy of the proposed algorithm in 10 different home setups, and we observed an average accuracy of 97.2%. Moreover, we show that it is feasible for the clinical study participants/caregivers to set up the BLE beacon sensors in their homes without any technical help, with 96% of them setting up the technology on the first day of data collection. Next, we present results from one-week location data from study participants collected through the proposed technology. Finally, we provide a list of good practice guidelines for optimally applying beacon technology for indoor location monitoring. The proposed algorithm enables us to estimate time spent in different rooms of a household that can pave the development of objective sociability features and eventually support decisions regarding drug efficacy in ASD.

The measurement of gait characteristics during a self-administered 2-minute walk test (2MWT), in persons with multiple sclerosis (PwMS), using a single body-worn device, has the potential to provide high-density longitudinal information on disease progression, beyond what is currently measured in the clinician-administered 2MWT. The purpose of this study is to determine the test-retest reliability, standard error of measurement (SEM) and minimum detectable change (MDC) of features calculated on gait characteristics, harvested during a self-administered 2MWT in a home environment, in 51 PwMS and 11 healthy control (HC) subjects over 24 weeks, using a single waist-worn inertial sensor-based smartphone. Excellent, or good to excellent test-retest reliability were observed in 58 of the 92 temporal, spatial and spatiotemporal gait features in PwMS. However, these were less reliable for HCs. Low SEM% and MDC% values were observed for most of the distribution measures for all gait characteristics for PwMS and HCs. This study demonstrates the inter-session test-retest reliability and provides an indication of clinically important change estimates, for interpreting the outcomes of gait characteristics measured using a body-worn smartphone, during a self-administered 2MWT. This system thus provides a reliable measure of gait characteristics in PwMS, supporting its application for the longitudinal assessment of gait deficits in this population.