Search

Background High-frequency patient-reported outcome (PRO) assessments are used to measure patients' symptoms after surgery for surgical research; however, the quality of those longitudinal PRO data has seldom been discussed. Objective The aim of this study was to determine data quality-influencing factors and to profile error trajectories of data longitudinally collected via paper-and-pencil (P&P) or web-based assessment (electronic PRO [ePRO]) after thoracic surgery. Methods We extracted longitudinal PRO data with 678 patients scheduled for lung surgery from an observational study (n=512) and a randomized clinical trial (n=166) on the evaluation of different perioperative care strategies. PROs were assessed by the MD Anderson Symptom Inventory Lung Cancer Module and single-item Quality of Life Scale before surgery and then daily after surgery until discharge or up to 14 days of hospitalization. Patient compliance and data error were identified and compared between P&P and ePRO. Generalized estimating equations model and 2-piecewise model were used to describe trajectories of error incidence over time and to identify the risk factors. Results Among 678 patients, 629 with at least 2 PRO assessments, 440 completed 3347 P&P assessments and 189 completed 1291 ePRO assessments. In total, 49.4% of patients had at least one error, including (1) missing items (64.69%, 1070/1654), (2) modifications without signatures (27.99%, 463/1654), (3) selection of multiple options (3.02%, 50/1654), (4) missing patient signatures (2.54%, 42/1654), (5) missing researcher signatures (1.45%, 24/1654), and (6) missing completion dates (0.30%, 5/1654). Patients who completed ePRO had fewer errors than those who completed P&P assessments (ePRO: 30.2% [57/189] vs. P&P: 57.7% [254/440]; P Conclusions It is possible to improve data quality of longitudinally collected PRO through ePRO, compared with P&P. However, ePRO-related sampling bias needs to be considered when designing clinical research using longitudinal PROs as major outcomes.

Background: There is increasing use of online surveys to improve data quality and timeliness and reduce costs. While there have been numerous cross-sectional studies comparing responses to online or paper surveys, there is little research from a longitudinal perspective. Objective: In the context of the well-established Australian Longitudinal Study on Women’s Health, we examined the patterns of responses to online or paper surveys across the first two waves of the study in which both modes were offered. We compared the following: differences between women born between 1946 and 1951 and between 1973 and 1978; types of device used for online completion; sociodemographic, behavioral, and health characteristics of women who responded online or using mailed paper surveys; and associations between mode of completion in the first survey and participation and mode of completion in the second survey. Methods: Participants in this study, who had responded to regular mailed surveys since 1996, were offered a choice of completing surveys using paper questionnaires or Web-based electronic questionnaires starting in 2012. Two groups of women were involved: an older cohort born between 1946 and 1951 aged in their 60s and a younger cohort born between 1973 and 1978 aged in their 30s when the online surveys were first introduced. We compared women who responded online on both occasions, women who responded online at the first survey and used the paper version of the second survey, women who changed from paper to online, and those who used paper for both surveys. Results: Of the 9663 women in their 60s who responded to one or both surveys, more than 50% preferred paper surveys (5290/9663, 54.74%, on the first survey and 5373/8621, 62.32%, on the second survey). If they chose the online version, most used computers. In contrast, of the 8628 women in their 30s, 56.04% (4835/8628) chose the online version at the first survey. While most favored computers to phones or tablets, many did try these alternatives on the subsequent survey. Many women who completed the survey online the first time preferred the paper version on the subsequent survey. In fact, for women in their 60s, the number who went from online to paper (1151/3851, 29.89%) exceeded the number who went from paper to online (734/5290, 13.88%). The online option was more likely to be chosen by better educated and healthier women. In both cohorts, women who completed paper surveys were more likely than online completers to become nonrespondents on the next survey. Due to the large sample size, almost all differences were statistically significant, with P

Background Virtual reality (VR) and augmented reality (AR) interventions are emerging as promising tools in the treatment of pediatric chronic pain conditions. However, in this young field, there is little consensus to guide the process of engaging in the development and evaluation of targeted VR-based interventions. Objective The INOVATE-Pain (Interdisciplinary Network on Virtual and Augmented Technologies for Pain management) consortium aims to advance the field of VR for pediatric chronic pain rehabilitation by providing guidance for best practices in the design, evaluation, and dissemination of VR-based interventions targeting this population. Methods An interdisciplinary meeting of 16 academics, clinicians, industry partners, and philanthropy partners was held in January 2020. Results Reviewing the state of the field, the consortium identified important directions for research-driven innovation in VR and AR clinical care, highlighted key opportunities and challenges facing the field, and established a consensus on best methodological practices to adopt in future efforts to advance the research and practice of VR and AR in pediatric pain. The consortium also identified important next steps to undertake to continue to advance the work in this promising new area of digital health pain interventions. Conclusions To realize the promise of this realm of innovation, key ingredients for success include productive partnerships among industry, academic, and clinical stakeholders; a uniform set of outcome domains and measures for standardized evaluation; and widespread access to the latest opportunities, tools, and resources. The INOVATE-Pain collaborative hopes to promote the creation, rigorous yet efficient evaluation, and dissemination of innovative VR-based interventions to reduce pain and improve quality of life for children.

Background Colorectal cancer screening by fecal occult blood testing has been an important public health test and shown to reduce colorectal cancer–related mortality. However, the low participation rate in colorectal cancer screening by the general public remains a problematic public health issue. This fact could be attributed to the complex and unpleasant operation of the screening tool. Objective This study aimed to validate a novel toilet paper–based point-of-care test (ie, JustWipe) as a public health instrument to detect fecal occult blood and provide detailed results from the evaluation of the analytic characteristics in the clinical validation. Methods The mechanism of fecal specimen collection by the toilet-paper device was verified with repeatability and reproducibility tests. We also evaluated the analytical characteristics of the test reagents. For clinical validation, we conducted comparisons between JustWipe and other fecal occult blood tests. The first comparison was between JustWipe and typical fecal occult blood testing in a central laboratory setting with 70 fecal specimens from the hospital. For the second comparison, a total of 58 volunteers were recruited, and JustWipe was compared with the commercially available Hemoccult SENSA in a point-of-care setting. Results Adequate amounts of fecal specimens were collected using the toilet-paper device with small day-to-day and person-to-person variations. The limit of detection of the test reagent was evaluated to be 3.75 µg of hemoglobin per milliliter of reagent. Moreover, the test reagent also showed high repeatability (100%) on different days and high reproducibility (>96%) among different users. The overall agreement between JustWipe and a typical fecal occult blood test in a central laboratory setting was 82.9%. In the setting of point-of-care tests, the overall agreement between JustWipe and Hemoccult SENSA was 89.7%. Moreover, the usability questionnaire showed that the novel test tool had high scores in operation friendliness (87.3/100), ease of reading results (97.4/100), and information usefulness (96.1/100). Conclusions We developed and validated a toilet paper–based fecal occult blood test for use as a point-of-care test for the rapid (in 60 seconds) and easy testing of fecal occult blood. These favorable characteristics render it a promising tool for colorectal cancer screening as a public health instrument.

Background Accurate quantification of pain in a clinical setting is vital. The use of an electronic pain scale enables data to be collected, analyzed, and utilized much faster compared with traditional paper-based scales. The advancement of smart technology in pediatric and adult pain evaluation may offer opportunities to introduce easy-to-use and reliable pain assessment methods within different clinical settings. If promptly introduced within different pediatric and adult pain clinic services, validated and easily accessible mobile health pain apps may lead to early pain detection, promoting improvement in patient’s quality of life and leading to potentially less time off from school or work. Objective This cross-sectional observational study aimed to investigate the interchangeability of an electronic visual analog scale (eVAS) app with a traditional paper visual analog scale (pVAS) among Australian children, adolescents, and adults for pain evaluation. Methods Healthy participants (age range 10-75 years) were recruited from a sporting club and a secondary school in Melbourne (Australia). The data collection process involved application of pressure (8.5 kg/cm2) from a Wagner Force Dial FDK 20 to the midpoint of the thumb. The pressure was applied twice with a 5-minute interval. At each pressure application, participants were asked to randomly record their pain perception using the “eVAS” accessible via the “Interactive Clinics” app and the traditional pVAS. Statistical analysis was conducted to determine intermethod and intramethod reliabilities. Results Overall, 109 healthy participants were recruited. Adults (mean age 42.43 years, SD 14.50 years) had excellent reliability, with an intraclass correlation coefficient (ICC) of 0.94 (95% CI 0.91-0.96). Children and adolescents (mean age 13.91 years, SD 2.89 years) had moderate-to-good intermethod and intramethod reliabilities, with an ICC of 0.80 (95% CI 0.70-0.87) and average ICC of 0.80 (95% CI 0.69-0.87), respectively. Conclusions The eVAS app appears to be interchangeable compared with the traditional pVAS among children, adolescents, and adults. This pain evaluation method may offer new opportunities to introduce user-friendly and validated pain assessment apps for patients, clinicians, and allied health professionals.

BackgroundElectronic applications are increasingly being used in hospitals for numerous purposes. ObjectiveOur aim was to assess differences in the characteristics of patients who choose paper versus electronic questionnaires and to evaluate the data quality of both approaches. MethodsBetween October 2012 and June 2013, 136 patients participated in a study on diagnosis-induced stress and anxiety. Patients were asked to fill out questionnaires at six different moments during the diagnostic phase. They were given the opportunity to fill out the questionnaires on paper or electronically (a combination of tablet and Web-based questionnaires). Demographic characteristics and completeness of returned data were compared between groups. ResultsNearly two-thirds of patients (88/136, 64.7%) chose to fill out the questionnaires on paper, and just over a third (48/136, 35.3%) preferred the electronic option. Patients choosing electronic questionnaires were significantly younger (mean 47.3 years vs mean 53.5 in the paper group, P=.01) and higher educated (P=.004). There was significantly more missing information (ie, at least one question not answered) in the paper group during the diagnostic day compared to the electronic group (using a tablet) (28/88 vs 1/48, P

Background: Improving questionnaire response rates is an everlasting issue for research. Today, the Internet can easily be used to collect data quickly. However, collecting data on the Internet can lead to biased samples because not everyone is able to access or use the Internet. The older population, for example, is much less likely to use the Internet. The Patient-Reported Outcomes Following Initial Treatment and Long-Term Evaluation of Survivorship (PROFILES) registry offers a platform to collect Web-based and paper questionnaires and to try different measures to improve response rates.Objective: In this study, our aim was to study the influence of two methods of invitation on the response rate. Our second aim was to examine the preference of questionnaire mode of administration (paper or Web-based) for the older patient in particular.Methods: To test these two invitational methods, 3406 colorectal cancer patients between ages 18 and 85 years received an invitation containing an access code for the Web-based questionnaire. They could also request a paper questionnaire with an included reply card (paper-optional group). In contrast, 179 randomly selected colorectal cancer patients received a paper questionnaire with the invitation (paper-included group). They could also choose to fill out the Web-based questionnaire with the included access code.Results: Response rates did not differ between the paper-optional and the paper-included groups (73.14%, 2491/3406 and 74.9%, 134/179, P=.57). In the paper-optional group, online response was significantly higher when compared to the paper-included group (41.23%, 1027/2491 vs 12.7%, 17/134, PConclusions: The lack of difference in response rates between invitation modes implies that researchers can leave out a paper questionnaire at invitation without lowering response rates. It may be preferable not to include a paper questionnaire because more respondents then will fill out a Web-based questionnaire, which will lead to faster available data. However, due to respondent preference, it is not likely that paper questionnaires can be left out completely in the near future.Keywords: Internet; questionnaires; aged; aged, 80 and over; cancer, colon; cancer, rectum; characteristics, population; survey methods; respondents; patient-reported outcomes

Background: Survey response rates have been declining over the past decade. The more widespread use of the Internet and Web-based technologies among potential health survey participants suggests that Web-based questionnaires may be an alternative to paper questionnaires in future epidemiological studies. Objective: To compare response rates in a population of parents by using 4 different modes of data collection for a questionnaire survey of which 1 involved a nonmonetary incentive. Methods: A random sample of 3148 parents of Danish children aged 2-17 years were invited to participate in the Danish part of the NordChild 2011 survey on their children’s health and welfare. NordChild was conducted in 1984 and 1996 in collaboration with Finland, Iceland, Norway, and Sweden using mailed paper questionnaires only. In 2011, all countries used conventional paper versions only except Denmark where the parents were randomized into 4 groups: (1) 789 received a paper questionnaire only (paper), (2) 786 received the paper questionnaire and a log-in code to the Web-based questionnaire (paper/Web), (3) 787 received a log-in code to the Web-based questionnaire (Web), and (4) 786 received log-in details to the Web-based questionnaire and were given an incentive consisting of a chance to win a tablet computer (Web/tablet). In connection with the first reminder, the nonresponders in the paper, paper/Web, and Web groups were also present with the opportunity to win a tablet computer as a means of motivation. Descriptive analysis was performed using chi-square tests. Odds ratios were used to estimate differences in response rates between the 4 modes. Results: In 2011, 1704 of 3148 (54.13%) respondents answered the Danish questionnaire. The highest response rate was with the paper mode (n=443, 56.2%). The other groups had similar response rates: paper/Web (n=422, 53.7%), Web (n=420, 53.4%), and Web/tablet (n=419, 53.3%) modes. Compared to the paper mode, the odds for response rate in the paper/Web decreased by 9% (OR 0.91, 95% CI 0.74-1.10) and by 11% (OR 0.89, 95% CI 0.73-1.09) in the Web and Web/tablet modes. The total number of responders for NordChild declined from 10,291 of 15,339 (67.09%) in 1984 and 10,667 of 15,254 (69.93%) in 1996 to 7805 of 15,945 (48.95%) in 2011 with similar declines in all 5 Nordic countries. Conclusions: Web-based questionnaires could replace traditional paper questionnaires with minor effects on response rates and lower costs. The increasing effect on the response rate on participants replying for a nonmonetary incentive could only be estimated within the 2 Web-based questionnaire modes before the first reminder. Alternative platforms to reach higher participation rates in population surveys should reflect the development of electronic devices and the ways in which the population primarily accesses the Internet. [J Med Internet Res 2013;15(8):e173]

Background: Major international guidelines recommend mental health screening during the perinatal period. However, substantial barriers to screening have been reported by pregnant and postpartum women and perinatal care providers. E-screening offers benefits that may address implementation challenges. Objective: The primary objective of this randomized controlled trial was to evaluate the feasibility and acceptability of Web-based mental health e-screening compared with paper-based screening among pregnant women. A secondary objective was to identify factors associated with women’s preferences for e-screening and disclosure of mental health concerns. Methods: Pregnant women recruited from community and hospital-based antenatal clinics and hospital-based prenatal classes were computer-randomized to a fully automated Web-based e-screening intervention group or a paper-based control group. Women were eligible if they spoke or read English, were willing to be randomized to e-screening, and were willing to participate in a follow-up diagnostic interview. The intervention group completed the Antenatal Psychosocial Health Assessment and the Edinburgh Postnatal Depression Scale on a tablet computer, while controls completed them on paper. All women completed self-report baseline questions and were telephoned 1 week after randomization by a blinded research assistant for a MINI International Neuropsychiatric Interview. Renker and Tonkin’s tool of feasibility and acceptability of computerized screening was used to assess the feasibility and acceptability of e-screening compared with paper-based screening. Intention-to-treat analysis was used. To identify factors associated with preference for e-screening and disclosure, variables associated with each outcome at P

Background: Electronic patient-reported outcomes (PRO) provide quick and usually reliable assessments of patients’ health-related quality of life (HRQL). Objective: An electronic version of the Patient-Reported Outcomes Quality of Life-human immunodeficiency virus (PROQOL-HIV) questionnaire was developed, and its face validity and reliability were assessed using standard psychometric methods. Methods: A sample of 80 French outpatients (66% male, 52/79; mean age 46.7 years, SD 10.9) were recruited. Paper-based and electronic questionnaires were completed in a randomized crossover design (2-7 day interval). Biomedical data were collected. Questionnaire version and order effects were tested on full-scale scores in a 2-way ANOVA with patients as random effects. Test-retest reliability was evaluated using Pearson and intraclass correlation coefficients (ICC, with 95% confidence interval) for each dimension. Usability testing was carried out from patients’ survey reports, specifically, general satisfaction, ease of completion, quality and clarity of user interface, and motivation to participate in follow-up PROQOL-HIV electronic assessments. Results: Questionnaire version and administration order effects (N=59 complete cases) were not significant at the 5% level, and no interaction was found between these 2 factors ( P =.94). Reliability indexes were acceptable, with Pearson correlations greater than .7 and ICCs ranging from .708 to .939; scores were not statistically different between the two versions. A total of 63 (79%) complete patients’ survey reports were available, and 55% of patients (30/55) reported being satisfied and interested in electronic assessment of their HRQL in clinical follow-up. Individual ratings of PROQOL-HIV user interface (85%-100% of positive responses) confirmed user interface clarity and usability. Conclusions: The electronic PROQOL-HIV introduces minor modifications to the original paper-based version, following International Society for Pharmacoeconomics and Outcomes Research (ISPOR) ePRO Task Force guidelines, and shows good reliability and face validity. Patients can complete the computerized PROQOL-HIV questionnaire and the scores from the paper or electronic versions share comparable accuracy and interpretation. [J Med Internet Res 2014;16(4):e115]

BackgroundWeb-based questionnaires have become increasingly popular in health research. However, reported response rates vary and response bias may be introduced. ObjectiveThe aim of this study was to evaluate whether sending a mixed invitation (paper-based together with Web-based questionnaire) rather than a Web-only invitation (Web-based questionnaire only) results in higher response and participation rates for female childhood cancer survivors filling out a questionnaire on fertility issues. In addition, differences in type of response and characteristics of the responders and nonresponders were investigated. Moreover, factors influencing preferences for either the Web- or paper-based version of the questionnaire were examined. MethodsThis study is part of a nationwide study on reproductive function, ovarian reserve, and risk of premature menopause in female childhood cancer survivors. The Web-based version of the questionnaire was available for participants through the Internet by means of a personalized user name and password. Participants were randomly selected to receive either a mixed invitation (paper-based questionnaire together with log-in details for Web-based questionnaire, n = 137) or a Web-only invitation (log-in details only, n = 140). Furthermore, the latter group could request a paper-based version of the questionnaire by filling out a form. ResultsOverall response rates were comparable in both randomization groups (83% mixed invitation group vs 89% in Web-only invitation group, P = .20). In addition, participation rates appeared not to differ (66% or 90/137, mixed invitation group vs 59% or 83/140, Web-only invitation group, P =.27). However, in the mixed invitation group, significantly more respondents filled out the paper-based questionnaire compared with the Web-only invitation group (83% or 75/90 and 65% or 54/83, respectively, P = .01). The 44 women who filled out the Web-based version of the questionnaire had a higher educational level than the 129 women who filled out the paper-based version (P = .01). Furthermore, the probability of filling out the Web-based questionnaire appeared to be greater for women who were allocated to the Web-only invitation group (OR = 2.85, 95% CI 1.31 - 6.21), were older (OR = 1.08, 95% CI 1.02 - 1.15), had a higher educational level (OR high vs low = 0.06, 95% CI 0.01 - 0.52), or were students (OR employed vs student = 3.25, 95% CI 1.00 - 10.56). ConclusionsAlthough overall response as well as participation rates to both types of invitations were similar, adding a paper version of a questionnaire to a Web-only invitation resulted in more respondents filling out the paper-based version. In addition, women who were older, had a higher level of education, or were students, were more likely to have filled out the Web-based version of the questionnaire. Given the many advantages of Web-based over paper-based questionnaires, researchers should strongly consider using Web-based questionnaires, although possible response bias when using these types of questionnaires should be taken into account. Trial RegistrationNederlands Trial Register NTR2922; http://www.trialregister.nl/trialreg/admin/rctview.asp?TC=2922 (Archived by WebCite at http://www.webcitation.org/5zRRdMrDv)

Background: Maternal, Newborn, and Child Health (MNCH) household survey data are collected mainly with pen-and-paper. Smartphone data collection may have advantages over pen-and-paper, but little evidence exists on how they compare. Objective: To compare smartphone data collection versus the use of pen-and-paper for infant feeding practices of the MNCH household survey. We compared the two data collection methods for differences in data quality (data recording, data entry, open-ended answers, and interrater reliability), time consumption, costs, interviewers’ perceptions, and problems encountered. Methods: We recruited mothers of infants aged 0 to 23 months in four village clinics in Zhaozhou Township, Zhao County, Hebei Province, China. We randomly assigned mothers to a smartphone or a pen-and-paper questionnaire group. A pair of interviewers simultaneously questioned mothers on infant feeding practices, each using the same method (either smartphone or pen-and-paper). Results: We enrolled 120 mothers, and all completed the study. Data recording errors were prevented in the smartphone questionnaire. In the 120 pen-and-paper questionnaires (60 mothers), we found 192 data recording errors in 55 questionnaires. There was no significant difference in recording variation between the groups for the questionnaire pairs (P = .32) or variables (P = .45). The smartphone questionnaires were automatically uploaded and no data entry errors occurred. We found that even after double data entry of the pen-and-paper questionnaires, 65.0% (78/120) of the questionnaires did not match and needed to be checked. The mean duration of an interview was 10.22 (SD 2.17) minutes for the smartphone method and 10.83 (SD 2.94) minutes for the pen-and-paper method, which was not significantly different between the methods (P = .19). The mean costs per questionnaire were higher for the smartphone questionnaire (¥143, equal to US $23 at the exchange rate on April 24, 2012) than for the pen-and-paper questionnaire (¥83, equal to US $13). The smartphone method was acceptable to interviewers, and after a pilot test we encountered only minor problems (eg, the system halted for a few seconds or it shut off), which did not result in data loss. Conclusions: This is the first study showing that smartphones can be successfully used for household data collection on infant feeding in rural China. Using smartphones for data collection, compared with pen-and-paper, eliminated data recording and entry errors, had similar interrater reliability, and took an equal amount of time per interview. While the costs for the smartphone method were higher than the pen-and-paper method in our small-scale survey, the costs for both methods would be similar for a large-scale survey. Smartphone data collection should be further evaluated for other surveys and on a larger scale to deliver maximum benefits in China and elsewhere. [J Med Internet Res 2012;14(5):e119]

BackgroundThere is growing interest in the use of information communication technologies to treat obesity. An intervention delivered by smartphone could be a convenient, potentially cost-effective, and wide-reaching weight management strategy. Although there have been studies of texting-based interventions and smartphone applications (apps) used as adjuncts to other treatments, there are currently no randomized controlled trials (RCT) of a stand-alone smartphone application for weight loss that focuses primarily on self-monitoring of diet and physical activity. ObjectiveThe aim of this pilot study was to collect acceptability and feasibility outcomes of a self-monitoring weight management intervention delivered by a smartphone app, compared to a website and paper diary. MethodsA sample of 128 overweight volunteers were randomized to receive a weight management intervention delivered by smartphone app, website, or paper diary. The smartphone app intervention, My Meal Mate (MMM), was developed by the research team using an evidence-based behavioral approach. The app incorporates goal setting, self-monitoring of diet and activity, and feedback via weekly text message. The website group used an existing commercially available slimming website from a company called Weight Loss Resources who also provided the paper diaries. The comparator groups delivered a similar self-monitoring intervention to the app, but by different modes of delivery. Participants were recruited by email, intranet, newsletters, and posters from large local employers. Trial duration was 6 months. The intervention and comparator groups were self-directed with no ongoing human input from the research team. The only face-to-face components were at baseline enrollment and brief follow-up sessions at 6 weeks and 6 months to take anthropometric measures and administer questionnaires. ResultsTrial retention was 40/43 (93%) in the smartphone group, 19/42 (55%) in the website group, and 20/43 (53%) in the diary group at 6 months. Adherence was statistically significantly higher in the smartphone group with a mean of 92 days (SD 67) of dietary recording compared with 35 days (SD 44) in the website group and 29 days (SD 39) in the diary group (P

The coronavirus disease (COVID-19) pandemic has created an urgent need for coordinated mechanisms to respond to the outbreak across health sectors, and digital health solutions have been identified as promising approaches to address this challenge. This editorial discusses the current situation regarding digital health solutions to fight COVID-19 as well as the challenges and ethical hurdles to broad and long-term implementation of these solutions. To decrease the risk of infection, telemedicine has been used as a successful health care model in both emergency and primary care. Official communication plans should promote facile and diverse channels to inform people about the pandemic and to avoid rumors and reduce threats to public health. Social media platforms such as Twitter and Google Trends analyses are highly beneficial to model pandemic trends as well as to monitor the evolution of patients’ symptoms or public reaction to the pandemic over time. However, acceptability of digital solutions may face challenges due to potential conflicts with users’ cultural, moral, and religious backgrounds. Digital tools can provide collective public health benefits; however, they may be intrusive and can erode individual freedoms or leave vulnerable populations behind. The COVID-19 pandemic has demonstrated the strong potential of various digital health solutions that have been tested during the crisis. More concerted measures should be implemented to ensure that future digital health initiatives will have a greater impact on the epidemic and meet the most strategic needs to ease the life of people who are at the forefront of the crisis.

Background The use of the Internet to administer questionnaires has many potential advantages over the use of pen-and-paper administration. Yet it is important to validate Internet administration, as most questionnaires were initially developed and validated for pen-and-paper delivery. While some have been validated for use over the Internet, these questionnaires have predominately been used amongst the healthy general population. To date, information is lacking on the validity of questionnaires administered over the Internet in patients with chronic diseases such as heart failure. Objectives To determine the validity of three heart failure questionnaires administered over the Internet compared to pen-and-paper administration in patients with heart failure. Methods We conducted a prospective randomized study using test-retest design comparing administration via the Internet to pen-and-paper administration for three heart failure questionnaires provided to patients recruited from a heart failure clinic in Toronto, Ontario, Canada: the Kansas City Cardiomyopathy Questionnaire (KCCQ), the Minnesota Living with Heart Failure Questionnaire (MLHFQ), and the Self-Care Heart Failure Index (SCHFI). Results Of the 58 subjects enrolled, 34 completed all three questionnaires. The mean difference and confidence intervals for the summary scores of the KCCQ, MLHFQ, and SCHFI were 1.2 (CI -1.5 to 4.0, scale from 0 to 100), 4.0 (CI -1.98 to 10.04, scale from 0 to 105), and 10.1 (CI 1.18 to 19.07, scale from 66.7 to 300), respectively. Conclusions Internet administration of the KCCQ appears to be equivalent to pen-and-paper administration. For the MLHFQ and SCHFI, we were unable to demonstrate equivalence. Further research is necessary to determine if the administration methods are equivalent for these instruments.

This article will provide a framework for producing immersive 360-degree videos for pediatric and adult patients in hospitals. This information may be useful to hospitals across the globe who may wish to produce similar videos for their patients. Advancements in immersive 360-degree technologies have allowed us to produce our own “virtual experience” where our children can prepare for anesthesia by “experiencing” all the sights and sounds of receiving and recovering from an anesthetic. We have shown that health care professionals, children, and their parents find this form of preparation valid, acceptable and fun. Perhaps more importantly, children and parents have self-reported that undertaking our virtual experience has led to a reduction in their anxiety when they go to the operating room. We provide definitions, and technical aspects to assist other health care professionals in the development of low-cost 360-degree videos.

BackgroundResearch in quality of life traditionally relies on paper-and-pencil questionnaires. Easy access to the Internet has inspired a number of studies that use the Internet to collect questionnaire data. However, Internet-based data collection may differ from traditional methods with respect to response rate and data quality as well as the validity and reliability of the involved scales. Objective We used a randomized design to compare a paper-and-pencil questionnaire with an Internet version of the same questionnaire with respect to differences in response rate and completeness of data. Methods Women referred for mammography at a Danish public hospital from September 2004 to April 2005, aged less than 67 years and without a history of breast cancer, were eligible for the study. The women received the invitation to participate along with the usual letter from the Department of Radiology. A total of 533 women were invited to participate. They were randomized to receive either a paper questionnaire, with a prepaid return envelope, or a guideline on how to fill in the Internet-based version online. The questionnaire consisted of 17 pages with a total of 119 items, including the Short Form-36, Multidimensional Fatigue Inventory-20, Hospital Anxiety and Depression Scale, and questions regarding social status, education level, occupation, and access to the Internet. Nonrespondents received a postal reminder giving them the option of filling out the other version of the questionnaire. Results The response rate before the reminder was 17.9% for the Internet group compared to 73.2% for the paper-and-pencil group (risk difference 55.3%, P < .001). After the reminder, when the participant could chose between versions of the questionnaire, the total response rate for the Internet and paper-and-pencil group was 64.2% and 76.5%, respectively (risk difference 12.2%, P = .002). For the Internet version, 97.8% filled in a complete questionnaire without missing data, while 63.4% filled in a complete questionnaire for the paper-and-pencil version (risk difference 34.5%, P < .001). Conclusions The Internet version of the questionnaire was superior with respect to completeness of data, but the response rate in this population of unselected patients was low. The general population has yet to become more familiar with the Internet before an online survey can be the first choice of researchers, although it is worthwhile considering within selected populations of patients as it saves resources and provides more complete answers. An Internet version may be combined with the traditional version of a questionnaire, and in follow-up studies of patients it may be more feasible to offer Internet versions.

The Internet is becoming increasingly important as a way for patients to acquire medical information and as a means for patient-physician communication. Questions about appropriate use of this new technology have been brought to the fore by the many patients using the Internet to seek sildenafil prescriptions.To present the first description of a physician designed and directed Internet-based prescribing system of sildenafil, together with data covering more than 2,100 patient encounters.Retrospective analysis of a large case series from a medical practice that prescribes sildenafil based on medical and sexual histories obtained through a physician designed and directed World Wide Web (WWW) site, compared against patients from clinics at a Midwestern inner city medical center. We compared all 2,104 Internet patients seeking sildenafil prescriptions online between June 14, 1998, and March 1, 1999, with all 36 medical center patients obtaining sildenafil prescriptions during the same period. The outcome measures compared were: completeness of medical record; patient safety as noted by the follow up responses of all patients requesting refills, any comments received by the internet site (webmaster), and patient or physician comments noted in the clinic medical record; satisfaction as noted by the follow up responses of all patients requesting refills, any comments received by the internet site (webmaster), and patient or physician comments noted in the clinic medical record; examinations and laboratory tests.Fifty-six percent of Internet requests came from 46 states, and 44% from eight foreign countries. Of 2,104 requests, 2,100 were granted. Three hundred ten patients have requested medication refills: all reported erections sufficient for intercourse and 69% said their satisfaction exceeded all expectations; none were at all dissatisfied. Side effect rates were comparable to those in the literature. Comparison of the medical history obtained from Internet patients with that recorded in clinic patients' charts revealed that the former was far more complete. No clinic patient received any examination or laboratory test specific for erectile dysfunction or its causes. There were no reported deaths or serious complications in either group.Internet-based prescription of sildenafil provides the physician with a complete and very detailed medical and sexual history for 100% of patients without denying any information routinely obtained in a direct patient contact setting. Internet-based practice, which may be expected to require far fewer healthcare resources than traditional settings, rates very high in patient satisfaction among patients requesting a refill; no negative comments were received from all other patients. Overall, these data support the safety and effectiveness of Internet prescribing of selected medications.

Background Urinary tract infections (UTIs) are one of the most common conditions in women. Current information on the presentation, management, and natural course of the infection is based on paper diaries filled out and subsequently posted by patients. Objective The aim of this study is to explore the feasibility of a smartphone app to assess the natural course and management of UTIs. Methods A smartphone app was developed to collect data from study participants presenting with symptoms of UTI in general practice. After initial demographic and treatment information, symptom severity was recorded by the patient after a reminder on their smartphone, which occurred twice daily for a period of 7 days or until symptom resolution. Results A total of 181 women aged 18-76 years downloaded the smartphone app. The duration of symptoms was determined from the results of 178 participants. All patients submitted a urine sample, most patients were prescribed an antibiotic (163/181, 90.1%), and 38.7% (70/181) of the patients had a positive culture. Moderately bad or worse symptoms lasted a mean of 3.8 (SD 3.2; median 4) days, and 70.2% (125/178) of the patients indicated that they were cured on day 4 after consultation. This compares with other research assessing symptom duration and management of UTIs using paper diaries. Patients were very positive about the usability of the smartphone app and often found the reminders supportive. On the basis of the feedback and the analysis of the data, some suggestions for improvement were made. Conclusions Smartphone diaries for symptom scores over the course of infections are an efficient and acceptable means of collecting data in research.

Background Many weight loss programs show short-term effectiveness, but subsequent weight loss maintenance is difficult to achieve. Digital technologies offer a promising means of delivering behavior change approaches at low costs and on a wide scale. The Navigating to a Healthy Weight (NoHoW) project, which was funded by the European Union’s Horizon 2020 research and innovation program, aimed to develop, test, and evaluate a digital toolkit designed to promote successful long-term weight management. The toolkit was tested in an 18-month, large-scale, international, 2×2 factorial (motivation and self-regulation vs emotion regulation) randomized controlled trial that was conducted on adults with overweight or obesity who lost ≥5% of their body weight in the preceding 12 months before enrollment into the intervention. Objective This paper aims to describe the development of the NoHoW Toolkit, focusing on the logic models, content, and specifications, as well as the results from user testing. Methods The toolkit was developed by using a systematic approach, which included the development of the theory-based logic models, the selection of behavior change techniques, the translation of these techniques into a web-based app (NoHoW Toolkit components), technical development, and the user evaluation and refinement of the toolkit. Results The toolkit included a set of web-based tools and inputs from digital tracking devices (smart scales and activity trackers) and modules that targeted weight, physical activity, and dietary behaviors. The final toolkit comprised 34 sessions that were distributed through 15 modules and provided active content over a 4-month period. The motivation and self-regulation arm consisted of 8 modules (17 sessions), the emotion regulation arm was presented with 7 modules (17 sessions), and the combined arm received the full toolkit (15 modules; 34 sessions). The sessions included a range of implementations, such as videos, testimonies, and questionnaires. Furthermore, the toolkit contained 5 specific data tiles for monitoring weight, steps, healthy eating, mood, and sleep. Conclusions A systematic approach to the development of digital solutions based on theory, evidence, and user testing may significantly contribute to the advancement of the science of behavior change and improve current solutions for sustained weight management. Testing the toolkit by using a 2×2 design provided a unique opportunity to examine the effect of motivation and self-regulation and emotion regulation separately, as well as the effect of their interaction in weight loss maintenance.

Background Elective colorectal cancer (CRC) surgeries offer enhanced surgical outcomes but demand high self-efficacy in prehabilitation and competency in self-care and disease management postsurgery. Conventional strategies to meet perioperative needs have not been pragmatic, and there remains a pressing need for novel technologies that could improve health outcomes. Objective The aim of this paper was to describe the development of a smartphone-based interactive CRC self-management enhancement psychosocial program (iCanManage) in order to improve health outcomes among patients who undergo elective CRC surgeries and their family caregivers. Methods A multidisciplinary international team comprising physicians, specialist nurses, a psychologist, software engineers, academic researchers, cancer survivors, patient ambassadors, and ostomy care medical equipment suppliers was formed to facilitate the development of this patient-centric digital solution. The process occurred in several stages: (1) review of current practice through clinic visits and on-site observations; (2) review of literature and findings from preliminary studies; (3) content development grounded in an underpinning theory; (4) integration of support services; and (5) optimizing user experience through improving interface aesthetics and customization. In our study, 5 participants with CRC performed preliminary assessments on the quality of the developed solution using the 20-item user version of the Mobile App Rating Scale (uMARS), which had good psychometric properties. Results Based on the collected uMARS data, the smartphone app was rated highly for functionality, aesthetics, information quality, and perceived impact, and moderately for engagement and subjective quality. Several limiting factors such as poor agility in the adoption of digital technology and low eHealth literacy were identified despite efforts to promote engagement and ensure ease of use of the mobile app. To overcome such barriers, additional app-training sessions, an instruction manual, and regular telephone calls will be incorporated into the iCanManage program during the trial period. Conclusions This form of multidisciplinary collaboration is advantageous as it can potentially streamline existing care paths and allow the delivery of more holistic care to the CRC population during the perioperative period. Should the program be found to be effective and sustainable, hospitals adopting this digital solution may achieve better resource allocation and reduce overall health care costs in the long run. Trial Registration ClinicalTrials.gov NCT04159363; https://clinicaltrials.gov/ct2/show/NCT04159363

Background Access to neurological care for Parkinson disease (PD) is a rare privilege for millions of people worldwide, especially in resource-limited countries. In 2013, there were just 1200 neurologists in India for a population of 1.3 billion people; in Africa, the average population per neurologist exceeds 3.3 million people. In contrast, 60,000 people receive a diagnosis of PD every year in the United States alone, and similar patterns of rising PD cases—fueled mostly by environmental pollution and an aging population—can be seen worldwide. The current projection of more than 12 million patients with PD worldwide by 2040 is only part of the picture given that more than 20% of patients with PD remain undiagnosed. Timely diagnosis and frequent assessment are key to ensure timely and appropriate medical intervention, thus improving the quality of life of patients with PD. Objective In this paper, we propose a web-based framework that can help anyone anywhere around the world record a short speech task and analyze the recorded data to screen for PD. Methods We collected data from 726 unique participants (PD: 262/726, 36.1% were women; non-PD: 464/726, 63.9% were women; average age 61 years) from all over the United States and beyond. A small portion of the data (approximately 54/726, 7.4%) was collected in a laboratory setting to compare the performance of the models trained with noisy home environment data against high-quality laboratory-environment data. The participants were instructed to utter a popular pangram containing all the letters in the English alphabet, “the quick brown fox jumps over the lazy dog.” We extracted both standard acoustic features (mel-frequency cepstral coefficients and jitter and shimmer variants) and deep learning–based embedding features from the speech data. Using these features, we trained several machine learning algorithms. We also applied model interpretation techniques such as Shapley additive explanations to ascertain the importance of each feature in determining the model’s output. Results We achieved an area under the curve of 0.753 for determining the presence of self-reported PD by modeling the standard acoustic features through the XGBoost—a gradient-boosted decision tree model. Further analysis revealed that the widely used mel-frequency cepstral coefficient features and a subset of previously validated dysphonia features designed for detecting PD from a verbal phonation task (pronouncing “ahh”) influence the model’s decision the most. Conclusions Our model performed equally well on data collected in a controlled laboratory environment and in the wild across different gender and age groups. Using this tool, we can collect data from almost anyone anywhere with an audio-enabled device and help the participants screen for PD remotely, contributing to equity and access in neurological care.

Background Virtual reality (VR) and augmented reality (AR) have recently become popular research themes. However, there are no published bibliometric reports that have analyzed the corresponding scientific literature in relation to the application of these technologies in medicine. Objective We used a bibliometric approach to identify and analyze the scientific literature on VR and AR research in medicine, revealing the popular research topics, key authors, scientific institutions, countries, and journals. We further aimed to capture and describe the themes and medical conditions most commonly investigated by VR and AR research. Methods The Web of Science electronic database was searched to identify relevant papers on VR research in medicine. Basic publication and citation data were acquired using the “Analyze” and “Create Citation Report” functions of the database. Complete bibliographic data were exported to VOSviewer and Bibliometrix, dedicated bibliometric software packages, for further analyses. Visualization maps were generated to illustrate the recurring keywords and words mentioned in the titles and abstracts. Results The analysis was based on data from 8399 papers. Major research themes were diagnostic and surgical procedures, as well as rehabilitation. Commonly studied medical conditions were pain, stroke, anxiety, depression, fear, cancer, and neurodegenerative disorders. Overall, contributions to the literature were globally distributed with heaviest contributions from the United States and United Kingdom. Studies from more clinically related research areas such as surgery, psychology, neurosciences, and rehabilitation had higher average numbers of citations than studies from computer sciences and engineering. Conclusions The conducted bibliometric analysis unequivocally reveals the versatile emerging applications of VR and AR in medicine. With the further maturation of the technology and improved accessibility in countries where VR and AR research is strong, we expect it to have a marked impact on clinical practice and in the life of patients.

Background Longitudinal follow-up of older persons living with HIV is essential for the ascertainment of aging-related clinical and behavioral outcomes, and self-administered questionnaires are necessary for collecting behavioral information in research involving persons living with HIV. Web-based self-reported data collection results in higher data quality than paper-and-pencil questionnaires in a wide range of populations. The option of remote web-based surveys may also increase retention in long-term research studies. However, the acceptability and feasibility of web-based data collection in clinical research involving older persons living with HIV have never been studied. Objective This study aims to assess the acceptability and feasibility of a web-based survey to collect information on sexual, substance use, and physical activity behaviors; compare the data quality of the web-based survey with that of a paper-and-pencil questionnaire; and summarize web-based survey metrics. Methods This pilot study took place within the AIDS Clinical Trials Group A5322 study, a longitudinal cohort of men and women living with HIV (aged ≥40 years), followed at 32 clinical sites in the United States and Puerto Rico. A total of 4 sites participated in this study. A web-based survey was created using self-administered questionnaires typically completed in A5322 via paper and pencil. Pilot study participants completed these questionnaires via web-based survey at one research visit in lieu of paper-and-pencil administration. Two questions were added to assess feasibility, defined as participants’ perception of the ease of web-based survey completion (very hard, hard, easy, very easy), and their preferred format (computer or tablet, paper and pencil, no preference) for completing the questions in the future (acceptability). Feasibility and acceptability were summarized overall and by demographic and clinical characteristics; the proportion of evaluable data by web-based survey versus previously administered paper-and-pencil questionnaires (data quality) was compared for each question. Results Acceptability and feasibility were high overall: 50.0% (79/158) preferred computer or tablet, 38.0% (60/158) reported no preference, and 12.0% (19/158) preferred paper and pencil; 93.0% (147/158) reported survey completion easy or very easy. Older age was associated with lower odds of preferring computer or tablet to paper and pencil (odds ratio per 1-year increase in age: 0.91, 95% CI 0.85-0.98). Individuals who found the survey hard or very hard had a lower median neurocognitive test score than those who found it easy or very easy. Data quality with web-based survey administration was similar to or higher than that with paper-and-pencil administration for most questions. Conclusions Web-based survey administration was acceptable and feasible in this cohort of older adults living with HIV, and data quality was high. Web-based surveys can be a useful tool for valid data collection and can potentially improve retention in long-term follow-up studies.

Background Detection and quantification of intra-abdominal free fluid (ie, ascites) on computed tomography (CT) images are essential processes for finding emergent or urgent conditions in patients. In an emergency department, automatic detection and quantification of ascites will be beneficial. Objective We aimed to develop an artificial intelligence (AI) algorithm for the automatic detection and quantification of ascites simultaneously using a single deep learning model (DLM). Methods We developed 2D DLMs based on deep residual U-Net, U-Net, bidirectional U-Net, and recurrent residual U-Net (R2U-Net) algorithms to segment areas of ascites on abdominopelvic CT images. Based on segmentation results, the DLMs detected ascites by classifying CT images into ascites images and nonascites images. The AI algorithms were trained using 6337 CT images from 160 subjects (80 with ascites and 80 without ascites) and tested using 1635 CT images from 40 subjects (20 with ascites and 20 without ascites). The performance of the AI algorithms was evaluated for diagnostic accuracy of ascites detection and for segmentation accuracy of ascites areas. Of these DLMs, we proposed an AI algorithm with the best performance. Results The segmentation accuracy was the highest for the deep residual U-Net model with a mean intersection over union (mIoU) value of 0.87, followed by U-Net, bidirectional U-Net, and R2U-Net models (mIoU values of 0.80, 0.77, and 0.67, respectively). The detection accuracy was the highest for the deep residual U-Net model (0.96), followed by U-Net, bidirectional U-Net, and R2U-Net models (0.90, 0.88, and 0.82, respectively). The deep residual U-Net model also achieved high sensitivity (0.96) and high specificity (0.96). Conclusions We propose a deep residual U-Net–based AI algorithm for automatic detection and quantification of ascites on abdominopelvic CT scans, which provides excellent performance.

Background Incorporating cognitive testing into routine clinical practice is a challenge in multiple sclerosis (MS), given the wide spectrum of both cognitive and physical impairments people can have and the time that testing requires. Shortened paper and verbal assessments predominate but still are not used routinely. Computer-based tests are becoming more widespread; however, changes in how a paper test is implemented can impact what exactly is being assessed in an individual. The Symbol Digit Modalities Test (SDMT) is one validated test that forms part of the cognitive batteries used in MS and has some computer-based versions. We developed a tablet-based SDMT variant that has the potential to be ultimately deployed to patients’ own devices. Objective This paper aims to develop, validate, and deploy a computer-based SDMT variant, the Cognition Reaction (CoRe) test, that can reliably replicate the characteristics of the paper-based SDMT. Methods We carried out analysis using Pearson and intraclass correlations, as well as a Bland-Altman comparison, to examine consistency between the SDMT and CoRe tests and for test-retest reliability. The SDMT and CoRe tests were evaluated for sensitivity to disability levels and age. A novel metric in CoRe was found: question answering velocity could be calculated. This was evaluated in relation to disability levels and age for people with MS and compared with a group of healthy control volunteers. Results SDMT and CoRe test scores were highly correlated and consistent with 1-month retest values. Lower scores were seen in patients with higher age and some effect was seen with increasing disability. There was no learning effect evident. Question answering velocity demonstrated a small increase in speed over the 90-second duration of the test in people with MS and healthy controls. Conclusions This study validates a computer-based alternative to the SDMT that can be used in clinics and beyond. It enables accurate recording of elements of cognition relevant in MS but offers additional metrics that may offer further value to clinicians and people with MS.

Background Accurate medication reconciliation reduces the risk of drug incompatibilities and adverse events that can occur during transitions in care. Community pharmacies (CPs) are a crucial part of the health care system and could be involved in collecting essential information on conventional and supplementary drugs used at home. Objective The aim of this paper was to establish an alliance between our cancer institute, Istituto Romagnolo per lo Studio dei Tumori (IRST), and CPs, the latter entrusted with the completion of a pharmacological recognition survey. We also aimed to integrate the national information technology (IT) platform of CPs with the electronic medical records of IRST. Methods Cancer patients undergoing antiblastic treatments were invited to select a CP taking part in the study and to complete the pharmacological recognition step. The information collected by the pharmacist was sent to the electronic medical records of IRST through the new IT platform, after which the oncologist performed the reconciliation process. Results A total of 66 CPs completed surveys for 134 patients. An average of 5.9 drugs per patient was used at home, with 12 or more used in the most advanced age groups. Moreover, 60% (80/134) of the patients used nonconventional products or critical foods. Some potential interactions between nonconventional medications and cancer treatments were reported. Conclusions In the PROF-1 (Progetto di Rete in Oncologia con le Farmacie di comunità della Romagna) study, an alliance was created between our cancer center and CPs to improve medication reconciliation, and a new integrated IT platform was validated. Trial Registration ClinicalTrials.gov NCT04796142; https://clinicaltrials.gov/ct2/show/NCT04796142

Background Although past research has focused on COVID-19–related frames in the news media, such research may not accurately capture and represent the perspectives of people from diverse backgrounds. Additionally, research on the public attention to COVID-19 as reflected through frames on social media is scarce. Objective This study identified the frames about the COVID-19 pandemic in the public discourse on Twitter, which voices diverse opinions. This study also investigated the amount of public attention to those frames on Twitter. Methods We collected 22 trending hashtags related to COVID-19 in the United States and 694,582 tweets written in English containing these hashtags in March 2020 and analyzed them via thematic analysis. Public attention to these frames was measured by evaluating the amount of public engagement with frames and public adoption of those frames. Results We identified 9 frames including “public health guidelines,” “quarantine life,” “solidarity,” “evidence and facts,” “call for action,” “politics,” “post-pandemic life,” “shortage panic,” and “conflict.” Results showed that some frames such as “call for action” are more appealing than others during a global pandemic, receiving greater public adoption and engagement. The “call for action” frame had the highest engagement score, followed by “conflict” and “evidence and facts.” Additionally, “post-pandemic life” had the highest adoption score, followed by “call for action” and “shortage panic.” The findings indicated that the frequency of a frame on social media does not necessarily mean greater public adoption of or engagement with the frame. Conclusions This study contributes to framing theory and research by demonstrating how trending hashtags can be used as new user-generated data to identify frames on social media. This study concludes that the identified frames such as “quarantine life” and “conflict” and themes such as “isolation” and “toilet paper panic” represent the consequences of the COVID-19 pandemic. The consequences could be (1) exclusively related to COVID-19, such as hand hygiene or isolation; (2) related to any health crisis such as social support of vulnerable groups; and (3) generic that are irrespective of COVID-19, such as homeschooling or remote working.

Background The COVID-19 pandemic has impacted people’s lives at unprecedented speed and scale, including how they eat and work, what they are concerned about, how much they move, and how much they can earn. Traditional surveys in the area of public health can be expensive and time-consuming, and they can rapidly become outdated. The analysis of big data sets (such as electronic patient records and surveillance systems) is very complex. Google Trends is an alternative approach that has been used in the past to analyze health behaviors; however, most existing studies on COVID-19 using these data examine a single issue or a limited geographic area. This paper explores Google Trends as a proxy for what people are thinking, needing, and planning in real time across the United States. Objective We aimed to use Google Trends to provide both insights into and potential indicators of important changes in information-seeking patterns during pandemics such as COVID-19. We asked four questions: (1) How has information seeking changed over time? (2) How does information seeking vary between regions and states? (3) Do states have particular and distinct patterns in information seeking? (4) Do search data correlate with—or precede—real-life events? Methods We analyzed searches on 38 terms related to COVID-19, falling into six themes: social and travel; care seeking; government programs; health programs; news and influence; and outlook and concerns. We generated data sets at the national level (covering January 1, 2016, to April 15, 2020) and state level (covering January 1 to April 15, 2020). Methods used include trend analysis of US search data; geographic analyses of the differences in search popularity across US states from March 1 to April 15, 2020; and principal component analysis to extract search patterns across states. Results The data showed high demand for information, corresponding with increasing searches for coronavirus linked to news sources regardless of the ideological leaning of the news source. Changes in information seeking often occurred well in advance of action by the federal government. The popularity of searches for unemployment claims predicted the actual spike in weekly claims. The increase in searches for information on COVID-19 care was paralleled by a decrease in searches related to other health behaviors, such as urgent care, doctor’s appointments, health insurance, Medicare, and Medicaid. Finally, concerns varied across the country; some search terms were more popular in some regions than in others. Conclusions COVID-19 is unlikely to be the last pandemic faced by the United States. Our research holds important lessons for both state and federal governments in a fast-evolving situation that requires a finger on the pulse of public sentiment. We suggest strategic shifts for policy makers to improve the precision and effectiveness of non-pharmaceutical interventions and recommend the development of a real-time dashboard as a decision-making tool.

Background There is a strong demand for an accurate and objective means of assessing acute pain among hospitalized patients to help clinicians provide pain medications at a proper dosage and in a timely manner. Heart rate variability (HRV) comprises changes in the time intervals between consecutive heartbeats, which can be measured through acquisition and interpretation of electrocardiography (ECG) captured from bedside monitors or wearable devices. As increased sympathetic activity affects the HRV, an index of autonomic regulation of heart rate, ultra–short-term HRV analysis can provide a reliable source of information for acute pain monitoring. In this study, widely used HRV time and frequency domain measurements are used in acute pain assessments among postoperative patients. The existing approaches have only focused on stimulated pain in healthy subjects, whereas, to the best of our knowledge, there is no work in the literature building models using real pain data and on postoperative patients. Objective The objective of our study was to develop and evaluate an automatic and adaptable pain assessment algorithm based on ECG features for assessing acute pain in postoperative patients likely experiencing mild to moderate pain. Methods The study used a prospective observational design. The sample consisted of 25 patient participants aged 18 to 65 years. In part 1 of the study, a transcutaneous electrical nerve stimulation unit was employed to obtain baseline discomfort thresholds for the patients. In part 2, a multichannel biosignal acquisition device was used as patients were engaging in non-noxious activities. At all times, pain intensity was measured using patient self-reports based on the Numerical Rating Scale. A weak supervision framework was inherited for rapid training data creation. The collected labels were then transformed from 11 intensity levels to 5 intensity levels. Prediction models were developed using 5 different machine learning methods. Mean prediction accuracy was calculated using leave-one-out cross-validation. We compared the performance of these models with the results from a previously published research study. Results Five different machine learning algorithms were applied to perform a binary classification of baseline (BL) versus 4 distinct pain levels (PL1 through PL4). The highest validation accuracy using 3 time domain HRV features from a BioVid research paper for baseline versus any other pain level was achieved by support vector machine (SVM) with 62.72% (BL vs PL4) to 84.14% (BL vs PL2). Similar results were achieved for the top 8 features based on the Gini index using the SVM method, with an accuracy ranging from 63.86% (BL vs PL4) to 84.79% (BL vs PL2). Conclusions We propose a novel pain assessment method for postoperative patients using ECG signal. Weak supervision applied for labeling and feature extraction improves the robustness of the approach. Our results show the viability of using a machine learning algorithm to accurately and objectively assess acute pain among hospitalized patients. International Registered Report Identifier (IRRID) RR2-10.2196/17783

Background Clinical decision support (CDS) is a valuable feature of electronic health records (EHRs) designed to improve quality and safety. However, due to the complexities of system design and inconsistent results, CDS tools may inadvertently increase alert fatigue and contribute to physician burnout. A/B testing, or rapid-cycle randomized tests, is a useful method that can be applied to the EHR in order to rapidly understand and iteratively improve design choices embedded within CDS tools. Objective This paper describes how rapid randomized controlled trials (RCTs) embedded within EHRs can be used to quickly ascertain the superiority of potential CDS design changes to improve their usability, reduce alert fatigue, and promote quality of care. Methods A multistep process combining tools from user-centered design, A/B testing, and implementation science was used to understand, ideate, prototype, test, analyze, and improve each candidate CDS. CDS engagement metrics (alert views, acceptance rates) were used to evaluate which CDS version is superior. Results To demonstrate the impact of the process, 2 experiments are highlighted. First, after multiple rounds of usability testing, a revised CDS influenza alert was tested against usual care CDS in a rapid (~6 weeks) RCT. The new alert text resulted in minimal impact on reducing firings per patients per day, but this failure triggered another round of review that identified key technical improvements (ie, removal of dismissal button and firings in procedural areas) that led to a dramatic decrease in firings per patient per day (23.1 to 7.3). In the second experiment, the process was used to test 3 versions (financial, quality, regulatory) of text supporting tobacco cessation alerts as well as 3 supporting images. Based on 3 rounds of RCTs, there was no significant difference in acceptance rates based on the framing of the messages or addition of images. Conclusions These experiments support the potential for this new process to rapidly develop, deploy, and rigorously evaluate CDS within an EHR. We also identified important considerations in applying these methods. This approach may be an important tool for improving the impact of and experience with CDS. Trial Registration Flu alert trial: ClinicalTrials.gov NCT03415425; https://clinicaltrials.gov/ct2/show/NCT03415425. Tobacco alert trial: ClinicalTrials.gov NCT03714191; https://clinicaltrials.gov/ct2/show/NCT03714191

Background In many countries, depressed individuals often first visit primary care settings for consultation, but a considerable number of clinically depressed patients remain unidentified. Introducing additional screening tools may facilitate the diagnostic process. Objective This study aimed to examine whether experience sampling method (ESM)-based measures of depressive affect and behaviors can discriminate depressed from nondepressed individuals. In addition, the added value of actigraphy-based measures was examined. Methods We used data from 2 samples to develop and validate prediction models. The development data set included 14 days of ESM and continuous actigraphy of currently depressed (n=43) and nondepressed individuals (n=82). The validation data set included 30 days of ESM and continuous actigraphy of currently depressed (n=27) and nondepressed individuals (n=27). Backward stepwise logistic regression analysis was applied to build the prediction models. Performance of the models was assessed with goodness-of-fit indices, calibration curves, and discriminative ability (area under the receiver operating characteristic curve [AUC]). Results In the development data set, the discriminative ability was good for the actigraphy model (AUC=0.790) and excellent for both the ESM (AUC=0.991) and the combined-domains model (AUC=0.993). In the validation data set, the discriminative ability was reasonable for the actigraphy model (AUC=0.648) and excellent for both the ESM (AUC=0.891) and the combined-domains model (AUC=0.892). Conclusions ESM is a good diagnostic predictor and is easy to calculate, and it therefore holds promise for implementation in clinical practice. Actigraphy shows no added value to ESM as a diagnostic predictor but might still be useful when ESM use is restricted.

Background Skin cancer is the most common cancer type affecting humans. Traditional skin cancer diagnosis methods are costly, require a professional physician, and take time. Hence, to aid in diagnosing skin cancer, artificial intelligence (AI) tools are being used, including shallow and deep machine learning–based methodologies that are trained to detect and classify skin cancer using computer algorithms and deep neural networks. Objective The aim of this study was to identify and group the different types of AI-based technologies used to detect and classify skin cancer. The study also examined the reliability of the selected papers by studying the correlation between the data set size and the number of diagnostic classes with the performance metrics used to evaluate the models. Methods We conducted a systematic search for papers using Institute of Electrical and Electronics Engineers (IEEE) Xplore, Association for Computing Machinery Digital Library (ACM DL), and Ovid MEDLINE databases following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews (PRISMA-ScR) guidelines. The studies included in this scoping review had to fulfill several selection criteria: being specifically about skin cancer, detecting or classifying skin cancer, and using AI technologies. Study selection and data extraction were independently conducted by two reviewers. Extracted data were narratively synthesized, where studies were grouped based on the diagnostic AI techniques and their evaluation metrics. Results We retrieved 906 papers from the 3 databases, of which 53 were eligible for this review. Shallow AI-based techniques were used in 14 studies, and deep AI-based techniques were used in 39 studies. The studies used up to 11 evaluation metrics to assess the proposed models, where 39 studies used accuracy as the primary evaluation metric. Overall, studies that used smaller data sets reported higher accuracy. Conclusions This paper examined multiple AI-based skin cancer detection models. However, a direct comparison between methods was hindered by the varied use of different evaluation metrics and image types. Performance scores were affected by factors such as data set size, number of diagnostic classes, and techniques. Hence, the reliability of shallow and deep models with higher accuracy scores was questionable since they were trained and tested on relatively small data sets of a few diagnostic classes.

Background Survey-based studies are frequently used to describe the economic impact of multiple sclerosis (MS). However, there is no validated health resource survey available, preventing comparison of study results and meaningful conclusions regarding the efficiency of long-term treatments. Objective The aim of this study was to develop and validate a tablet- and paper-based MS health resource utilization survey. Methods We developed and validated the Multiple Sclerosis Health Resource Utilization Survey (MS-HRS), consisting of 24 cost items for paper and tablet users. Data for validation came from two large German observational studies. Survey practicability was assessed according to the response rate. Reliability was described using test-retest reliability as well as Guttman lambda. Construct validity was assessed as convergent and discriminant validity via correlations with associated patient-reported outcomes and known-group analyses. Results In total, 2207 out of 2388 (response rate: 92.4%) patients completed the survey and were included to determine psychometric properties. The test-retest reliability had an intraclass correlation coefficient of 0.828 over a course of 3 months. Convergent validity analyses showed that total costs correlated positively with increased disability (r=0.411, P Conclusions The MS-HRS is a multilingual, reliable, valid, electronically available, and easy-to-administer questionnaire providing a holistic cross-sectional and longitudinal assessment of resource utilization in patients with MS.

Background The worldwide burden of musculoskeletal diseases is increasing. The number of newly registered rheumatologists has stagnated. Primary care, which takes up a key role in early detection of rheumatic disease, is working at full capacity. COVID-19 and its containment impede rheumatological treatment. Telemedicine in rheumatology (telerheumatology) could support rheumatologists and general practitioners. Objective The goal of this study was to investigate acceptance and preferences related to the use of telerheumatology care among German rheumatologists and general practitioners. Methods A nationwide, cross-sectional, self-completed, paper-based survey on telerheumatology care was conducted among outpatient rheumatologists and general practitioners during the pre-COVID-19 period. Results A total of 73.3% (349/476) of survey participants rated their knowledge of telemedicine as unsatisfactory, poor, or very poor. The majority of survey participants (358/480, 74.6%) answered that they do not currently use telemedicine, although 62.3% (291/467) would like to. Barriers to the implementation of telemedicine include the purchase of technology equipment (182/292, 62.3%), administration (181/292, 62.0%), and poor reimbursement (156/292, 53.4%). A total of 69.6% (117/168) of the surveyed physicians reckoned that telemedicine could be used in rheumatology. Surveyed physicians would prefer to use telemedicine to communicate directly with other physicians (370/455, 81.3%) than to communicate with patients (213/455, 46.8%). Among treatment phases, 64.4% (291/452) of participants would choose to use telemedicine during follow-up. Half of the participants would choose telecounseling as a specific approach to improve rheumatology care (91/170, 53.5%). Conclusions Before COVID-19 appeared, our results indicated generally low use but high acceptance of the implementation of telerheumatology among physicians. Participants indicated that the lack of a structural framework was a barrier to the effective implementation of telerheumatology. Training courses should be introduced to address the limited knowledge on the part of physicians in the use of telemedicine. More research into telerheumatology is required. This includes large-scale randomized controlled trials, economic analyses, and the exploration of user preferences.

Background In an effort to contain the effects of the coronavirus disease (COVID-19) pandemic, health care systems worldwide implemented telemedical solutions to overcome staffing, technical, and infrastructural limitations. In Germany, a multitude of telemedical systems are already being used, while new approaches are rapidly being developed in response to the crisis. However, the extent of the current implementation within different health care settings, the user’s acceptance and perception, as well as the hindering technical and regulatory obstacles remain unclear. Objective The aim of this paper is to assess the current status quo of the availability and routine use of telemedical solutions, user acceptance, and the subjectively perceived burdens on telemedical approaches. Furthermore, we seek to assess the perception of public information quality among professional groups and their preferred communication channels. Methods A national online survey was conducted on 14 consecutive days in March and April 2020, and distributed to doctors, nurses, and other medical professionals in the German language. Results A total of 2827 medical professionals participated in the study. Doctors accounted for 65.6% (n=1855) of the professionals, 29.5% (n=833) were nursing staff, and 4.9% (n=139) were identified as others such as therapeutic staff. A majority of participants rated the significance of telemedicine within the crisis as high (1065/2730, 39%) or neutral (n=720, 26.4%); however, there were significant differences between doctors and nurses (P=.01) as well as between the stationary sector compared to the ambulatory sector (P

Background There has been a cultural shift toward patient engagement in health, with a growing demand from patients to access their results. Objective The Lymphoma Intervention (LIVE) trial is conducted to examine the impact of return of individual patient-reported outcome (PRO) results and a web-based self-management intervention on psychological distress, self-management, satisfaction with information, and health care use in a population-based setting. Methods Return of PRO results included comparison with age- and sex-matched peers and was built into the Patient-Reported Outcomes Following Initial Treatment and Long-Term Evaluation of Survivorship registry. The self-management intervention is an adaptation of a fully automated evidence-based intervention for breast cancer survivors. Patients with lymphoma who completed the web-based questionnaire were equally randomized to care as usual, return of PRO results, and return of PRO results plus self-management intervention. Patients completed questionnaires 9 to 18 months after diagnosis (T0; n=227), 4 months (T1; n=190), 12 months (T2; n=170), and 24 months (T3; n=98). Results Of all invited patients, 51.1% (456/892) responded and web-based participants (n=227) were randomly assigned to care as usual (n=76), return of PRO results (n=74), or return of PRO results and access to Living with lymphoma (n=77). Return of PRO results was viewed by 76.7% (115/150) of those with access. No statistically significant differences were observed for psychological distress, self-management, satisfaction with information provision, and health care use between patients who received PRO results and those who did not (P>.05). Use of the self-management intervention was low (2/76, 3%), and an effect could therefore not be determined. Conclusions Return of individual PRO results seems to meet patients’ wishes but had no beneficial effects on patient outcome. No negative effects were found when individual PRO results were disclosed, and the return of individual PRO results can therefore be safely implemented in daily clinical practice. Trial Registration Netherlands Trial Register NTR5953; https://www.trialregister.nl/trial/5790 International Registered Report Identifier (IRRID) RR2-10.1186/s13063-017-1943-2

Background There is a general agreement on the importance of health-related quality of life (HRQoL). This type of information is becoming increasingly important for the value assessment of health technology assessment agencies in evaluating the benefits of new health technologies, including medicines. However, HRQoL data are often limited, and additional sources that provide this type of information may be helpful. Objective We aim to identify the HRQoL topics important to patients with melanoma based on web-based discussions on public social media forums. Methods We identified 3 public web-based forums from the United States and the United Kingdom, namely the Melanoma Patient Information Page, the Melanoma International Forum, and MacMillan. Their posts were randomly selected and coded using qualitative methods until saturation was reached. Results Of the posts assessed, 36.7% (150/409) of posts on Melanoma International Forum, 45.1% (198/439) on MacMillan, and 35.4% (128/362) on Melanoma Patient Information Page focused on HRQoL. The 2 themes most frequently mentioned were mental health and (un)certainty. The themes were constructed based on underlying and more detailed codes. Codes related to fear, worry and anxiety, uncertainty, and unfavorable effects were the most-often discussed ones. Conclusions Web-based forums are a valuable source for identifying relevant HRQoL aspects in patients with a given disease. These aspects could be cross-referenced with existing tools and they might improve the content validity of patient-reported outcome measures, including HRQoL questionnaires. In addition, web-based forums may provide health technology assessment agencies with a more holistic understanding of the external aspects affecting patient HRQoL. These aspects might support the value assessment of new health technologies and could therefore help inform topic prioritization as well as the scoping phase before any value assessment.

BackgroundIn the absence of official clinical trial information, data from social networks can be used by public health and medical researchers to assess public claims about loosely regulated substances such as cannabidiol (CBD). For example, this can be achieved by comparing the medical conditions targeted by those selling CBD against the medical conditions patients commonly treat with CBD.ObjectiveThe objective of this study was to provide a framework for public health and medical researchers to use for identifying and analyzing the consumption and marketing of unregulated substances. Specifically, we examined CBD, which is a substance that is often presented to the public as medication despite complete evidence of efficacy and safety.MethodsWe collected 567,850 tweets by searching Twitter with the Tweepy Python package using the terms “CBD” and “cannabidiol.” We trained two binary text classifiers to create two corpora of 167,755 personal use and 143,322 commercial/sales tweets. Using medical, standard, and slang dictionaries, we identified and compared the most frequently occurring medical conditions, symptoms, side effects, body parts, and other substances referenced in both corpora. In addition, to assess popular claims about the efficacy of CBD as a medical treatment circulating on Twitter, we performed sentiment analysis via the VADER (Valence Aware Dictionary for Sentiment Reasoning) model on the personal CBD tweets.ResultsWe found references to medically relevant terms that were unique to either personal or commercial CBD tweet classes, as well as medically relevant terms that were common to both classes. When we calculated the average sentiment scores for both personal and commercial CBD tweets referencing at least one of 17 medical conditions/symptoms terms, an overall positive sentiment was observed in both personal and commercial CBD tweets. We observed instances of negative sentiment conveyed in personal CBD tweets referencing autism, whereas CBD was also marketed multiple times as a treatment for autism within commercial tweets.ConclusionsOur proposed framework provides a tool for public health and medical researchers to analyze the consumption and marketing of unregulated substances on social networks. Our analysis showed that most users of CBD are satisfied with it in regard to the condition that it is being advertised for, with the exception of autism.

Background Low back pain (LBP) remains the leading cause of disability worldwide. A better understanding of the beliefs regarding LBP and impact of LBP on the individual is important in order to improve outcomes. Although personal experiences of LBP have traditionally been explored through qualitative studies, social media allows access to data from a large, heterogonous, and geographically distributed population, which is not possible using traditional qualitative or quantitative methods. As data on social media sites are collected in an unsolicited manner, individuals are more likely to express their views and emotions freely and in an unconstrained manner as compared to traditional data collection methods. Thus, content analysis of social media provides a novel approach to understanding how problems such as LBP are perceived by those who experience it and its impact. Objective The objective of this study was to identify contextual variables of the LBP experience from a first-person perspective to provide insights into individuals’ beliefs and perceptions. Methods We analyzed 896,867 cleaned tweets about LBP between January 1, 2014, and December 31, 2018. We tested and compared latent Dirichlet allocation (LDA), Dirichlet multinomial mixture (DMM), GPU-DMM, biterm topic model, and nonnegative matrix factorization for identifying topics associated with tweets. A coherence score was determined to identify the best model. Two domain experts independently performed qualitative content analysis of the topics with the strongest coherence score and grouped them into contextual categories. The experts met and reconciled any differences and developed the final labels. Results LDA outperformed all other algorithms, resulting in the highest coherence score. The best model was LDA with 60 topics, with a coherence score of 0.562. The 60 topics were grouped into 19 contextual categories. “Emotion and beliefs” had the largest proportion of total tweets (157,563/896,867, 17.6%), followed by “physical activity” (124,251/896,867, 13.85%) and “daily life” (80,730/896,867, 9%), while “food and drink,” “weather,” and “not being understood” had the smallest proportions (11,551/896,867, 1.29%; 10,109/896,867, 1.13%; and 9180/896,867, 1.02%, respectively). Of the 11 topics within “emotion and beliefs,” 113,562/157,563 (72%) had negative sentiment. Conclusions The content analysis of tweets in the area of LBP identified common themes that are consistent with findings from conventional qualitative studies but provide a more granular view of individuals’ perspectives related to LBP. This understanding has the potential to assist with developing more effective and personalized models of care to improve outcomes in those with LBP.

Background Cognitive stimulation therapy appears to show promising results in the rehabilitation of impaired cognitive processes in attention deficit hyperactivity disorder. Objective Encouraged by this evidence and the ever-increasing use of technology and artificial intelligence for therapeutic purposes, we examined whether cognitive stimulation therapy implemented on a mobile device and controlled by an artificial intelligence engine can be effective in the neurocognitive rehabilitation of these patients. Methods In this randomized study, 29 child participants (25 males) underwent training with a smart, digital, cognitive stimulation program (KAD_SCL_01) or with 3 commercial video games for 12 weeks, 3 days a week, 15 minutes a day. Participants completed a neuropsychological assessment and a preintervention and postintervention magnetoencephalography study in a resting state with their eyes closed. In addition, information on clinical symptoms was collected from the child´s legal guardians. Results In line with our main hypothesis, we found evidence that smart, digital, cognitive treatment results in improvements in inhibitory control performance. Improvements were also found in visuospatial working memory performance and in the cognitive flexibility, working memory, and behavior and general executive functioning behavioral clinical indexes in this group of participants. Finally, the improvements found in inhibitory control were related to increases in alpha-band power in all participants in the posterior regions, including 2 default mode network regions of the interest: the bilateral precuneus and the bilateral posterior cingulate cortex. However, only the participants who underwent cognitive stimulation intervention (KAD_SCL_01) showed a significant increase in this relationship. Conclusions The results seem to indicate that smart, digital treatment can be effective in the inhibitory control and visuospatial working memory rehabilitation in patients with attention deficit hyperactivity disorder. Furthermore, the relation of the inhibitory control with alpha-band power changes could mean that these changes are a product of plasticity mechanisms or changes in the neuromodulatory dynamics. Trial Registration ISRCTN Registry ISRCTN71041318; https://www.isrctn.com/ISRCTN71041318

Background The COVID-19 pandemic has highlighted the inability of health systems to leverage existing system infrastructure in order to rapidly develop and apply broad analytical tools that could inform state- and national-level policymaking, as well as patient care delivery in hospital settings. The COVID-19 pandemic has also led to highlighted systemic disparities in health outcomes and access to care based on race or ethnicity, gender, income-level, and urban-rural divide. Although the United States seems to be recovering from the COVID-19 pandemic owing to widespread vaccination efforts and increased public awareness, there is an urgent need to address the aforementioned challenges. Objective This study aims to inform the feasibility of leveraging broad, statewide datasets for population health–driven decision-making by developing robust analytical models that predict COVID-19–related health care resource utilization across patients served by Indiana’s statewide Health Information Exchange. Methods We leveraged comprehensive datasets obtained from the Indiana Network for Patient Care to train decision forest-based models that can predict patient-level need of health care resource utilization. To assess these models for potential biases, we tested model performance against subpopulations stratified by age, race or ethnicity, gender, and residence (urban vs rural). Results For model development, we identified a cohort of 96,026 patients from across 957 zip codes in Indiana, United States. We trained the decision models that predicted health care resource utilization by using approximately 100 of the most impactful features from a total of 1172 features created. Each model and stratified subpopulation under test reported precision scores >70%, accuracy and area under the receiver operating curve scores >80%, and sensitivity scores approximately >90%. We noted statistically significant variations in model performance across stratified subpopulations identified by age, race or ethnicity, gender, and residence (urban vs rural). Conclusions This study presents the possibility of developing decision models capable of predicting patient-level health care resource utilization across a broad, statewide region with considerable predictive performance. However, our models present statistically significant variations in performance across stratified subpopulations of interest. Further efforts are necessary to identify root causes of these biases and to rectify them.

Background Smartphones and their built-in sensors allow for measuring functions in disease-related domains through mobile tests. This could improve disease characterization and monitoring, and could potentially support treatment decisions for multiple sclerosis (MS), a multifaceted chronic neurological disease with highly variable clinical manifestations. Practice effects can complicate the interpretation of both improvement over time by potentially exaggerating treatment effects and stability by masking deterioration. Objective The aim of this study is to identify short-term learning and long-term practice effects in 6 active tests for cognition, dexterity, and mobility in user-scheduled, high-frequency smartphone-based testing. Methods We analyzed data from 264 people with self-declared MS with a minimum of 5 weeks of follow-up and at least 5 repetitions per test in the Floodlight Open study, a self-enrollment study accessible by smartphone owners from 16 countries. The collected data are openly available to scientists. Using regression and bounded growth mixed models, we characterized practice effects for the following tests: electronic Symbol Digit Modalities Test (e-SDMT) for cognition; Finger Pinching and Draw a Shape for dexterity; and Two Minute Walk, U-Turn, and Static Balance for mobility. Results Strong practice effects were found for e-SDMT (n=4824 trials), Finger Pinching (n=19,650), and Draw a Shape (n=19,019) with modeled boundary improvements of 40.8% (39.9%-41.6%), 86.2% (83.6%-88.7%), and 23.1% (20.9%-25.2%) over baseline, respectively. Half of the practice effect was reached after 11 repetitions for e-SDMT, 28 repetitions for Finger Pinching, and 17 repetitions for Draw a Shape; 90% was reached after 35, 94, and 56 repetitions, respectively. Although baseline performance levels were highly variable across participants, no significant differences between the short-term learning effects in low performers (5th and 25th percentile), median performers, and high performers (75th and 95th percentile) were found for e-SDMT up to the fifth trial (β=1.50-2.00). Only small differences were observed for Finger Pinching (β=1.25-2.5). For U-Turn (n=15,051) and Static Balance (n=16,797), only short-term learning effects could be observed, which ceased after a maximum of 5 trials. For Two Minute Walk (n=14,393), neither short-term learning nor long-term practice effects were observed. Conclusions Smartphone-based tests are promising for monitoring the disease trajectories of MS and other chronic neurological diseases. Our findings suggest that strong long-term practice effects in cognitive and dexterity functions have to be accounted for to identify disease-related changes in these domains, especially in the context of personalized health and in studies without a comparator arm. In contrast, changes in mobility may be more easily interpreted because of the absence of long-term practice effects, even though short-term learning effects might have to be considered.

Background New parents face increased risks of emotional distress and relationship dissatisfaction. Digital interventions increase support access, but few preventive programs are optimized for both parents. Objective This study aims to conduct the first randomized controlled trial on universal self-guided digital programs to support positive perinatal adjustment of both mothers and fathers. Effects of childcare information (Baby Care) and information plus an interactive program (Baby Steps Wellbeing) were compared from the third trimester baseline to 3 and 6 months subsequently. Methods The study recruited 388 co-parenting male-female adult couples expecting their first single child (26-38 weeks’ gestation), using web-based registration. Most (337/388, 86.8%) were obtained from prenatal hospital classes. Couples’ randomization was automated and stratified by Edinburgh Postnatal Depression Scale (EPDS) scores (50% couples scored high if either mother >7, father >5). All assessments were web-based self-reports: the EPDS and psychosocial quality of life were primary outcomes; relationship satisfaction, social support, and self-efficacy for parenting and support provision were secondary. Linear mixed models provided intention-to-treat analyses, with linear and quadratic effects for time and random intercepts for participants and couples. Results Selection criteria were met by 63.9% (248/388) of couples, who were all randomized. Most participants were married (400/496, 80.6%), tertiary educated (324/496, 65.3%), employed full time (407/496, 82%), and born in Australia (337/496, 67.9%). Their mean age was 32.2 years, and average gestation was 30.8 weeks. Using an EPDS cutoff score of 13, 6.9% (18/248) of men, and 16.1% (40/248) of women screened positive for depression at some time during the 6 months. Retention of both partners was 80.6% (201/248) at the 6-month assessments, and satisfaction with both programs was strong (92% ≥50). Only 37.3% (185/496) of participants accessed their program more than once, with higher rates for mothers (133/248, 53.6%) than fathers (52/248, 20.9%; P Conclusions Three secondary outcomes showed differential benefits from Baby Steps Wellbeing, but for one (parenting self-efficacy), the effect only occurred for mothers, perhaps reflecting their greater program use. Increased engagement will be needed for more definitive testing of the potential benefits of Baby StepsWellbeing for perinatal adjustment. Trial Registration Australian New Zealand Clinical Trials Registry ACTRN12614001256662; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=367277

Background Adherence to internet-delivered interventions targeting mental health such as online psychotherapeutic aftercare is important for the intervention’s impact. High dropout rates limit the impact and generalizability of findings. Baseline differences may be putting patients at risk for dropping out, making comparisons between online with face-to-face (F2F) therapy and care as usual (CAU) necessary to examine. Objective This study investigated adherence to online, F2F, and CAU interventions as well as study dropout among these groups and the subjective evaluation of the therapeutic relationship. Sociodemographic, social-cognitive, and health-related variables were considered. Methods In a randomized controlled trial, 6023 patients were recruited, and 300 completed the baseline measures (T1), 144 completed T2 (retention 44%-52%), and 95 completed T3 (retention 24%-36%). Sociodemographic variables (eg, age, gender, marital status, educational level), social-cognitive determinants (eg, self-efficacy, social support), health-related variables (eg, depressiveness), and expectation towards the treatment for patients assigned to online or F2F were measured at T1. Results There were no significant differences between the groups regarding dropout rates (χ21=0.02-1.06, P≥.30). Regarding adherence to the treatment condition, the online group outperformed the F2F and CAU conditions (P≤.01), indicating that patients randomized into the F2F and CAU control groups were much more likely to show nonadherent behavior in comparison with the online therapy groups. Within study groups, gender differences were significant only in the CAU group at T2, with women being more likely to drop out. At T3, age and marital status were also only significant in the CAU group. Patients in the online therapy group were significantly more satisfied with their treatment than patients in the F2F group (P=.02; Eta²=.09). Relationship satisfaction and success satisfaction were equally high (P>.30; Eta²=.02). Combining all study groups, patients who reported lower depressiveness scores at T1 (T2: odds ratio [OR] 0.55, 95% CI 0.35-0.87; T3: OR 0.56, 95% CI 0.37-0.92) were more likely to be retained, and patients who had higher self-efficacy (T2: OR 0.57, 95% CI 0.37-0.89; T3: OR 0.52, 95% CI 0.32-0.85) were more likely to drop out at T2 and T3. Additionally, at T3, the lower social support that patients reported was related to a higher likelihood of remaining in the study (OR 0.68, 95% CI 0.48-0.96). Comparing the 3 intervention groups, positive expectation was significantly related with questionnaire completion at T2 and T3 after controlling for other variables (T2: OR 1.64, 95% CI 1.08-2.50; T3: OR 1.59, 95% CI 1.01-2.51). Conclusions While online interventions have many advantages over F2F variants such as saving time and effort to commute to F2F therapy, they also create difficulties for therapists and hinder their ability to adequately react to patients’ challenges. Accordingly, patient characteristics that might put them at risk for dropping out or not adhering to the treatment plan should be considered in future research and practice. Online aftercare, as described in this research, should be provided more often to medical rehabilitation patients. Trial Registration ClinicalTrials.gov NCT04989842; https://clinicaltrials.gov/ct2/show/NCT04989842

Background There is a limited amount of data on the safety profile of the COVID-19 vector vaccine Gam-COVID-Vac (Sputnik V). Previous infodemiology studies showed that social media discourse could be analyzed to assess the most concerning adverse events (AE) caused by drugs. Objective We aimed to investigate mild AEs of Sputnik V based on a participatory trial conducted on Telegram in the Russian language. We compared AEs extracted from Telegram with other limited databases on Sputnik V and other COVID-19 vaccines. We explored symptom co-occurrence patterns and determined how counts of administered doses, age, gender, and sequence of shots could confound the reporting of AEs. Methods We collected a unique dataset consisting of 11,515 self-reported Sputnik V vaccine AEs posted on the Telegram group, and we utilized natural language processing methods to extract AEs. Specifically, we performed multilabel classifications using the deep neural language model Bidirectional Encoder Representations from Transformers (BERT) “DeepPavlov,” which was pretrained on a Russian language corpus and applied to the Telegram messages. The resulting area under the curve score was 0.991. We chose symptom classes that represented the following AEs: fever, pain, chills, fatigue, nausea/vomiting, headache, insomnia, lymph node enlargement, erythema, pruritus, swelling, and diarrhea. Results Telegram users complained mostly about pain (5461/11,515, 47.43%), fever (5363/11,515, 46.57%), fatigue (3862/11,515, 33.54%), and headache (2855/11,515, 24.79%). Women reported more AEs than men (1.2-fold, P Conclusions After the Sputnik V vaccination, Russian Telegram users reported mostly pain, fever, and fatigue. The Sputnik V AE profile was comparable with other vector COVID-19 vaccines. Discussion on social media could provide meaningful information about the AE profile of novel vaccines.

Background There are limited evidence-based strategies that have been shown to increase the rate at which peer-reviewed articles are cited. In a previously reported randomized controlled trial, we demonstrated that promotion of article links in an online cross-publisher distribution platform (TrendMD) persistently augments citation rates after 12 months, leading to a statistically significant 50% increase in citations relative to the control. Objective This study aims to investigate if the citation advantage of promoted articles upholds after 36 months. Methods A total of 3200 published articles in 64 peer-reviewed journals across 8 subject areas were block randomized at the subject level to either the TrendMD group (n=1600) or the control group (n=1600) of the study. Articles were promoted in the TrendMD Network for 6 months. We compared the citation rates in both groups after 36 months. Results At 36 months, we found the citation advantage endured; articles randomized to TrendMD showed a 28% increase in mean citations relative to the control. The difference in mean citations at 36 months for articles randomized to TrendMD versus the control was 10.52 (95% CI 3.79-17.25) and was statistically significant (P=.001). Conclusions To our knowledge, this is the first randomized controlled trial to demonstrate how a postpublication article promotion intervention can be used to persistently augment citations of peer-reviewed articles. TrendMD is an efficient digital tool for knowledge translation and dissemination to targeted audiences to facilitate the uptake of research.

Background Pain is a complex experience that involves sensory-discriminative and cognitive-emotional neuronal processes. It has long been known across cultures that pain can be relieved by mindful breathing (MB). There is a common assumption that MB exerts its analgesic effect through interoception. Interoception refers to consciously refocusing the mind’s attention to the physical sensation of internal organ function. Objective In this study, we dissect the cortical analgesic processes by imaging the brains of healthy subjects exposed to traditional MB (TMB) and compare them with another group for which we augmented MB to an outside sensory experience via virtual reality breathing (VRB). Methods The VRB protocol involved in-house–developed virtual reality 3D lungs that synchronized with the participants’ breathing cycles in real time, providing them with an immersive visual-auditory exteroception of their breathing. Results We found that both breathing interventions led to a significant increase in pain thresholds after week-long practices, as measured by a thermal quantitative sensory test. However, the underlying analgesic brain mechanisms were opposite, as revealed by functional near-infrared spectroscopy data. In the TMB practice, the anterior prefrontal cortex uniquely modulated the premotor cortex. This increased its functional connection with the primary somatosensory cortex (S1), thereby facilitating the S1-based sensory-interoceptive processing of breathing but inhibiting its other role in sensory-discriminative pain processing. In contrast, virtual reality induced an immersive 3D exteroception with augmented visual-auditory cortical activations, which diminished the functional connection with the S1 and consequently weakened the pain processing function of the S1. Conclusions In summary, our study suggested two analgesic neuromechanisms of VRB and TMB practices—exteroception and interoception—that distinctively modulated the S1 processing of the ascending noxious inputs. This is in line with the concept of dualism (Yin and Yang).