Search

We assessed acceptability/usability of tablet-based patient-reported outcome (PRO) assessments among patients in HIV care, and relationships with health outcomes using a modified Acceptability E-Scale (AES) within a self-administered PRO assessment. Using multivariable linear regression, we measured associations between patient characteristics and continuous combined AES score. Among 786 patients (median age=48; 91% male; 49% white; 17% Spanish-speaking) overall mean score was 26/30 points (SD: 4.4). Mean scores per dimension (max 5, 1=lowest acceptability, 5=highest): ease of use 4.7, understandability 4.7, time burden 4.3, overall satisfaction 4.3, helpfulness describing symptoms/behaviors 4.2, and enjoyability 3.8. Higher overall score was associated with race/ethnicity (+1.3 points/African-American patients (95%CI:0.3-2.3); +1.6 points/Latino patients (95%CI:0.9-2.3) compared to white patients). Patients completing PROs in Spanish scored +2.4 points on average (95%CI:1.6-3.3). Higher acceptability was associated with better quality of life (0.3 points (95%CI:0.2-0.5)) and adherence (0.4 points (95%CI:0.2-0.6)). Lower acceptability was associated with: higher depression symptoms (-0.9 points (95%CI:-1.4 to -0.4)); recent illicit opioid use (-2.0 points (95%CI:-3.9 to -0.2)); multiple recent sex partners (-0.8 points (95%CI:-1.5 to -0.1)). While patients endorsing depression symptoms, recent opioid use, condomless sex, or multiple sex partners found PROs less acceptable, overall, patients found the assessments highly acceptable and easy to use.

Duncan Short,1 Xueqi Wang,2 Shivali Suri,3 Thomas K Hsu,2 Bryn Jones,1 Rob J Fredericksen,4 Heidi M Crane,4 Alexandra Musten,5 Jean Bacon,5 Yongwei Wang,2 Kevin A Gough,3 Moti Ramgopal,6 Jeff Berry,7 William B Lober4 1ViiV Healthcare, Brentford, UK; 2ViiV Healthcare, Durham, NC, USA; 3St Michael’s Hospital, Toronto, ON, Canada; 4Center for AIDS Research, University of Washington, Seattle, WA, USA; 5Ontario HIV Treatment Network, Toronto, ON, Canada; 6Midway Specialty Care Center, Fort Pierce, FL, USA; 7TPAN, Chicago, IL, USACorrespondence: Duncan Short, ViiV Healthcare, 980 Great West Road, Brentford, Middlesex, TW8 9GS, UK, Tel +44 7827 282971, Email duncan.x.short@viivhealthcare.comPurpose: Use of patient-reported outcomes assessments (PROs) can improve patient–provider communication and focus provider attention on current health issues. This analysis examines the association between suboptimal antiretroviral therapy (ART) adherence and factors obtained through PROs among people with HIV (PWH) at 2 North American outpatient clinics.Patients and Methods: Immediately before a clinic visit, PWH completed self-administered PROs. Unadjusted and adjusted odds ratios (ORs) and 95% confidence intervals (CIs) were estimated from logistic regression models to identify sociodemographic and health-related factors (satisfaction with ART, difficulty meeting housing costs, depression, intimate partner violence, risk of malnutrition, smoking status, alcohol use, and substance use) associated with suboptimal adherence (defined as self-reporting < 95% or < 80% adherence). Multiple imputation was performed to account for missing data in the multivariate analyses.Results: Of 1632 PWH, 1239 (76%) responded to the adherence assessment; of these, 268 (22%) and 106 (9%) reported < 95% and < 80% adherence, respectively. Of 1580 PWH who responded, 354 (22%) were dissatisfied with their HIV medication. Of responding PWH, 19% reported moderate-to-severe depression, 23% indicated they were at risk of malnutrition, 34% were current smokers, and 62% reported substance use in the past 3 months. Dissatisfaction with ART was significantly associated with < 95% and < 80% adherence in the unadjusted analysis (unadjusted OR [95% CI], 3.38 [2.51– 4.56] and 4.26 [2.82– 6.42], respectively) and adjusted analysis (adjusted OR [95% CI], 2.76 [1.91– 4.00] and 3.28 [1.95– 5.52], respectively); significance remained after multiple imputation. In adjusted analyses, no risk of malnutrition was significantly associated with reduced odds of < 95% adherence after multiple imputation (adjusted OR [95% CI], 0.714 [0.511– 0.997]); no other factors were associated with < 95% or < 80% adherence.Conclusion: These results suggest that implementation of PROs evaluating treatment satisfaction may provide value to adherence management in routine HIV care.Keywords: patient satisfaction, antiretroviral therapy, highly active, treatment adherence, implementation science, quality of life

We developed, implemented, and evaluated a myocardial infarction (MI) adjudication protocol for cohort research of human immunodeficiency virus. Potential events were identified through the centralized Centers for AIDS Research Network of Integrated Clinical Systems data repository using MI diagnoses and/or cardiac enzyme laboratory results (1995-2012). Sites assembled de-identified packets, including physician notes and results from electrocardiograms, procedures, and laboratory tests. Information pertaining to the specific antiretroviral medications used was redacted for blinded review. Two experts reviewed each packet, and a third review was conducted if discrepancies occurred. Reviewers categorized probable/definite MIs as primary or secondary and identified secondary causes of MIs. The positive predictive value and sensitivity for each identification/ascertainment method were calculated. Of the 1,119 potential events that were adjudicated, 294 (26%) were definite/probable MIs. Almost as many secondary (48%) as primary (52%) MIs occurred, often as the result of sepsis or cocaine use. Of the patients with adjudicated definite/probable MIs, 78% had elevated troponin concentrations (positive predictive value = 57%, 95% confidence interval: 52, 62); however, only 44% had clinical diagnoses of MI (positive predictive value = 45%, 95% confidence interval: 39, 51). We found that central adjudication is crucial and that clinical diagnoses alone are insufficient for ascertainment of MI. Over half of the events ultimately determined to be MIs were not identified by clinical diagnoses. Adjudication protocols used in traditional cardiovascular disease cohorts facilitate cross-cohort comparisons but do not address issues such as identifying secondary MIs that may be common in persons with human immunodeficiency virus.

BACKGROUND: Researchers and policy makers are interested in identifying, implementing, and evaluating a national minimum data set for biosurveillance. However, work remains to be done to establish methods for measuring the value of such data. PURPOSE: The purpose of this article is to establish and evaluate a method for measuring the utility of biosurveillance data. METHOD: The authors derive an expected utility model in which the value of data may be determined by trading data relevance for time delay in receiving data. In a sample of 23 disease surveillance practitioners, the authors test if such tradeoffs are sensitive to the types of data elements involved (chief complaint v. emergency department [ED] log of visit) and proportional changes to the time horizon needed for receiving data (24 v. 48 h). In addition, they evaluate the logical error rate: the proportion of responses that scored less relevant data as having higher utility. RESULTS: Utilities of chief complaints were significantly higher than ED log of visit, F(1, 21)= 5.60, P < 0.05, suggesting the method is sensitive. Further utilities did not depend on time horizon used in the exercise, F(1, 21) = 0.00, P = ns. Of 92 time tradeoffs elicited, there were 5 logical errors (i.e., 5% logical error rate). CONCLUSIONS: In this article, the authors establish a time-tradeoff exercise for valuing biosurveillance data. Empirically, the method shows initial promise for evaluating a minimum data set for biosurveillance. Future applications of this approach may prove useful in disease surveillance planning and evaluation. [ABSTRACT FROM AUTHOR]

Syndromic surveillance refers to methods relying on detection of individual and population health indicators that are discernible before confirmed diagnoses are made. In particular, prior to the laboratory confirmation of an infectious disease, ill persons may exhibit behavioral patterns, symptoms, signs, or laboratory findings that can be tracked through a variety of data sources. Syndromic surveillance systems are being developed locally, regionally, and nationally. The efforts have been largely directed at facilitating the early detection of a covert bioterrorist attack, but the technology may also be useful for general public health, clinical medicine, quality improvement, patient safety, and research. This report, authored by developers and methodologists involved in the design and deployment of the first wave of syndromic surveillance systems, is intended to serve as a guide for informaticians, public health managers, and practitioners who are currently planning deployment of such systems in their regions. [ABSTRACT FROM AUTHOR]

Public Health Informatics (PHI) education began at the University of Washington (UW) with a Summer Institute in 1995. The Biomedical and Health Informatics graduate program, which is housed in the School of Medicine, is an interdisciplinary, multi-school program. It demonstrates the UW's cooperative efforts in advancing informatics, encompassing the schools of public health, medicine, nursing, dentistry, pharmacy, information and graduate schools in computer science. This article provides an overview of the developmental milestones related to activities in PHI and describes the evaluation strategy and assessment plan for PHI training at the UW ( http://phig.washington.edu ). [ABSTRACT FROM AUTHOR]

During the 2001 AMIA Annual Symposium, the Anesthesia, Critical Care, and Emergency Medicine Working Group hosted the Roundtable on Bioterrorism Detection. Sixty-four people attended the roundtable discussion, during which several researchers discussed public health surveillance systems designed to enhance early detection of bioterrorism events. These systems make secondary use of existing clinical, laboratory, paramedical, and pharmacy data or facilitate electronic case reporting by clinicians. This paper combines case reports of six existing systems with discussion of some common techniques and approaches. The purpose of the roundtable discussion was to foster communication among researchers and promote progress by 1) sharing information about systems, including origins, current capabilities, stages of deployment, and architectures; 2) sharing lessons learned during the development and implementation of systems; and 3) exploring cooperation projects, including the sharing of software and data. A mailing list server for these ongoing efforts may be found at http://bt.cirg.washington.edu. [ABSTRACT FROM AUTHOR]

PURPOSE/OBJECTIVES: To develop and test an innovative computerized symptom and quality-of-life (QOL) assessment for patients with cancer who are evaluated for and treated with radiation therapy. DESIGN: Descriptive, longitudinal prototype development and cross-sectional clinical data. SETTING: Department of radiation oncology in an urban, academic medical center. SAMPLE: 101 outpatients who were evaluated for radiation therapy, able to communicate in English (or through one of many interpreters available at the University of Washington), and competent to understand the study information and give informed consent. Six clinicians caring for the patients in the sample were enrolled. METHODS: Iterative prototype development was conducted using a standing focus group of clinicians. The software was developed based on survey markup language and implemented in a wireless, Web-based format. Patient participants completed the computerized assessment prior to consultation with the radiation physician. Graphical output pages with flagged areas of symptom distress or troublesome QOL issues were made available to consulting physicians and nurses. MAIN RESEARCH VARIABLES: Pain intensity, symptoms, QOL, and demographics. INSTRUMENTS: Computerized versions of a 0 to 10 Pain Intensity Numerical Scale (PINS), Symptom Distress Scale, and Short Form-8. FINDINGS: Focus group recommendations included clinician priorities of brevity, flexibility, and simplicity for both input interface and output and that the assessment output contain color graphic display. Patient participants included 45 women and 56 men with a mean age of 52.7 years (SD = 13.8). Fewer than half of the participants (40%) reported using a computer on a regular basis (weekly or daily). Completion time averaged 7.8 minutes (SD = 3.7). Moderate to high levels of distress were reported more often for fatigue, pain, and emotional issues than for other symptoms or concerns. CONCLUSIONS: Computerized assessment of cancer symptoms and QOL is technically possible and feasible in an ambulatory cancer clinic. A wireless, Web-based system facilitates access to results and data entry and retrieval. The symptom and QOL profiles of these patients new to radiation therapy were comparable to other samples of outpatients with cancer. IMPLICATIONS FOR NURSING: The ability to capture an easily interpreted illustration of a patients symptom and QOL experience in less than 10 minutes is a potentially useful adjunct to traditional face-to-face interviewing. Ultimately, electronic patient-generated data could produce automated red flags directed to the most appropriate clinicians (e.g., nurse, pain specialist, social worker, nutritionist) for further evaluation. Such system enhancement could greatly facilitate oncology nurses coordination role in caring for complex patients with cancer. [Abstract for this article also available on page 895 of printed version. Full article available at www.ons.org/xp6/ONS/Library.xml/ONS_Publications.xml/ONF.xml [ABSTRACT FROM AUTHOR]

Introduction: Digital exposure notifications are a novel public health intervention used during the COVID-19 pandemic to alert users of possible COVID-19 exposure. We seek to quantify the effectiveness of Washington State's digital exposure notification system, WA Notify, as measured by the number of COVID-19 cases averted during a 1-year period., Methods: While maintaining individuals' privacy, WA Notify collected data that could be used to evaluate the system's effectiveness. This article uses these and other data and builds on a previous model to estimate the number of cases averted by WA Notify. Novel estimates of some model parameters are possible because of improvements in the quality and breadth of data reported by WA Notify., Results: We estimate that WA Notify averted 64,000 (sensitivity analysis: 35,000-92,000) COVID-19 cases in Washington State during the study period from 1 March 2021 to 28 February 2022. During this period, there were an estimated 1,089,000 exposure notifications generated and 155,000 cases reported to WA Notify. During the last 78 days of the study period, the median estimated number of daily active users was 1,740,000., Discussion: We believe WA Notify reduced the impact of the COVID-19 pandemic in Washington State and that similar systems could reduce the impact of future communicable disease outbreaks., Competing Interests: LM and NP were employed by the Mountain Whisper Light. The remaining authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2024 Elder, Arrouzet, Miljacic, Karras, Higgins, West, Lorigan, Revere, Polissar, Segal, Lober and Baseman.)

Background: WA Notify was Washington State's smartphone-based COVID-19 digital exposure notification (EN) tool, which was used to help limit the spread of COVID-19 between November 30, 2020, and May 11, 2023. Following the 2022 Washington State Public Health Association Annual Conference, attendees who had WA Notify activated began receiving ENs alerting them to a possible COVID-19 exposure during the conference. A survey was emailed to all conference attendees to measure WA Notify adoption, mechanisms through which attendees received ENs, and self-reported engagement in protective behaviors postexposure., Objective: This study aimed to learn more about the experiences of WA Notify adopters and nonadopters who may have been exposed to COVID-19 at a large group gathering., Methods: A web-based survey administered through REDCap (Research Electronic Data Capture; Vanderbilt University) was sent to all attendees of the Washington State Public Health Association conference. Self-reported demographic information and characteristics of respondents were summarized. Regression models were used to estimate relative risks to compare WA Notify adoption and testing behaviors between groups., Results: Of the 464 total registered attendees who were sent the survey, 205 (44%) responses were received; 201 eligible attendees were included in this analysis. Of those, 149 (74%) respondents reported having WA Notify activated on their phones at the time of the conference. Among respondents with WA Notify activated, 54% (n=77) reported learning of their potential exposure from a WA Notify EN. Respondents who reported that they did not have WA Notify activated and learned of their potential exposure via the event-wide email from conference organizers were 39% less likely to test for COVID-19 compared to respondents with WA Notify activated who learned of their potential exposure from the email (relative risk 0.61, 95% CI 0.40-0.93; P=.02), and this gap was even larger when compared to respondents who learned of their exposure from a WA Notify EN. The most commonly cited reason for not having WA Notify activated was privacy concerns (n=17, 35%), followed by not wanting to receive ENs (n=6, 12%) and being unaware of WA Notify (n=5, 10%)., Conclusions: Digital EN systems are an important tool to directly and anonymously notify close contacts of potential exposures and provide guidance on the next steps in a timely manner. Given the privacy concerns, there is still a need for increasing transparency surrounding EN technology to increase uptake by the public if this technology were to be used in the future to slow the spread of communicable diseases., (©Caitlin M Drover, Adam S Elder, Brandon L Guthrie, Debra Revere, Nicole L Briggs, Laura M West, Amanda Higgins, William B Lober, Bryant T Karras, Janet G Baseman. Originally published in JMIR Formative Research (https://formative.jmir.org), 18.03.2024.)

Background: People with HIV (PWH) are at increased risk for venous thromboembolism (VTE). We conducted this study to characterize VTE including provoking factors among PWH in the current treatment era., Methods: We included PWH with VTE between 2010 and 2020 at 6 sites in the CFAR Network of Integrated Clinical Systems cohort. We ascertained for possible VTE using diagnosis, VTE-related imaging, and VTE-related procedure codes, followed by centralized adjudication of primary data by expert physician reviewers. We evaluated sensitivity and positive predictive value of VTE ascertainment approaches. VTEs were classified by type and anatomic location. Reviewers identified provoking factors such as hospitalizations, infections, and other potential predisposing factors such as smoking., Results: We identified 557 PWH with adjudicated VTE: 239 (43%) had pulmonary embolism with or without deep venous thrombosis, and 318 (57%) had deep venous thrombosis alone. Ascertainment with clinical diagnoses alone missed 6% of VTEs identified with multiple ascertainment approaches. DVTs not associated with intravenous lines were most often in the proximal lower extremities. Among PWH with VTE, common provoking factors included recent hospitalization (n = 134, 42%), infection (n = 133, 42%), and immobilization/bed rest (n = 78, 25%). Only 57 (10%) PWH had no provoking factor identified. Smoking (46%), HIV viremia (27%), and injection drug use (22%) were also common., Conclusions: We conducted a robust adjudication process that demonstrated the benefits of multiple ascertainment approaches followed by adjudication. Provoked VTEs were more common than unprovoked events. Nontraditional and modifiable potential predisposing factors such as viremia and smoking were common., (Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.)

Background: Tobacco smoking increases frailty risk among the general population and is common among people with HIV (PWH) who experience higher rates of frailty at younger ages than the general population., Methods: We identified 8608 PWH across 6 Centers for AIDS Research Network of Integrated Clinical Systems sites who completed ≥2 patient-reported outcome assessments, including a frailty phenotype measuring unintentional weight loss, poor mobility, fatigue, and inactivity, and scored 0-4. Smoking was measured as baseline pack-years and time-updated never, former, or current use with cigarettes/day. We used Cox models to associate smoking with risk of incident frailty (score ≥3) and deterioration (frailty score increase by ≥2 points), adjusted for demographics, antiretroviral medication, and time-updated CD4 count., Results: The mean follow-up of PWH was 5.3 years (median: 5.0), the mean age at baseline was 45 years, 15% were female, and 52% were non-White. At baseline, 60% reported current or former smoking. Current (HR: 1.79; 95% confidence interval: 1.54 to 2.08) and former (HR: 1.31; 95% confidence interval: 1.12 to 1.53) smoking were associated with higher incident frailty risk, as were higher pack-years. Current smoking (among younger PWH) and pack-years, but not former smoking, were associated with higher risk of deterioration., Conclusions: Among PWH, smoking status and duration are associated with incident and worsening frailty., Competing Interests: The authors have no conflicts of interest to disclose., (Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.)

Importance: Discussions about goals of care are important for high-quality palliative care yet are often lacking for hospitalized older patients with serious illness., Objective: To evaluate a communication-priming intervention to promote goals-of-care discussions between clinicians and hospitalized older patients with serious illness., Design, Setting, and Participants: A pragmatic, randomized clinical trial of a clinician-facing communication-priming intervention vs usual care was conducted at 3 US hospitals within 1 health care system, including a university, county, and community hospital. Eligible hospitalized patients were aged 55 years or older with any of the chronic illnesses used by the Dartmouth Atlas project to study end-of-life care or were aged 80 years or older. Patients with documented goals-of-care discussions or a palliative care consultation between hospital admission and eligibility screening were excluded. Randomization occurred between April 2020 and March 2021 and was stratified by study site and history of dementia., Intervention: Physicians and advance practice clinicians who were treating the patients randomized to the intervention received a 1-page, patient-specific intervention (Jumpstart Guide) to prompt and guide goals-of-care discussions., Main Outcomes and Measures: The primary outcome was the proportion of patients with electronic health record-documented goals-of-care discussions within 30 days. There was also an evaluation of whether the effect of the intervention varied by age, sex, history of dementia, minoritized race or ethnicity, or study site., Results: Of 3918 patients screened, 2512 were enrolled (mean age, 71.7 [SD, 10.8] years and 42% were women) and randomized (1255 to the intervention group and 1257 to the usual care group). The patients were American Indian or Alaska Native (1.8%), Asian (12%), Black (13%), Hispanic (6%), Native Hawaiian or Pacific Islander (0.5%), non-Hispanic (93%), and White (70%). The proportion of patients with electronic health record-documented goals-of-care discussions within 30 days was 34.5% (433 of 1255 patients) in the intervention group vs 30.4% (382 of 1257 patients) in the usual care group (hospital- and dementia-adjusted difference, 4.1% [95% CI, 0.4% to 7.8%]). The analyses of the treatment effect modifiers suggested that the intervention had a larger effect size among patients with minoritized race or ethnicity. Among 803 patients with minoritized race or ethnicity, the hospital- and dementia-adjusted proportion with goals-of-care discussions was 10.2% (95% CI, 4.0% to 16.5%) higher in the intervention group than in the usual care group. Among 1641 non-Hispanic White patients, the adjusted proportion with goals-of-care discussions was 1.6% (95% CI, -3.0% to 6.2%) higher in the intervention group than in the usual care group. There was no evidence of differential treatment effects of the intervention on the primary outcome by age, sex, history of dementia, or study site., Conclusions and Relevance: Among hospitalized older adults with serious illness, a pragmatic clinician-facing communication-priming intervention significantly improved documentation of goals-of-care discussions in the electronic health record, with a greater effect size in racially or ethnically minoritized patients., Trial Registration: ClinicalTrials.gov Identifier: NCT04281784.

Objectives: People with HIV have a higher risk of myocardial infarction (MI) than the general population, with a greater proportion of type 2 MI (T2MI) due to oxygen demand-supply mismatch compared with type 1 (T1MI) resulting from atherothrombotic plaque disruption. People living with HIV report a greater prevalence of cigarette and alcohol use than do the general population. Alcohol use and smoking as risk factors for MI by type are not well studied among people living with HIV. We examined longitudinal associations between smoking and alcohol use patterns and MI by type among people living with HIV., Design and Methods: Using longitudinal data from the Centers for AIDS Research Network of Integrated Clinical Systems cohort, we conducted time-updated Cox proportional hazards models to determine the impact of smoking and alcohol consumption on adjudicated T1MI and T2MI., Results: Among 13 506 people living with HIV, with a median 4 years of follow-up, we observed 177 T1MI and 141 T2MI. Current smoking was associated with a 60% increase in risk of both T1MI and T2MI. In addition, every cigarette smoked per day was associated with a 4% increase in risk of T1MI, with a suggestive, but not significant, 2% increase for T2MI. Cigarette use had a greater impact on T1MI for men than for women and on T2MI for women than for men. Increasing alcohol use was associated with a lower risk of T1MI but not T2MI. Frequency of heavy episodic alcohol use was not associated with MI., Conclusions: Our findings reinforce the prioritization of smoking reduction, even without cessation, and cessation among people living with HIV for MI prevention and highlight the different impacts on MI type by gender., (© 2023 The Authors. HIV Medicine published by John Wiley & Sons Ltd on behalf of British HIV Association.)

Objective: Frailty is common among people with HIV (PWH), so we developed frail risk in the short-term for care (RISC)-HIV, a frailty prediction risk score for HIV clinical decision-making., Design: We followed PWH for up to 2 years to identify short-term predictors of becoming frail., Methods: We predicted frailty risk among PWH at seven HIV clinics across the United States. A modified self-reported Fried Phenotype captured frailty, including fatigue, weight loss, inactivity, and poor mobility. PWH without frailty were separated into training and validation sets and followed until becoming frail or 2 years. Bayesian Model Averaging (BMA) and five-fold-cross-validation Lasso regression selected predictors of frailty. Predictors were selected by BMA if they had a greater than 45% probability of being in the best model and by Lasso if they minimized mean squared error. We included age, sex, and variables selected by both BMA and Lasso in Frail RISC-HIV by associating incident frailty with each selected variable in Cox models. Frail RISC-HIV performance was assessed in the validation set by Harrell's C and lift plots., Results: Among 3170 PWH (training set), 7% developed frailty, whereas among 1510 PWH (validation set), 12% developed frailty. BMA and Lasso selected baseline frailty score, prescribed antidepressants, prescribed antiretroviral therapy, depressive symptomology, and current marijuana and illicit opioid use. Discrimination was acceptable in the validation set, with Harrell's C of 0.76 (95% confidence interval: 0.73-0.79) and sensitivity of 80% and specificity of 61% at a 5% frailty risk cutoff., Conclusions: Frail RISC-HIV is a simple, easily implemented tool to assist in classifying PWH at risk for frailty in clinics., (Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.)

Background: Digital health interventions have the potential to improve the provision of health care services through digitized data collection and management. Low- and middle-income countries are beginning to introduce electronic immunization registries (EIRs) into their routine immunization services to better capture and store childhood vaccination information. Especially in Africa, where 25% of children remain unimmunized or underimmunized, technologies that can help identify children due for a vaccination are particularly important for improving vaccination coverage. However, an improved understanding of the effectiveness of these systems is needed to develop and deploy sustainable EIRs in low- and middle-income countries., Objective: We conducted an interventional pretest-posttest design study that sought to improve time efficiency through workflow modifications in Kenyan immunization clinics. Our aim was to describe how activity times differed after introducing workflow modifications that could potentially reduce the time needed to perform routine data entry activities. Our intent was to demonstrate changes in efficiency when moving from the existing dual-data entry workflow to a future paperless workflow by health facility size and experience length of health care workers (HCWs)., Methods: We tested how 3 workflow modifications would affect time utilization among HCWs using the EIR at the point of care compared with baseline immunization clinic workflows. Our outcome of interest was the time taken to complete individual activities and a patient's total time in the clinic where we compared the time spent during the baseline workflow with that during the modified workflow. We used a standardized tool to observe and document the immunization clinic workflow. To estimate differences in time utilization, we used bivariate analyses and fit multivariate linear mixed-effects models., Results: Our study found that for HCWs using an EIR, the introduction of modified workflows decreased the amount of time needed to provide services to children seen in the immunization clinic. With a baseline mean time of 10 minutes spent per child, this decreased by about 3 minutes when the preparation modification was introduced and almost 5 minutes for the paperless and combined modifications. Results pertaining to the EIR's performance and ability to connect to the internet were particularly insightful about potential causes of delays., Conclusions: We were able to conduct a concise clinical simulation exercise by introducing modified workflows and estimating their impact on time utilization in immunization clinics using an EIR. We found that the paperless workflow provided the largest time savings when delivering services, although this was threatened by poor EIR performance and internet connectivity. This study demonstrated that not only should digital health interventions be built and adapted for particular use cases but existing user workflows also need to adapt to new technology., (©Samantha B Dolan, Rachel Wittenauer, Anne Njoroge, Penina Onyango, George Owiso, Jessica C Shearer, William B Lober, Shan Liu, Nancy Puttkammer, Peter Rabinowitz. Originally published in JMIR Formative Research (https://formative.jmir.org), 16.03.2023.)

Background: In an effort to increase vaccination coverage in low-resource settings, digital tools have been introduced to better track immunization records, improve data management practices, and provide improved access to vaccination coverage data for decision-making. Despite the potential of these electronic systems to improve the provision of health services, few digital health interventions have been institutionalized at scale in low- and middle-income countries., Objective: In this paper, we aimed to describe how health care workers in Kenya had integrated an electronic immunization registry into their immunization clinic workflows and to use these findings to inform the development of a refined program theory on the registry's usability., Methods: Informed by realist methodology, we developed a program theory to explain usability of the electronic immunization registry. We designed a qualitative study based on our theory to describe the barriers and facilitators influencing data entry and use. Qualitative data were collected through semistructured interviews with users and workflow observations of immunization clinic sessions. Our findings were summarized by context-mechanism-outcome relationships formed after analyzing our key themes across interviews and workflow observations. Using these relationships, we were able to identify common rules for future implementers., Results: Across the 12 facilities included in our study, 19 health care workers were interviewed, and 58 workflow sessions were observed. The common rules developed from our qualitative findings are as follows: rule 1-ensure that the users complete training to build familiarity with the system, understand the value of the system and data, and know where to find support; rule 2-confirm that the system captures all data needed for users to provide routine health care services and is easy to navigate; rule 3-identify work-arounds for poor network, system performance, and too few staff or resources; and rule 4-make users aware of expected changes to their workflow, and how these changes might differ over time and by facility size or number of patients. Upon study completion, we revised the program theory to reflect the importance of the goals and workflows of electronic immunization registries aligning with reality., Conclusions: We created a deeper understanding of the underlying mechanisms for usability of the registry. We found that the electronic immunization registry had high acceptability among users; however, there were numerous barriers to using the system, even under ideal conditions, causing a misalignment between the system and the reality of the users' workflows and their environment. Human-centered design and human-factors methods can assist during pilot stages to better align systems with users' needs and again after scale-up to ensure that interventions are suitable for all user settings., (©Samantha B Dolan, Rachel  Wittenauer, Jessica C Shearer, Anne Njoroge, Penina Onyango, George Owiso, William B Lober, Shan Liu, Nancy Puttkammer, Peter Rabinowitz. Originally published in JMIR Formative Research (https://formative.jmir.org), 14.03.2023.)

Background and Objective: Care partners of people living with dementia require support to knowledgeably navigate decision making about how and when to use monitoring technologies for care purposes. We conducted a pilot study of a novel self-administered intervention, "Let's Talk Tech," for people living with mild dementia and their care partners. This paper presents preliminary efficacy findings of this intervention designed to educate and facilitate dyadic communication about a range of technologies used in dementia care and to document the preferences of the person living with dementia. It is the first-of-its-kind decision-making and planning tool with a specific focus on technology use., Research Design and Methods: We used a 1-group pretest-post-test design and paired t tests to assess change over 2 time periods in measures of technology comprehension, care partner knowledge of the participant living with mild Alzheimer's disease's (AD) preferences, care partner preparedness to make decisions about technology use, and mutual understanding. Thematic analysis was conducted on postintervention interview transcripts to elucidate mechanisms and experiences with Let's Talk Tech., Results: Twenty-nine mild AD dementia care dyads who live together completed the study. There was statistically significant improvement with medium and large effect sizes on outcome measures of care partners' understanding of each technology, care partners' perceptions of the person living with dementia's understanding of each technology, knowledge of the person living with dementia's preferences, decision-making preparedness, and care partners' feelings of mutual understanding. Participants reported that it helped them have important and meaningful conversations about using technology., Discussion and Implications: Let's Talk Tech demonstrated promising preliminary efficacy on targeted measures that can lead to informed, shared decision making about technologies used in dementia care. Future studies should assess efficacy with larger samples and more diverse sample populations in terms of race, ethnicity, and dementia type., Competing Interests: None reported., (© The Author(s) 2023. Published by Oxford University Press on behalf of The Gerontological Society of America.)

Importance: Many clinical trial outcomes are documented in free-text electronic health records (EHRs), making manual data collection costly and infeasible at scale. Natural language processing (NLP) is a promising approach for measuring such outcomes efficiently, but ignoring NLP-related misclassification may lead to underpowered studies., Objective: To evaluate the performance, feasibility, and power implications of using NLP to measure the primary outcome of EHR-documented goals-of-care discussions in a pragmatic randomized clinical trial of a communication intervention., Design, Setting, and Participants: This diagnostic study compared the performance, feasibility, and power implications of measuring EHR-documented goals-of-care discussions using 3 approaches: (1) deep-learning NLP, (2) NLP-screened human abstraction (manual verification of NLP-positive records), and (3) conventional manual abstraction. The study included hospitalized patients aged 55 years or older with serious illness enrolled between April 23, 2020, and March 26, 2021, in a pragmatic randomized clinical trial of a communication intervention in a multihospital US academic health system., Main Outcomes and Measures: Main outcomes were natural language processing performance characteristics, human abstractor-hours, and misclassification-adjusted statistical power of methods of measuring clinician-documented goals-of-care discussions. Performance of NLP was evaluated with receiver operating characteristic (ROC) curves and precision-recall (PR) analyses and examined the effects of misclassification on power using mathematical substitution and Monte Carlo simulation., Results: A total of 2512 trial participants (mean [SD] age, 71.7 [10.8] years; 1456 [58%] female) amassed 44 324 clinical notes during 30-day follow-up. In a validation sample of 159 participants, deep-learning NLP trained on a separate training data set identified patients with documented goals-of-care discussions with moderate accuracy (maximal F1 score, 0.82; area under the ROC curve, 0.924; area under the PR curve, 0.879). Manual abstraction of the outcome from the trial data set would require an estimated 2000 abstractor-hours and would power the trial to detect a risk difference of 5.4% (assuming 33.5% control-arm prevalence, 80% power, and 2-sided α = .05). Measuring the outcome by NLP alone would power the trial to detect a risk difference of 7.6%. Measuring the outcome by NLP-screened human abstraction would require 34.3 abstractor-hours to achieve estimated sensitivity of 92.6% and would power the trial to detect a risk difference of 5.7%. Monte Carlo simulations corroborated misclassification-adjusted power calculations., Conclusions and Relevance: In this diagnostic study, deep-learning NLP and NLP-screened human abstraction had favorable characteristics for measuring an EHR outcome at scale. Adjusted power calculations accurately quantified power loss from NLP-related misclassification, suggesting that incorporation of this approach into the design of studies using NLP would be beneficial.

Context: Goals-of-care discussions are important for patient-centered care among hospitalized patients with serious illness. However, there are little data on the occurrence, predictors, and timing of these discussions., Objectives: To examine the occurrence, predictors, and timing of electronic health record (EHR)-documented goals-of-care discussions for hospitalized patients., Methods: This retrospective cohort study used natural language processing (NLP) to examine EHR-documented goals-of-care discussions for adults with chronic life-limiting illness or age ≥80 hospitalized 2015-2019. The primary outcome was NLP-identified documentation of a goals-of-care discussion during the index hospitalization. We used multivariable logistic regression to evaluate associations with baseline characteristics., Results: Of 16,262 consecutive, eligible patients without missing data, 5,918 (36.4%) had a documented goals-of-care discussion during hospitalization; approximately 57% of these discussions occurred within 24 hours of admission. In multivariable analysis, documented goals-of-care discussions were more common for women (OR=1.26, 95%CI 1.18-1.36), older patients (OR=1.04 per year, 95%CI 1.03-1.04), and patients with more comorbidities (OR=1.11 per Deyo-Charlson point, 95%CI 1.10-1.13), cancer (OR=1.88, 95%CI 1.72-2.06), dementia (OR=2.60, 95%CI 2.29-2.94), higher acute illness severity (OR=1.12 per National Early Warning Score point, 95%CI 1.11-1.14), or prior advance care planning documents (OR=1.18, 95%CI 1.08-1.30). Documentation of these discussions was less common for racially or ethnically minoritized patients (OR=0.823, 95%CI 0.75-0.90)., Conclusion: Among hospitalized patients with serious illness, documented goals-of-care discussions identified by NLP were more common among patients with older age and increased burden of acute or chronic illness, and less common among racially or ethnically minoritized patients. This suggests important disparities in goals-of-care discussions., (Copyright © 2022 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.)

Abstract: Modifications to Fried's frailty phenotype (FFP) are common. We evaluated a self-reported modified frailty phenotype (Mod-FP) used among people with HIV (PWH). Among 522 PWH engaged in two longitudinal studies, we assessed validity of the four-item Mod-FP compared with the five-item FFP. We compared the phenotypes via receiver operator characteristic curves, agreement in classifying frailty, and criterion validity via association with having experienced falls. Mod-FP classified 8% of PWH as frail, whereas FFP classified 9%. The area under the receiver operator characteristic curve for Mod-FP classifying frailty was 0.93 (95% CI = 0.91-0.96). We observed kappa ranging from 0.64 (unweighted) to 0.75 (weighted) for categorizing frailty status. Both definitions found frailty associated with a greater odds of experiencing a fall; FFP estimated a slightly greater magnitude (i.e., OR) for the association than Mod-FP. The Mod-FP has good performance in measuring frailty among PWH and is reasonable to use when the gold standards of observed assessments (i.e., weakness and slowness) are not feasible., (Copyright © 2023 Association of Nurses in AIDS Care.)

Objective: Lung transplant (LTx) saves lives in cystic fibrosis (CF). However, many potential candidates express uncertainty about LTx and die before receiving this treatment. CF guidelines recommend LTx education and clinical discussions well before the need for LTx arises, but limited patient resources exist., Materials and Methods: We engaged people with CF and CF physicians in human-centered design of "Take On Transplant" (TOT), a web-based education tool to prepare patients for LTx discussions. Across 3 phases, needs assessment, design groups, and iterative user testing of TOT, we refined TOT from wireframe prototypes, to an interactive website, to a fully functional intervention ready for clinical trials., Results: Fifty-five people with CF and 105 physicians identified information needs to prepare for LTx discussions. Design groups (n = 14 participants) then established core requirements: didactic education ("Resource Library"), patient narratives ("CF Stories"), frequently asked questions ("FAQ"), and self-assessment to tailor content ("My CF Stage"). Iterative usability testing (n = 39) optimized the design of CF Stories and prototype layout. We then developed the TOT website and demonstrated feasibility and preliminary efficacy of use through 2-week field testing (n = 9)., Discussion: Our human-centered design process provided guidance for educational tools to serve the evolving needs of potential LTx candidates. Our findings support the process of patient deliberation as a foundation for shared decision-making in CF, and inform educational tools that could potentially translate beyond LTx., Conclusion: TOT fills a critical gap in preparing people with CF for shared decision-making about LTx and may serve as a model for educational tools for other preference-sensitive decisions., (© The Author(s) 2022. Published by Oxford University Press on behalf of the American Medical Informatics Association. All rights reserved. For permissions, please email: journals.permissions@oup.com.)

Objective: Digital exposure notifications (DEN) systems were an emergency response to the coronavirus disease 2019 (COVID-19) pandemic, harnessing smartphone-based technology to enhance conventional pandemic response strategies such as contact tracing. We identify and describe performance measurement constructs relevant to the implementation of DEN tools: (1) reach (number of users enrolled in the intervention); (2) engagement (utilization of the intervention); and (3) effectiveness in preventing transmissions of COVID-19 (impact of the intervention). We also describe WA State's experience utilizing these constructs to design data-driven evaluation approaches., Methods: We conducted an environmental scan of DEN documentation and relevant publications. Participation in multidisciplinary collaborative environments facilitated shared learning. Compilation of available data sources and their relevance to implementation and operation workflows were synthesized to develop implementation evaluation constructs., Results: We identified 8 useful performance indicators within reach, engagement, and effectiveness constructs., Discussion: We use implementation science to frame the evaluation of DEN tools by linking the theoretical constructs with the metrics available in the underlying disparate, deidentified, and aggregate data infrastructure. Our challenges in developing meaningful metrics include limited data science competencies in public health, validation of analytic methodologies in the complex and evolving pandemic environment, and the lack of integration with the public health infrastructure., Conclusion: Continued collaboration and multidisciplinary consensus activities can improve the utility of DEN tools for future public health emergencies., (© The Author(s) 2022. Published by Oxford University Press on behalf of the American Medical Informatics Association.)

Background: People with HIV (PWH) are at increased risk of cardiovascular comorbidities and substance use is a potential predisposing factor. We evaluated associations of tobacco smoking and alcohol use with venous thromboembolism (VTE) in PWH., Methods: We assessed incident, centrally adjudicated VTE among 12 957 PWH within the Centers for AIDS Research Network of Integrated Clinical Systems (CNICS) cohort between January 2009 and December 2018. Using separate Cox proportional hazards models, we evaluated associations of time-updated alcohol and cigarette use with VTE, adjusting for demographic and clinical characteristics. Smoking was evaluated as pack-years and never, former, or current use with current cigarettes per day. Alcohol use was parameterized using categorical and continuous alcohol use score, frequency of use, and binge frequency., Results: During a median of 3.6 years of follow-up, 213 PWH developed a VTE. One-third of PWH reported binge drinking and 40% reported currently smoking. In adjusted analyses, risk of VTE was increased among both current (HR: 1.44, 95% CI: 1.02-2.03) and former (HR: 1.44, 95% CI: 0.99-2.07) smokers compared to PWH who never smoked. Additionally, total pack-years among ever-smokers (HR: 1.10 per 5 pack-years; 95% CI: 1.03-1.18) was associated with incident VTE in a dose-dependent manner. Frequency of binge drinking was associated with incident VTE (HR: 1.30 per 7 days/month, 95% CI: 1.11-1.52); however, alcohol use frequency was not. Severity of alcohol use was not significantly associated with VTE., Conclusions: Current smoking and pack-year smoking history were dose-dependently associated with incident VTE among PWH in CNICS. Binge drinking was also associated with VTE. Interventions for smoking and binge drinking may decrease VTE risk among PWH., (© 2022 British HIV Association.)

Background: Digital health interventions (DHI) have the potential to improve the management and utilization of health information to optimize health care worker performance and provision of care. Despite the proliferation of DHI projects in low-and middle-income countries, few have been evaluated in an effort to understand their impact on health systems and health-related outcomes. Although more evidence is needed on their impact and effectiveness, the use of DHIs among immunization programs has become more widespread and shows promise for improving vaccination uptake and adherence to immunization schedules., Methods: Our aim was to assess the impact of an electronic immunization registry (EIR) using an interrupted time-series analysis to analyze the effect on proportion of on-time vaccinations following introduction of an EIR in Tanzania. We hypothesized that the introduction of the EIR would lead to statistically significant changes in vaccination timeliness at 3, 6, and > 6 months post-introduction., Results: For our primary analysis, we observed a decrease in the proportion of on-time vaccinations following EIR introduction. In contrast, our sensitivity analysis estimated improvements in timeliness among those children with complete vaccination records. However, we must emphasize caution interpreting these findings as they are likely affected by implementation challenges., Conclusions: This study highlights the complexities of using digitized individual-level routine health information system data for evaluation and research purposes. EIRs have the potential to improve vaccination timeliness, but analyses using EIR data can be complicated by data quality issues and inconsistent data entry leading to difficulties interpreting findings., (© 2022. The Author(s).)

Context: Documented goals-of-care discussions are an important quality metric for patients with serious illness. Natural language processing (NLP) is a promising approach for identifying goals-of-care discussions in the electronic health record (EHR)., Objectives: To compare three NLP modeling approaches for identifying EHR documentation of goals-of-care discussions and generate hypotheses about differences in performance., Methods: We conducted a mixed-methods study to evaluate performance and misclassification for three NLP featurization approaches modeled with regularized logistic regression: bag-of-words (BOW), rule-based, and a hybrid approach. From a prospective cohort of 150 patients hospitalized with serious illness over 2018 to 2020, we collected 4391 inpatient EHR notes; 99 (2.3%) contained documented goals-of-care discussions. We used leave-one-out cross-validation to estimate performance by comparing pooled NLP predictions to human abstractors with receiver-operating-characteristic (ROC) and precision-recall (PR) analyses. We qualitatively examined a purposive sample of 70 NLP-misclassified notes using content analysis to identify linguistic features that allowed us to generate hypotheses underpinning misclassification., Results: All three modeling approaches discriminated between notes with and without goals-of-care discussions (AUC ROC : BOW, 0.907; rule-based, 0.948; hybrid, 0.965). Precision and recall were only moderate (precision at 70% recall: BOW, 16.2%; rule-based, 50.4%; hybrid, 49.3%; AUC PR : BOW, 0.505; rule-based, 0.579; hybrid, 0.599). Qualitative analysis revealed patterns underlying performance differences between BOW and rule-based approaches., Conclusion: NLP holds promise for identifying EHR-documented goals-of-care discussions. However, the rarity of goals-of-care content in EHR data limits performance. Our findings highlight opportunities to optimize NLP modeling approaches, and support further exploration of different NLP approaches to identify goals-of-care discussions., (Copyright © 2022 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.)

Background: An optimal adherence to antiretroviral therapy (ART) is fundamental for suppression of HIV viral load and favourable treatment outcomes. Patient-reported outcomes (PROs) are effective tools for improving patient-provider communication and focusing providers' awareness on current health problems. The objectives of this analysis were (1) to determine the feasibility of implementing an electronic screening tool to measure PROs in a Canadian HIV clinic to obtain information on ART adherence and related factors and (2) to determine the factors related to sub-optimal adherence., Methods: This implementation research with a convenience sample of 600 people living with HIV (PLWH) was conducted in a busy, academic, urban HIV clinic in Toronto, Canada. PLWH were approached to participate in PRO assessments just prior to their in-clinic appointments, including health-related domains such as mental health, housing, nutrition, financial stress and medication adherence, and responses were summarized on a single sheet available for providers to review. Feasibility of implementing PROs was assessed by quantifying response rate, completion rate, time taken and participation rate. Medication adherence was elicited by self-report of the percentage of prescribed HIV medications taken in the last month. Unadjusted and adjusted odds ratios were estimated from logistic regression models to identify factors associated with adherence of <95%., Results: Of the 748 PLWH invited to participate, 692 (participation rate: 92.5%) completed the PRO assessments as standard of care in clinic. Of these, 600 consented to the use of their PRO results for research and were included in this analysis. The average response rate to the ART-related questions was 96.8% and mean completion rate was 95.5%. The median time taken to complete the assessment was 12.0 (IQR = 8.4-17.3) min, adjusted 8.7 (IQR = 7.2-10.8) min. 445 (74.9%) of participants were male, and 153 (26.2%) reported dissatisfaction with ART. 105 (19.7%) of the PLWH reported ART adherence of <95%. Multivariable logistic regression identified the following risk factors for sub-optimal adherence: dissatisfaction with ART (OR = 2.30, 95% CI 1.38-3.83), not having a family doctor or not visiting a family doctor in last year (OR = 1.69, 95% CI 1.02-2.79)., Conclusion: Collecting self-reported health information from PLWH through PROs in a busy urban clinic was feasible and can provide relevant information to healthcare providers on issues related to adherence. This has a potential to help in individualizing ambulatory care.

Substance use in the U.S. varies by geographic region. Opioid prescribing practices and marijuana, heroin, and methamphetamine availability are evolving differently across regions. We examined self-reported substance use among people living with HIV (PLWH) in care at seven sites from 2017-2019 to understand current regional substance use patterns. We calculated the percentage and standardized percentage of PLWH reporting current drug use and at-risk and binge alcohol use by U.S. Census Bureau geographic region and examined associations in adjusted logistic regression analyses. Among 7,686 PLWH, marijuana use was the most prevalent drug (30%), followed by methamphetamine/crystal (8%), cocaine/crack (7%), and illicit opioids (3%). One-third reported binge alcohol use (32%). Differences in percent of current use by region were seen for marijuana (24-41%) and methamphetamine/crystal (2-15%), with more use in the West and Northeast, and binge alcohol use (26-40%). In adjusted analyses, PLWH in the Midwest were significantly less likely to use methamphetamine/crystal (aOR: 0.13;0.06-0.25) or illicit opioids (aOR:0.16;0.05-0.53), and PLWH in the Northeast were more likely to use cocaine/crack (aOR:1.59;1.16-2.17), compared to PLWH in the West. Understanding differences in substance use patterns in the current era, as policies continue to evolve, will enable more targeted interventions in clinical settings among PLWH.

Making EHR Data More Available for Research and Public Health (MedMorph) is a Centers for Disease Control and Prevention-led initiative developing and demonstrating a reference architecture (RA) and implementation, including Health Level Seven International Fast Healthcare Interoperability Resources (HL7 FHIR) implementation guides (IGs), describing how to leverage FHIR for aligned research and public health access to clinical data for automated data exchange. MedMorph engaged a technical expert panel of more than 100 members to model representative use cases, develop IGs (architectural and content), align with existing efforts in the FHIR community, and demonstrate the RA in research and public health uses. The RA IG documents common workflows needed to automatically send research data to Research Patient Data Repositories for multiple use cases. Sharing a common RA and canonical data model will improve data sharing for research and public health needs and generate evidence. MedMorph delivers a robust, reusable method to utilize data from electronic health records addressing multiple research and public health needs., (Published by Oxford University Press on behalf of the American Medical Informatics Association 2021. This work is written by a US Government employee and is in the public domain in the US.)