Search

CONTEXT: Documented goals-of-care discussions are an important quality metric for patients with serious illness. Natural language processing (NLP) is a promising approach for identifying goals-of-care discussions in the electronic health record (EHR). OBJECTIVES: To compare three NLP modeling approaches for identifying EHR documentation of goals-of-care discussions and generate hypotheses about differences in performance. METHODS: We conducted a mixed-methods study to evaluate performance and misclassification for three NLP featurization approaches modeled with regularized logistic regression: bag-of-words (BOW), rule-based, and a hybrid approach. From a prospective cohort of 150 patients hospitalized with serious illness over 2018–2020, we collected 4,391 inpatient EHR notes; 99 (2.3%) contained documented goals-of-care discussions. We used leave-one-out cross-validation to estimate performance by comparing pooled NLP predictions to human abstractors with receiver-operating-characteristic (ROC) and precision-recall (PR) analyses. We qualitatively examined a purposive sample of 70 NLP-misclassified notes using content analysis to identify linguistic features that allowed us to generate hypotheses underpinning misclassification. RESULTS: All three modeling approaches discriminated between notes with and without goals-of-care discussions (AUC(ROC): BOW, 0.907; rule-based, 0.948; hybrid, 0.965). Precision and recall were only moderate (precision at 70% recall: BOW, 16.2%; rule-based, 50.4%; hybrid, 49.3%; AUC(PR): BOW, 0.505; rule-based, 0.579; hybrid, 0.599). Qualitative analysis revealed patterns underlying performance differences between BOW and rule-based approaches. CONCLUSION: NLP holds promise for identifying EHR-documented goals-of-care discussions. However, the rarity of goals-of-care content in EHR data limits performance. Our findings highlight opportunities to optimize NLP modeling approaches, and support further exploration of different NLP approaches to identify goals-of-care discussions.

ImportanceDiscussions about goals of care are important for high-quality palliative care yet are often lacking for hospitalized older patients with serious illness.ObjectiveTo evaluate a communication-priming intervention to promote goals-of-care discussions between clinicians and hospitalized older patients with serious illness.Design, Setting, and ParticipantsA pragmatic, randomized clinical trial of a clinician-facing communication-priming intervention vs usual care was conducted at 3 US hospitals within 1 health care system, including a university, county, and community hospital. Eligible hospitalized patients were aged 55 years or older with any of the chronic illnesses used by the Dartmouth Atlas project to study end-of-life care or were aged 80 years or older. Patients with documented goals-of-care discussions or a palliative care consultation between hospital admission and eligibility screening were excluded. Randomization occurred between April 2020 and March 2021 and was stratified by study site and history of dementia.InterventionPhysicians and advance practice clinicians who were treating the patients randomized to the intervention received a 1-page, patient-specific intervention (Jumpstart Guide) to prompt and guide goals-of-care discussions.Main Outcomes and MeasuresThe primary outcome was the proportion of patients with electronic health record–documented goals-of-care discussions within 30 days. There was also an evaluation of whether the effect of the intervention varied by age, sex, history of dementia, minoritized race or ethnicity, or study site.ResultsOf 3918 patients screened, 2512 were enrolled (mean age, 71.7 [SD, 10.8] years and 42% were women) and randomized (1255 to the intervention group and 1257 to the usual care group). The patients were American Indian or Alaska Native (1.8%), Asian (12%), Black (13%), Hispanic (6%), Native Hawaiian or Pacific Islander (0.5%), non-Hispanic (93%), and White (70%). The proportion of patients with electronic health record–documented goals-of-care discussions within 30 days was 34.5% (433 of 1255 patients) in the intervention group vs 30.4% (382 of 1257 patients) in the usual care group (hospital- and dementia-adjusted difference, 4.1% [95% CI, 0.4% to 7.8%]). The analyses of the treatment effect modifiers suggested that the intervention had a larger effect size among patients with minoritized race or ethnicity. Among 803 patients with minoritized race or ethnicity, the hospital- and dementia-adjusted proportion with goals-of-care discussions was 10.2% (95% CI, 4.0% to 16.5%) higher in the intervention group than in the usual care group. Among 1641 non-Hispanic White patients, the adjusted proportion with goals-of-care discussions was 1.6% (95% CI, −3.0% to 6.2%) higher in the intervention group than in the usual care group. There was no evidence of differential treatment effects of the intervention on the primary outcome by age, sex, history of dementia, or study site.Conclusions and RelevanceAmong hospitalized older adults with serious illness, a pragmatic clinician-facing communication-priming intervention significantly improved documentation of goals-of-care discussions in the electronic health record, with a greater effect size in racially or ethnically minoritized patients.Trial RegistrationClinicalTrials.gov Identifier: NCT04281784

Family members of critically ill patients with COVID-19 have described increased symptoms of Post-Traumatic Stress Disorder (PTSD). Little is known about how these symptoms may change over time.We studied changes in PTSD symptoms in family members of critically ill patients with COVID-19 over 12-months.This prospective, multi-site observational cohort study recruited participants at 12 hospitals in 5 states. Calls were made to participants at 3-4 months, 6-months, and 12-months post-patient admission to the ICU.There were 955 eligible family members, of whom 330 (53.3% of those reached) consented to participate. Complete longitudinal data was acquired for 115 individuals (34.8% of consented). PTSD symptoms were measured by the Impact of Events Scale-6 (IES-6), with a score of ≥10 identifying significant symptoms. At 3-months, the mean IES-6 score was 11.9±6.1 with 63.6% having significant symptoms, decreasing to 32.9% at one year (mean IES-6 score 7.6±5.0). Three clusters of symptom evolution emerged over time: persistent symptoms (34.8%, n=40), recovered symptoms (33.0%, n=38) and non-development of symptoms (32.2%, n=37). While participants identifying as Hispanic demonstrated initially higher adjusted IES-6 scores (2.57 points higher [95% CI: 1.1, 4.1, p =0.001]), they also demonstrated a more dramatic improvement in adjusted scores over time (4.7 greater decrease at 12 months [95% CI: 3.2-6.3, p.001]).One year later, some family members of patients with COVID-19 continue to experience significant symptoms of PTSD. Further studies are needed to better understand how various differences contribute to increased risk for these symptoms.

IMPORTANCE: The psychological symptoms associated with having a family member admitted to the intensive care unit (ICU) during the COVID-19 pandemic are not well defined. OBJECTIVE: To examine the prevalence of symptoms of stress-related disorders, primarily posttraumatic stress disorder (PTSD), in family members of patients admitted to the ICU with COVID-19 approximately 90 days after admission. DESIGN, SETTING, AND PARTICIPANTS: This prospective, multisite, mixed-methods observational cohort study assessed 330 family members of patients admitted to the ICU (except in New York City, which had a random sample of 25% of all admitted patients per month) between February 1 and July 31, 2020, at 8 academic-affiliated and 4 community-based hospitals in 5 US states. EXPOSURE: Having a family member in the ICU with COVID-19. MAIN OUTCOMES AND MEASURES: Symptoms of PTSD at 3 months, as defined by a score of 10 or higher on the Impact of Events Scale 6 (IES-6). RESULTS: A total of 330 participants (mean [SD] age, 51.2 [15.1] years; 228 [69.1%] women; 150 [52.8%] White; 92 [29.8%] Hispanic) were surveyed at the 3-month time point. Most individuals were the patients’ child (129 [40.6%]) or spouse or partner (81 [25.5%]). The mean (SD) IES-6 score at 3 months was 11.9 (6.1), with 201 of 316 respondents (63.6%) having scores of 10 or higher, indicating significant symptoms of PTSD. Female participants had an adjusted mean IES-6 score of 2.6 points higher (95% CI, 1.4-3.8; P

High-quality goals-of-care communication is critical to delivering goal-concordant, patient-centered care to hospitalized patients with chronic life-limiting illness. However, implementation and documentation of goals-of-care discussions remain important shortcomings in many health systems.To evaluate the efficacy, feasibility, and acceptability of a patient-facing and clinician-facing communication-priming intervention to promote goals-of-care communication for patients hospitalized with serious illness.This randomized clinical trial enrolled patients from November 6, 2018, to February 18, 2020. The setting was 2 hospitals in an academic health care system in Seattle, Washington. Participants included hospitalized adults with chronic life-limiting illness, aged 65 years or older and with markers of frailty, or aged 80 years or older. Data analysis was performed from August 2020 to August 2021.Patients were randomized to usual care with baseline questionnaires (control) vs the Jumpstart communication-priming intervention. Patients or surrogates in the intervention group and their clinicians received patient-specific Jumpstart Guides populated with data from questionnaires and the electronic health records (EHRs) that were designed to prompt and guide a goals-of-care discussion.The primary outcome was EHR documentation of a goals-of-care discussion between randomization and hospital discharge. Additional outcomes included patient-reported or surrogate-reported goals-of-care discussions, patient-reported or surrogate-reported quality of communication, and intervention feasibility and acceptability.Of 428 eligible patients, this study enrolled 150 patients (35% enrollment rate; mean [SD] age, 59.2 [13.6] years; 66 women [44%]; 132 [88%] by patient consent and 18 [12%] by surrogate consent). Seventy-five patients each were randomized to the intervention and control groups. Compared with the control group, the cumulative incidence of EHR-documented goals-of-care discussions between randomization and hospital discharge was higher in the intervention group (16 of 75 patients [21%] vs 6 of 75 patients [8%]; risk difference, 13% [95% CI, 2%-24%]; risk ratio, 2.67 [95% CI, 1.10-6.44]; P = .04). Patient-reported or surrogate-reported goals-of-care discussions did not differ significantly between groups (30 of 66 patients [45%] vs 36 of 66 patients [55%]), although the intrarater consistency of patient and surrogate reports was poor. Patient-rated or surrogate-rated quality of communication did not differ significantly between groups. The intervention was feasible and acceptable to patients, surrogates, and clinicians.In this randomized clinical trial, a patient-facing and clinician-facing communication priming intervention for seriously ill, hospitalized patients promoted EHR-documented goals-of-care discussions before discharge with good feasibility and acceptability. Communication-priming interventions should be reexamined in a larger randomized clinical trial to better understand their effectiveness in the inpatient setting.ClinicalTrials.gov Identifier: NCT03746392.

Although goals-of-care discussions are important for high-quality palliative care, this communication is often lacking for hospitalized older patients with serious illness. Electronic health records (EHR) provide an opportunity to identify patients who might benefit from these discussions and promote their occurrence, yet prior interventions using the EHR for this purpose are limited. We designed two complementary yet independent randomized trials to examine effectiveness of a communication-priming intervention (Jumpstart) for hospitalized older adults with serious illness.We report the protocol for these 2 randomized trials. Trial 1 has two arms, usual care and a clinician-facing Jumpstart, and is a pragmatic trial assessing outcomes with the EHR only (n = 2000). Trial 2 has three arms: usual care, clinician-facing Jumpstart, and clinician- and patient-facing (bi-directional) Jumpstart (n = 600). We hypothesize the clinician-facing Jumpstart will improve outcomes over usual care and the bi-directional Jumpstart will improve outcomes over the clinician-facing Jumpstart and usual care. We use a hybrid effectiveness-implementation design to examine implementation barriers and facilitators.For both trials, the primary outcome is EHR documentation of a goals-of-care discussion within 30 days of randomization; additional outcomes include intensity of end-of-life care. Trial 2 also examines patient- or family-reported outcomes assessed by surveys targeting 3-5 days and 4-8 weeks after randomization including quality of goals-of-care communication, receipt of goal-concordant care, and psychological symptoms.This novel study incorporates two complementary randomized trials and a hybrid effectiveness-implementation approach to improve the quality and value of care for hospitalized older adults with serious illness.STUDY00007031-A and STUDY00007031-B.