Search

Background: Equitable assessment is critical in competency-based medical education. This study explores differences in key characteristics of qualitative assessments (i.e., narrative comments or assessment feedback) of internal medicine postgraduate resident performance associated with gender and race and ethnicity. Methods: Analysis of narrative comments included in faculty assessments of resident performance from six internal medicine residency programs was conducted. Content analysis was used to assess two key characteristics of comments- valence (overall positive or negative orientation) and specificity (detailed nature and actionability of comment) – via a blinded, multi-analyst approach. Differences in comment valence and specificity with gender and race and ethnicity were assessed using multilevel regression, controlling for multiple covariates including quantitative competency ratings. Results: Data included 3,383 evaluations with narrative comments by 597 faculty of 698 residents, including 45% of comments about women residents and 13.2% about residents who identified with race and ethnicities underrepresented in medicine. Most comments were moderately specific and positive. Comments about women residents were more positive (estimate 0.06, p 0.045) but less specific (estimate − 0.07, p 0.002) compared to men. Women residents were more likely to receive non-specific, weakly specific or no comments (adjusted OR 1.29, p 0.012) and less likely to receive highly specific comments (adjusted OR 0.71, p 0.003) or comments with specific examples of things done well or areas for growth (adjusted OR 0.74, p 0.003) than men. Gendered differences in comment specificity and valence were most notable early in training. Comment specificity and valence did not differ with resident race and ethnicity (specificity: estimate 0.03, p 0.32; valence: estimate − 0.05, p 0.26) or faculty gender (specificity: estimate 0.06, p 0.15; valence: estimate 0.02 p 0.54). Conclusion: There were significant differences in the specificity and valence of qualitative assessments associated with resident gender with women receiving more praising but less specific and actionable comments. This suggests a lost opportunity for well-rounded assessment feedback to the disadvantage of women. [ABSTRACT FROM AUTHOR]

Introduction: Evidence suggests gender disparities in medical education assessment, including differences in ratings of competency and narrative comments provided in resident performance assessments. This study explores how gender manifests within the content of qualitative assessments (i.e., narrative comments or performance feedback) of resident performance. Methods: Qualitative content analysis was used to explore gender-based differences in narrative comments included in faculty assessments of resident performance during inpatient medicine rotations at six Internal Medicine residency programs, 2016–2017. A blinded, multi-analyst approach was employed to identify themes across comments. Patterns in themes with resident gender and post-graduate year (PGY) were explored, focusing on PGY2 and PGY3 when residents are serving in the team leader role. Results: Data included 3,383 evaluations with narrative comments of 385 men (55.2%) and 313 women residents (44.8%). There were thematic differences in narrative comments received by men and women residents and how these themes manifested within comments changed with training time. Compared to men, comments about women had a persistent relationship-orientation and emphasized confidence over training including as interns and in PGY2 and PGY3, when serving as team leader. The relationship-orientation was characterized not only by the residents' communal attributes but also their interpersonal and communication skills, including efforts supporting others and establishing the tone for the team. Comments about women residents often highlighted confidence, including recommendations around behaviors that convey confidence in decision-making and team leadership. Discussion: There were gender-based thematic differences in qualitative assessments. Comments about women resident team leaders highlight relationship building skills and urge confidence and actions that convey confidence as team leader. Persistent attention to communal skills suggests gendered expectations for women resident team leaders and a lost opportunity for well-rounded feedback to the disadvantage of women residents. These findings may inform interventions to promote equitable assessment, such as providing feedback across the competencies. [ABSTRACT FROM AUTHOR]

Background: Coaching has been shown to decrease physician burnout; however, coachee outcomes have been the focus. We report the impact of coaching on women-identifying surgeons who participated as coaches in a 9-month virtual program. Methods: A coaching program was implemented in the Association of Women Surgeons (AWS) to determine the effects of coaching on well-being and burnout from 2018 to 2020. AWS members volunteered and completed training in professional development coaching. Pre- and post-study measures were assessed, and bivariate analysis performed based on burnout and professional fulfillment score. Results: Seventy-five coaches participated; 57 completed both pre- and post-study surveys. There were no significant changes in burnout or professional fulfillment including the Positive Emotion, Engagement, Relationship, Meaning, and Accomplishment scale, hardiness, self-valuation, coping, gratitude, or intolerance of uncertainty scores from baseline to post-survey. On bivariate analysis, hardiness was associated with lower burnout throughout the duration of the program. Coaches with lower burnout at the end of the program met with their coachee more frequently than coaches with higher burnout [mean (SD) 3.95(2.16) versus 2.35(2.13) p = 0.0099]. Discussion: Burnout and professional fulfillment demonstrated no change in women surgeons who participated as professional development coaches. Those with lower burnout and higher professional fulfillment at the end of the program were found to have higher hardiness, which may be worth future investigation. Conclusions: Acquisition of coaching skills did not directly improve well-being in faculty who participated in a resident coaching program. Future studies would benefit from control groups and exploration of qualitative benefits of coaching. [ABSTRACT FROM AUTHOR]

Background: Understanding association between factors related to clinical work environment and well-being can inform strategies to improve physicians' work experience. Objective: To model and quantify what drivers of work composition, team structure, and dynamics are associated with well-being. Design: Utilizing social network modeling, this cohort study of physicians in an academic health center examined inbasket messaging data from 2018 to 2019 to identify work composition, team structure, and dynamics features. Indicators from a survey in 2019 were used as dependent variables to identify factors predictive of well-being. Participants: EHR data available for 188 physicians and their care teams from 18 primary care practices; survey data available for 163/188 physicians. Main Measures: Area under the receiver operating characteristic curve (AUC) of logistic regression models to predict well-being dependent variables was assessed out-of-sample. Key Results: The mean AUC of the model for the dependent variables of emotional exhaustion, vigor, and professional fulfillment was, respectively, 0.665 (SD 0.085), 0.700 (SD 0.082), and 0.669 (SD 0.082). Predictors associated with decreased well-being included physician centrality within support team (OR 3.90, 95% CI 1.28–11.97, P=0.01) and share of messages related to scheduling (OR 1.10, 95% CI 1.03–1.17, P=0.003). Predictors associated with increased well-being included higher number of medical assistants within close support team (OR 0.91, 95% CI 0.83–0.99, P=0.05), nurse-centered message writing practices (OR 0.89, 95% CI 0.83–0.95, P=0.001), and share of messages related to ambiguous diagnosis (OR 0.92, 95% CI 0.87–0.98, P=0.01). Conclusions: Through integration of EHR data with social network modeling, the analysis highlights new characteristics of care team structure and dynamics that are associated with physician well-being. This quantitative methodology can be utilized to assess in a refined data-driven way the impact of organizational changes to improve well-being through optimizing team dynamics and work composition. [ABSTRACT FROM AUTHOR]

Background: Disparities in objective assessments in graduate medical education such as the In-Training Examination (ITE) that disadvantage women and those self-identifying with race/ethnicities underrepresented in medicine (URiM) are of concern.Objective: Examine ITE trends longitudinally across post-graduate year (PGY) with gender and race/ethnicity.Design: Longitudinal analysis of resident ITE metrics at 7 internal medicine residency programs, 2014-2019. ITE trends across PGY of women and URiM residents compared to non-URiM men assessed via ANOVA. Those with ITE scores associated with less than 90% probability of passing the American Board of Internal Medicine certification exam (ABIM-CE) were identified and odds of being identified as at-risk between groups were assessed with chi square.Participants: A total of 689 IM residents, including 330 women and URiM residents (48%).Main Measures: ITE score KEY RESULTS: There was a significant difference in ITE score across PGY for women and URiM residents compared to non-URiM men (F(2, 1321) 4.46, p=0.011). Adjusting for program, calendar year, and baseline ITE, women and URiM residents had smaller ITE score gains (adjusted mean change in score between PGY1 and PGY3 (se), non-URiM men 13.1 (0.25) vs women and URiM residents 11.4 (0.28), p<0.001). Women and URiM residents had greater odds of being at potential risk for not passing the ABIM-CE (OR 1.75, 95% CI 1.10 to 2.78) with greatest odds in PGY3 (OR 3.13, 95% CI 1.54 to 6.37).Conclusion: Differences in ITE over training were associated with resident gender and race/ethnicity. Women and URiM residents had smaller ITE score gains across PGY translating into greater odds of potentially being seen as at-risk for not passing the ABIM-CE. Differences in ITE over training may reflect differences in experiences of women and URiM residents during training and may lead to further disparities. [ABSTRACT FROM AUTHOR]

Background: Coaching has been shown to improve resident well-being; however, not all benefit equally. Objective: Assess predictors of changes in resident physician well-being and burnout in a multisite implementation of a Professional Development Coaching Program. Design: Pre- and post-implementation surveys administered to participant cohorts at implementation sites in their intern year. Effect size was calculated comparing pre- and post-intervention paired data. Participants: In total, 272 residents in their intern year at five internal medicine residency programs (Boston Medical Center, University Hospitals Cleveland Medical Center, Duke University, Emory University, Massachusetts General Hospital). Analyses included 129 residents with paired data. Interventions: Interns were paired with a faculty coach trained in positive psychology and coaching skills and asked to meet quarterly with coaches. Main Measures: Primary outcomes included Maslach Burnout Inventory depersonalization (DP) and emotional exhaustion (EE) subscales, and the PERMA well-being scale. Key predictors included site, demographics, intolerance of uncertainty, hardiness-resilience, gratitude, and coping. Program moderators included were reflection, goal setting, and feedback. Key Results: Well-being (PERMA) changed from baseline to follow-up in all participants; females showed a decline and males an increase (−1.41 vs..83, p = 0.04). Self-reflection was associated with positive change in PERMA (mean positive change 1.93, p = 0.009). Burnout (EE) declined in non-Hispanic white residents vs. Black/Asian/Hispanic/other residents (−1.86, p = 0.021). Burnout improved with increased goal setting. Conclusion: Coaching programs should consider tailored approaches to support residents whose well-being is impacted by gender and/or race, and who have higher intolerance of uncertainty and lower resilience at baseline. Coaching skills of goal setting and reflection may positively affect interns and teach coping skills. [ABSTRACT FROM AUTHOR]

A moderately strong correlation was also seen between the total PERMA score and the personal accomplishment component of MBI among residents ( I r i = 0.51). We hypothesized that resident well-being would be lower compared with faculty scores and that the PERMA and MBI models would correlate inversely given the focus on measuring positive versus negative aspects of well-being. Overall, no correlation between the two models was found; however, in the subgroup analyses of residents only, a statistically significant inverse relationship was found between the positive emotion (P) of PERMA and the emotional exhaustion (EE) of MBI. Individual items are assessed on a 0-5 scale with 0 correlating with "never" and 5 with "always".[7], [9] We assessed the mean PERMA score, and the individual domain scores (P, E, R, M, and A) across residents and faculty at pre-survey completion. [Extracted from the article]

This document is a correction notice for an article titled "Exploring gender and thematic differences in qualitative assessments of internal medicine resident performance" published in BMC Medical Education. The correction addresses formatting errors in quotes and Table 2. The original article has been corrected. The correction notice also includes the names of the authors involved in the study. [Extracted from the article]

Background: Competency-based medical education relies on meaningful resident assessment. Implicit gender bias represents a potential threat to the integrity of resident assessment. We sought to examine the available evidence of the potential for and impact of gender bias in resident assessment in graduate medical education.Methods: A systematic literature review was performed to evaluate the presence and influence of gender bias on resident assessment. We searched Medline and Embase databases to capture relevant articles using a tiered strategy. Review was conducted by two independent, blinded reviewers. We included studies with primary objective of examining the impact of gender on resident assessment in graduate medical education in the USA or Canada published from 1998 to 2018.Results: Nine studies examined the existence and influence of gender bias in resident assessment and data included rating scores and qualitative comments. Heterogeneity in tools, outcome measures, and methodologic approach precluded meta-analysis. Five of the nine studies reported a difference in outcomes attributed to gender including gender-based differences in traits ascribed to residents, consistency of feedback, and performance measures.Conclusion: Our review suggests that gender bias poses a potential threat to the integrity of resident assessment in graduate medical education. Future study is warranted to understand how gender bias manifests in resident assessment, impact on learners and approaches to mitigate this bias. [ABSTRACT FROM AUTHOR]

The Accreditation Council for Graduate Medical Education (ACGME) requirement that internal medicine residents spend one-third of their training in an ambulatory setting has resulted in programmatic innovation across the country. The traditional weekly half-day clinic model has lost ground to the block or "X + Y" clinic model, which has gained in popularity for many reasons. Several disadvantages of the block model have been reported, however, and residency programs are caught between the threat of old and new challenges. We offer the perspectives of three large residency programs (University of Washington, Emory University, and Massachusetts General Hospital) that have successfully navigated scheduling challenges in our individual settings without implementing the block model. By sharing our innovative non-block models, we hope to demonstrate that programs can and should create the solution that fits their individual needs. [ABSTRACT FROM AUTHOR]

The article focuses on the residency program called Clinical Learning Environment Review (CLER) by the organization Accreditation Council of Graduate Medical Education (ACGME). Topics discussed include experiences of residents who completed the course, with subjects such as work life balance, information processing, and self confidence.

The article attempts to design, implement, and assess a program to support intern professional development in medicine through positive psychology coaching.