Search

ProblemMedical educators recognize that partnering actively with health system leaders closes significant health care experience, quality, and outcomes gaps. Medical schools have explored innovations training physicians to care for both individual patients and populations while improving systems of care. Yet, early medical student education fails to include systems improvement as foundational skills. When health systems science is taught, it is often separated from core clinical skills.ApproachThe Clinical Microsystems Clerkship at the University of California, San Francisco School of Medicine, launched in 2016, integrates clinical skills training with health systems improvement from the start of medical school. Guided by communities of practice and workplace learning principles, it embeds first-year and second-year students in longitudinal clinical microsystems with physician coaches and interprofessional clinicians one day per week. Students learn medical history, physical examination, patient communication, interprofessional teamwork, and health systems improvement. Assessments include standardized patient examinations and improvement project reports. Program outcome measures include student satisfaction and attitudes, clinical skills performance, and evidence of systems improvement learning, including dissemination and scholarship.OutcomesStudents reported high satisfaction (first-year, 4.10; second-year, 4.29, on a scale of 1-5) and value (4.14) in their development as physicians. Clinical skills assessment accuracy was high (70%-96%). Guided by interprofessional clinicians across 15 departments, students completed 258 improvement projects in 3 health systems (academic, safety net, Veterans Affairs). Sample projects reduced disparities in hypertension, improved opiate safety, and decreased readmissions. Graduating students reported both clinical skills and health systems knowledge as important to physician success, patient experience, and clinical outcomes (4.73). Most graduates discussed their projects in residency applications (85%) and disseminated related papers and presentations (54%).Next stepsIntegrating systems improvement, interprofessional teamwork, and clinical skills training can redefine early medical student education. Health system perspectives, long-term outcomes, and sustainability merit further exploration.

ContextClinical supervisors make judgements about how much to trust learners with critical activities in patient care. Such decisions mediate trainees' opportunities for learning and competency development and thus are a critical component of education. As educators apply entrustment frameworks to assessment, it is important to determine how narrative feedback reflecting entrustment may also address learners' educational needs.MethodsIn this study, we used artificial intelligence (AI) and natural language processing (NLP) to identify characteristics of feedback tied to supervisors' entrustment decisions during direct observation encounters of clerkship medical students (3328 unique observations). Supervisors conducted observations of students and collaborated with them to complete an entrustment-based assessment in which they documented narrative feedback and assigned an entrustment rating. We trained a deep neural network (DNN) to predict entrustment levels from the narrative data and developed an explainable AI protocol to uncover the latent thematic features the DNN used to make its prediction.ResultsWe found that entrustment levels were associated with level of detail (specific steps for performing clinical tasks), feedback type (constructive versus reinforcing) and task type (procedural versus cognitive). In justifying both high and low levels of entrustment, supervisors detailed concrete steps that trainees performed (or did not yet perform) competently.ConclusionsFraming our results in the factors previously identified as influencing entrustment, we find a focus on performance details related to trainees' clinical competency as opposed to nonspecific feedback on trainee qualities. The entrustment framework reflected in feedback appeared to guide specific goal-setting, combined with details necessary to reach those goals. Our NLP methodology can also serve as a starting point for future work on entrustment and feedback as similar assessment datasets accumulate.

IntroductionTo advance in their clinical roles, residents must earn supervisors' trust. Research on supervisor trust in the inpatient setting has identified learner, supervisor, relationship, context, and task factors that influence trust. However, trust in the continuity clinic setting, where resident roles, relationships, and context differ, is not well understood. We aimed to explore how preceptors in the continuity clinic setting develop trust in internal medicine residents and how trust influences supervision.MethodsIn this qualitative study, we conducted semi-structured interviews with faculty preceptors from two continuity clinic sites in an internal medicine residency program at an urban academic medical center in the United States from August 2018-June 2020. We analyzed transcripts using thematic analysis with sensitizing concepts related to the theoretical framework of the five factors of trust.ResultsSixteen preceptors participated. We identified four key drivers of trust and supervision in the continuity clinic setting: 1) longitudinal resident-preceptor-patient relationships, 2) direct observations of continuity clinic skills, 3) resident attitude towards their primary care physician role, and 4) challenging context and task factors influencing supervision. Preceptors shared challenges to determining trust stemming from incomplete knowledge about patients and limited opportunities to directly observe and supervise between-visit care.DiscussionThe continuity clinic setting offers unique supports and challenges to trust development and trust-supervision alignment. Maximizing resident-preceptor-patient continuity, promoting direct observation, and improving preceptor supervision of residents' provision of between-visit care may improve resident continuity clinic learning and patient care.

IntroductionCoaching is a growing clinician-educator role. Self-efficacy is a powerful faculty motivator that is associated positively with job satisfaction and negatively with burnout. This study examines self-efficacy, job satisfaction, and burnout in coaches and other clinician-educators.MethodsWe conducted a mixed methods study using a quantitative survey followed by qualitative interviews of faculty at the University of California, San Francisco. Coaches (funded 20% full-time equivalents), faculty with other funded education positions ("funded"), and faculty without funded education positions ("unfunded") completed a 48-item survey addressing self-efficacy (teaching, professional development, and scholarship), job satisfaction, and burnout. Data were analyzed using analysis of variance followed by post-hoc tests and chi-square tests. To elaborate quantitative results, we conducted qualitative interviews of 15 faculty and analyzed data using framework analysis.Results202 of 384 faculty (52.6%) responded to the survey; 187 complete surveys were analyzed. Teaching self-efficacy was similar across groups. Coaches and funded educators had significantly higher professional development self-efficacy and job satisfaction than unfunded educators. Burnout was more prevalent in coaches and unfunded educators. Qualitative analysis yielded three themes: sources of reward, academic identity, and strategies to mitigate burnout. Educator roles provide reward that enhances self-efficacy and job satisfaction but also generate competing demands. Coaches cited challenges in forming professional identities and working with struggling learners.DiscussionThe coaching role provides faculty with benefits similar to other funded educator roles, but the particular demands of the coach role may contribute to burnout.

IntroductionTrust between supervisors and trainees mediates trainee participation and learning. A resident (postgraduate) trainee's understanding of their supervisor's trust can affect their perceptions of their patient care responsibilities, opportunities for learning, and overall growth as physicians. While the supervisor perspective of trust has been well studied, less is known about how resident trainees recognize supervisor trust and how it affects them.MethodsIn this qualitative study, 21 pediatric residents were interviewed at a single institution. Questions addressed their experiences during their first post-graduate year (PGY-1) on inpatient wards. Each interviewee was asked to describe three different patient care scenarios in which they perceived optimal, under-, and over-trust from their resident supervisor. Data were analyzed using thematic analysis.ResultsResidents recognized and interpreted their supervisor's trust through four factors: supervisor, task, relationship, and context. Optimal trust was associated with supervision balancing supervisor availability and resident independence, tasks affording participation in decision-making, trusting relationships with supervisors, and a workplace fostering appropriate autonomy and team inclusivity. The effects of supervisor trust on residents fell into three themes: learning experiences, attitudes and self-confidence, and identities and roles. Optimal trust supported learning via tailored guidance, confidence and lessened vulnerability, and a sense of patient ownership and team belonging.DiscussionUnderstanding how trainees recognize supervisor trust can enhance interventions for improving the dialogue of trust between supervisors and trainees. It is important for supervisors to be cognizant of their trainees' interpretations of trust because it affects how trainees understand their patient care roles, perceive autonomy, and approach learning.

Many medical schools have reconsidered or eliminated clerkship grades and honor society memberships. National testing organizations announced plans to eliminate numerical scoring for the United States Medical Licensing Examination Step 1 in favor of pass/fail results. These changes have led some faculty to wonder: "How will we recognize and reward excellence?" Excellence in undergraduate medical education has long been defined by high grades, top test scores, honor society memberships, and publication records. However, this model of learner excellence is misaligned with how students learn or what society values. This accolade-driven view of excellence is perpetuated by assessments that are based on gestalt impressions influenced by similarity between evaluators and students, and assessments that are often restricted to a limited number of traditional skill domains. To achieve a new model of learner excellence that values the trainee's achievement, growth, and responsiveness to feedback across multiple domains, we must envision a new model of teacher excellence. Such teachers would have a growth mindset toward assessing competencies and learning new competencies. Actualizing true learner excellence will require teachers to change from evaluators who conduct assessments of learning to coaches who do assessment for learning. Schools will also need to establish policies and structures that foster a culture that supports this change. In this new paradigm, a teacher's core duty is to develop talent rather than sort it.

BackgroundSince 2013, US residency programs have used the competency-based framework of the Milestones to report resident progress and to provide feedback to residents. The implementation of Milestones-based assessments, clinical competency committee (CCC) meetings, and processes for providing feedback varies among programs and warrants systematic examination across specialties.ObjectiveWe sought to determine how varying assessment, CCC, and feedback implementation strategies result in different outcomes in resource expenditure and stakeholder engagement, and to explore the contextual forces that moderate these outcomes.MethodsFrom 2017 to 2018, interviews were conducted of program directors, CCC chairs, and residents in emergency medicine (EM), internal medicine (IM), pediatrics, and family medicine (FM), querying their experiences with Milestone processes in their respective programs. Interview transcripts were coded using template analysis, with the initial template derived from previous research. The research team conducted iterative consensus meetings to ensure that the evolving template accurately represented phenomena described by interviewees.ResultsForty-four individuals were interviewed across 16 programs (5 EM, 4 IM, 5 pediatrics, 3 FM). We identified 3 stages of Milestone-process implementation, including a resource-intensive early stage, an increasingly efficient transition stage, and a final stage for fine-tuning.ConclusionsResidency program leaders can use these findings to place their programs along an implementation continuum and gain an understanding of the strategies that have enabled their peers to progress to improved efficiency and increased resident and faculty engagement.

The National Board of Medical Examiners' decision to change Step 1 of the United States Medical Licensing Examination (USMLE) from a three-digit score to Pass/Fail (P/F) represents a disruptive change for students, faculty, and leaders in the academic community. In the context of this change, some schools may re-consider the optimal timing of Step 1 as they strive to align their assessment practices with sound educational principles. Currently, over 20 schools administer USMLE Step 1 after the core clerkships. In this commentary, we review the educational rationale for a post-clerkship Step 1, highlighting how adult learning theories support this placement. We discuss some short-term challenges post-clerkship Step 1 schools may encounter due to the proposed timing of the change in scoring, which creates three unique scenarios for learners that can introduce inequity in the system and provoke anxiety. We review outcomes of potentially heightened importance when Step 1 is P/F, including lower clinical subject exam scores in some clerkships, lower failure rates on Step 1 and stable Step 2 Clinical Knowledge scores with implications for the residency match. We outline the future potential for performance-based time-variable Step 1 study periods that are facilitated by post-clerkship placement of the exam. Finally, we discuss opportunities to achieve the goal of enhancing student well-being, which was a major rationale for eliminating the three-digit score.

PurposeDespite increasing emphasis in medical school education on quality and systems improvement, many medical schools lack sufficient faculty with expertise to teach systems improvement. Using the pedagogical content knowledge framework, this study explores how faculty engage students in systems improvement work and faculty perceptions of the outcomes for the health system and students.MethodIn May-June 2017, the authors interviewed 12 of 13 invited faculty with experience in teaching and engaging first-year medical students in systems improvement work, the course of students' systems improvement work over time, the impact of students' projects on health systems, and students' learning and attitudes about systems improvement. The authors conducted qualitative analysis iteratively with data collection to sufficiency.ResultsSix emergent themes characterized faculty's approach to guiding students in systems improvement work: faculty-student relationship, faculty role, student role, faculty-student shared responsibility for projects, faculty and student content knowledge, and project outcomes. The faculty-student relationship was foundational for successful systems improvement work. Faculty roles included project selection, project management, and health systems interactions. Students engaged in systems improvement as their faculty leveraged their knowledge and skills and created meaningful student roles. Faculty and students shared responsibility and colearned systems improvement content knowledge. Faculty defined successful outcomes as students' learning about the systems improvement process and interprofessional collaboration.ConclusionsFindings highlight the critical importance of pedagogical content knowledge to engage early learners in systems improvement work, understand their learning interests and needs, and manage their projects longitudinally.

BackgroundFaculty and students debate the fairness and accuracy of medical student clerkship grades. Group decision-making is a potential strategy to improve grading.ObjectiveTo explore how one school's grading committee members integrate assessment data to inform grade decisions and to identify the committees' benefits and challenges.DesignThis qualitative study used semi-structured interviews with grading committee chairs and members conducted between November 2017 and March 2018.ParticipantsParticipants included the eight core clerkship directors, who chaired their grading committees. We randomly selected other committee members to invite, for a maximum of three interviews per clerkship.ApproachInterviews were recorded, transcribed, and analyzed using inductive content analysis.Key resultsWe interviewed 17 committee members. Within and across specialties, committee members had distinct approaches to prioritizing and synthesizing assessment data. Participants expressed concerns about the quality of assessments, necessitating careful scrutiny of language, assessor identity, and other contextual factors. Committee members were concerned about how unconscious bias might impact assessors, but they felt minimally impacted at the committee level. When committee members knew students personally, they felt tension about how to use the information appropriately. Participants described high agreement within their committees; debate was more common when site directors reviewed students' files from other sites prior to meeting. Participants reported multiple committee benefits including faculty development and fulfillment, as well as improved grading consistency, fairness, and transparency. Groupthink and a passive approach to bias emerged as the two main threats to optimal group decision-making.ConclusionsGrading committee members view their practices as advantageous over individual grading, but they feel limited in their ability to address grading fairness and accuracy. Recommendations and support may help committees broaden their scope to address these aspirations.

BackgroundTrust informs supervision decisions in medical training. Factors that influence trust differ depending on learners' and supervisors' level. Research has focused on resident trainees; questions exist about how medical students experience entrustment.ObjectiveThis study examines how clerkship students perceive supervisors' trust in them and its impact on their learning.DesignQualitative study using individual semi-structured interviews.ParticipantsClerkship medical students at the University of California, San Francisco.ApproachWe invited 30 core clerkship students to participate in interviews (October 2017 to February 2018) eliciting examples of appropriate, over-, and under-trust. We coded and analyzed transcripts using thematic analysis.Key resultsSixteen (53%) students participated. Three major themes arose: trust as scaffolding for learning, effects of trust on the learning environment, and consequences of trust for patients. Appropriate trust usually involved coaching and close guidance, often with more junior supervisors (interns or residents). These situations fostered students' motivation to learn, sense of value on the team, and perceived benefits to patients. Over-trust was characterized by task assignment without clear instruction, supervision, or feedback. Over-trust prompted student anxiety and stress, and concerns for potential patient harm. Under-trust was characterized by lack of clarity about the student role, leading to frustration and discontent, with unclear impact on patients. Students attributed inappropriate trust to contextual and supervisor factors and did not feel empowered to intervene due to concerns about performance evaluations and hierarchy.ConclusionsAs early learners in the clinical workplace, students frame trust as entailing high levels of support. It is important for medical educators to consider ways to train resident and faculty supervisors to enact trust and supervision for students differently than for residents. Structures that encourage students and supervisors to discuss trust and supervision in a transparent way can enhance learning.

BackgroundIn varied educational settings, narrative evaluations have revealed systematic and deleterious differences in language describing women and those underrepresented in their fields. In medicine, limited qualitative studies show differences in narrative language by gender and under-represented minority (URM) status.ObjectiveTo identify and enumerate text descriptors in a database of medical student evaluations using natural language processing, and identify differences by gender and URM status in descriptions.DesignAn observational study of core clerkship evaluations of third-year medical students, including data on student gender, URM status, clerkship grade, and specialty.ParticipantsA total of 87,922 clerkship evaluations from core clinical rotations at two medical schools in different geographic areas.Main measuresWe employed natural language processing to identify differences in the text of evaluations for women compared to men and for URM compared to non-URM students.Key resultsWe found that of the ten most common words, such as "energetic" and "dependable," none differed by gender or URM status. Of the 37 words that differed by gender, 62% represented personal attributes, such as "lovely" appearing more frequently in evaluations of women (p

The article emphasizes the significance of equity, diversity, and inclusion (EDI) in peer reviews for Medical Education, stressing the importance of considering EDI for social justice in medical education research. The journal has taken steps to integrate EDI into the peer review process by including a specific field in the reviewer form. Responses from reviewers in 43 countries worldwide varied in their perceptions of EDI in the manuscripts, indicating diverse interpretations of these concepts. The study suggests that authors, reviewers, and editorial teams should actively incorporate EDI principles to enhance inclusivity and accessibility in medical education scholarship. [Extracted from the article]

Competency-based medical education (CBME) focuses on preparing physicians to improve the health of patients and populations. In the context of ongoing health disparities worldwide, medical educators must implement CBME in ways that advance social justice and anti-oppression. In this article, authors describe how CBME can be implemented to promote equity pedagogy, an approach to education in which curricular design, teaching, assessment strategies, and learning environments support learners from diverse groups to be successful. The five core components of CBME programs – outcomes competency framework, progressive sequencing of competencies, learning experiences tailored to learners' needs, teaching focused on competencies, and programmatic assessment – enable individualization of learning experiences and teaching and encourage learners to partner with their teachers in driving their learning. These educational approaches appreciate each learner's background, experiences, and strengths. Using an exemplar case study, the authors illustrate how CBME can afford opportunities to enhance anti-oppression and social justice in medical education and promote each learner's success in meeting the expected outcomes of training. The authors provide recommendations for individuals and institutions implementing CBME to enact equity pedagogy. [ABSTRACT FROM AUTHOR]

IntroductionTo develop lifelong learning skills, students need feedback, access to performance data, and coaching. A new medical curriculum incorporated infrastructural supports based on self-regulated learning theory and the Master Adaptive Learner framework to engage students in reflection and learning planning. This study examines students' experience with a performance dashboard, longitudinal coaching, and structured time for goal-setting.MethodsFocus groups with first-year medical students explored performance dashboard usage, coaching and learning planning. We analyzed findings using thematic analysis. Results informed development of a 29-item survey rated strongly disagree (1) to strongly agree (5) to investigate experience with the dashboard, coaching and learning goals program. The survey was distributed to one first-year medical student class. We performed descriptive statistics and factor analysis.ResultsIn three focus groups with 21 participants, students endorsed using the dashboard to access performance information but had trouble interpreting and integrating information. They valued coaches as sources of advice but varied in their perceptions of the value of discussing learning planning. Of 152 students, 114 (75%) completed the survey. Exploratory factor analysis yielded 5 factors explaining 57% of the variance: learning goals development (α = 0.88; mean 3.25 (standard deviation 0.91)), dashboard usage (α = 0.82; 3.36 (0.64)), coaching (α = 0.71; 3.72 (0.64)), employment of learning strategies (α = 0.81; 3.67 (0.79)), and reflection (α = 0.63; 3.68 (0.64)).DiscussionThe student performance dashboard provides efficient feedback access, yet students' use of this information to guide learning is variable. These results can inform other programs seeking to foster lifelong learning skills.

IntroductionDirect observation of clinical skills is a key assessment strategy in competency-based medical education. The guidelines presented in this paper synthesize the literature on direct observation of clinical skills. The goal is to provide a practical list of Do's, Don'ts and Don't Knows about direct observation for supervisors who teach learners in the clinical setting and for educational leaders who are responsible for clinical training programs.MethodsWe built consensus through an iterative approach in which each author, based on their medical education and research knowledge and expertise, independently developed a list of Do's, Don'ts, and Don't Knows about direct observation of clinical skills. Lists were compiled, discussed and revised. We then sought and compiled evidence to support each guideline and determine the strength of each guideline.ResultsA final set of 33 Do's, Don'ts and Don't Knows is presented along with a summary of evidence for each guideline. Guidelines focus on two groups: individual supervisors and the educational leaders responsible for clinical training programs. Guidelines address recommendations for how to focus direct observation, select an assessment tool, promote high quality assessments, conduct rater training, and create a learning culture conducive to direct observation.ConclusionsHigh frequency, high quality direct observation of clinical skills can be challenging. These guidelines offer important evidence-based Do's and Don'ts that can help improve the frequency and quality of direct observation. Improving direct observation requires focus not just on individual supervisors and their learners, but also on the organizations and cultures in which they work and train. Additional research to address the Don't Knows can help educators realize the full potential of direct observation in competency-based education.

Coaching in medical education facilitates learners' growth and development through feedback, goal-setting and support. This study explored how coaching relationships evolve throughout medical school and the impact of longitudinal coaching relationships on medical students' approach to feedback and goal setting in the clinical years. In this qualitative study using a constructivist paradigm, authors purposively sampled 15 senior medical students at University of California, San Francisco, to participate in individual semi-structured interviews (October–November 2021). The authors used an inductive approach to thematic analysis. The authors identified four themes: First, the student-coach relationship deepened over the course of medical school. Second, students identified factors that sustained and strengthened the student-coach relationship over time: a strong foundation to the relationship, the non-evaluative nature of the relationship, coach supportiveness and responsiveness, and coach knowledge of the institutional landscape. Third, coaches provided individualized advice, assessed trajectory, and guided feedback interpretation. Lastly, students applied skills of soliciting and responding to feedback and creating learning goals, originally learned through coaching experience. Coaching relationships, grounded in trust, evolve to meet students' changing needs as they grow into physicians. Students apply feedback and goal-setting skills learned with the coach in clinical settings with other supervisors. [ABSTRACT FROM AUTHOR]

BackgroundThe new UCSF Bridges Curriculum aims to prepare students to succeed in today's health care system while simultaneously improving it. Curriculum redesign requires assessment strategies that ensure that graduates achieve competence in enduring and emerging skills for clinical practice.AimTo design entrustable professional activities (EPAs) for assessment in a new curriculum and gather evidence of content validity.SettingUniversity of California, San Francisco, School of Medicine.ParticipantsNineteen medical educators participated; 14 completed both rounds of a Delphi survey.Program descriptionAuthors describe 5 steps for defining EPAs that encompass a curricular vision including refining the vision, defining draft EPAs, developing EPAs and assessment strategies, defining competencies and milestones, and mapping milestones to EPAs. A Q-sort activity and Delphi survey involving local medical educators created consensus and prioritization for milestones for each EPA.Program evaluationFor 4 EPAs, most milestones had content validity indices (CVIs) of at least 78 %. For 2 EPAs, 2 to 4 milestones did not achieve CVIs of 78 %.DiscussionWe demonstrate a stepwise procedure for developing EPAs that capture essential physician work activities defined by a curricular vision. Structured procedures for soliciting faculty feedback and mapping milestones to EPAs provide content validity.

The role of undergraduate medical education in creating, perpetuating, and potentially solving the physician shortage in adult primary care has been debated for years, but often the discussions revolve around overly simplistic notions of supply and demand. The supply is curtailed, it is said, because the work is hard and the pay is low relative to other career options. Missing is a recognition that medical schools make choices in developing primary care learning environments that profoundly affect student perceptions of this career. Emerging developments in healthcare, including the transformation of academic health centers into integrated health systems that enter into risk-based contracts, may provide an opportunity to re-direct discussions about primary care. More schools may begin to recognize that they can control the quality of primary care teaching environments, and that doing so will help them achieve excellence in education and compete in the new marketplace. The selling of primary care to medical schools may be the first step in primary care selling itself to medical students.

Introduction: Identity threats, such as stereotype threat and microaggressions, impair learning and erode well‐being. In contrast to identity threat, less is known about how learners experience feelings of safety regarding their identity. This exploratory study aims to develop a theory of identity safety in the clinical learning environment. Methods: This multi‐institutional, qualitative interview study was informed by constructivist grounded theory and critical pedagogy. Participants were clinical students at three public medical schools in the United States in 2022. Investigators purposively sampled participants for interviews based on their responses to an 11‐item survey with an open‐ended question soliciting students' personal identities and responses to both the racial/ethnic and gender Stereotype Vulnerability Scales. The investigators interviewed, coded, constantly compared and continued sampling until the codes could be developed into categories, then concepts and finally into a theory. The team engaged in critical reflexivity throughout the analytic process to enrich data interpretations. Results: Sixteen diverse students were interviewed. We organised their identity‐salient experiences into identity threat, threat mitigation and identity safety. Participants experienced identity threat through unwelcoming learning environments, feeling compelled to change their behaviour in inauthentic ways or sociopolitical threat. Threat mitigation occurred when a participant or supervisor intervened against an identity threat, dampening but not eliminating the threat impact. Participants characterised identity safety as the ability to exist as their authentic selves without feeling the need to monitor how others perceive their identities. Identity safety manifested when participants demonstrated agency to leverage their identities for patient care, when others upheld their personhood and saw them as unique individuals and when they felt they belonged in the learning environment. Discussion Attending to identity safety may lead to educational practices that sustain and leverage team members' diverse identities. Identity safety and threat mitigation may work together to combat identity threats in the learning environment. In this edition of @medEd_journal, @jbullockruns et al. describe identity safety, where learning environments allow learners to exist as their authentic selves. The figure is worth 1000 words. [ABSTRACT FROM AUTHOR]

BackgroundGraduate medical education programs assess trainees' performance to determine readiness for unsupervised practice. Entrustable professional activities (EPAs) are a novel approach for assessing performance of core professional tasks.AimTo describe a pilot and feasibility evaluation of two EPAs for competency-based assessment in internal medicine (IM) residency.Setting/participantsPost-graduate year-1 interns (PGY-1s) and attendings at a large internal medicine (IM) residency program.Program descriptionTwo Entrustable professional activities (EPA) assessments (Discharge, Family Meeting) were piloted.Program feasibility evaluationTwenty-eight out of 43 (65.1 %) PGY-1 s and 32/43 (74.4 %) attendings completed surveys about the Discharge EPA experience. Most who completed the EPA assessment (10/12, 83.8 %, PGY-1s; 9/11, 83.3 %, attendings) agreed it facilitated useful feedback discussions. For the Family Meeting EPA, 16/26 (61.5 %) PGY-1s completed surveys, and most who participated (9/12 PGY1s, 75 %) reported it improved attention to family meeting education, although only half recommended continuing the EPA assessment.DiscussionFrom piloting two EPA assessments in a large IM residency, we recognized our reminder systems and time dedicated for completing EPA requirements as inadequate. Collaboration around patient safety and palliative care with relevant clinical services has enhanced implementation and buy-in. We will evaluate how well EPA-based assessment serves the intended purpose of capturing trainees' trustworthiness to conduct activities unsupervised.

BackgroundEntrustable professional activities (EPAs) can form the foundation of competency-based assessment in medical training, focused on performance of discipline-specific core clinical activities.ObjectiveTo identify EPAs for the Internal Medicine (IM) Educational Milestones to operationalize competency-based assessment of residents using EPAs.MethodsWe used a modified Delphi approach to conduct a 2-step cross-sectional survey of IM educators at a 3-hospital IM residency program; residents also completed a survey. Participants rated the importance and appropriate year of training to reach competence for 30 proposed IM EPAs. Content validity indices identified essential EPAs. We conducted independent sample t tests to determine IM educator-resident agreement and calculated effect sizes. Finally, we determined the effect of different physician roles on ratings.ResultsThirty-six IM educators participated; 22 completed both surveys. Twelve residents participated. Seventeen EPAs had a content validity index of 100%; 10 additional EPAs exceeded 80%. Educators and residents rated the importance of 27 of 30 EPAs similarly. Residents felt that 10 EPAs could be met at least 1 year earlier than educators had specified.ConclusionsInternal medicine educators had a stable opinion of EPAs developed through this study, and residents generally agreed. Using this approach, programs could identify EPAs for resident evaluation, building on the initial list created via our study.

PurposeUnhealthy behaviors contribute to half of U.S. deaths. However, physicians lack sufficient skill in counseling patients to change behaviors. Characterizing effective published curricular interventions for behavior change counseling for medical trainees would inform educators toward improved training.MethodThe authors conducted a systematic literature search of studies published between 1965 and 2011 evaluating curricula on behavior change counseling for medical trainees. Included studies described behavior change counseling, teaching interventions for medical trainees, and assessment of interventions. The authors extracted eligible articles, rated outcomes for learners and patients using Kirkpatrick's hierarchy, and determined study quality.ResultsOf 2,788 identified citations, 109 met inclusion criteria. Most studies were performed in the United States (98), 93 at a single institution, and 81 in primary care settings. Curricular topics for counseling included smoking (67 studies), nutrition (30), alcohol/drug use (26), and exercise (22). Although most studies did not include theoretical frameworks, 39 used the Transtheoretical Model of Change. Sixty-two studies involved eight or fewer hours of curricular time, and 51 spanned four or fewer weeks. The studies with highest-level outcomes and quality employed multiple curricular techniques and included practice of counseling techniques in either simulated or actual clinical settings.ConclusionsExisting literature suggests that trainees learn behavior change counseling through active, realistic practice and implementation of reminder and feedback systems within actual clinical practice settings. Multiinstitutional medical education research on methods of teaching behavior change counseling that influence patients' health outcomes are needed to ensure trainees' clinical competence and improve patient care.

BackgroundCompetence in quality improvement (QI) is a priority for medical students. We describe a self-directed QI skills curriculum for medical students in a 1-year longitudinal integrated third-year clerkship: an ideal context to learn and practice QI.MethodsTwo groups of four students identified a quality gap, described existing efforts to address the gap, made quantifying measures, and proposed a QI intervention. The program was assessed with knowledge and attitude surveys and a validated tool for rating trainee QI proposals. Reaction to the curriculum was assessed by survey and focus group.ResultsKnowledge of QI concepts did not improve (mean knowledge score±SD): pre: 5.9±1.5 vs. post: 6.6±1.3, p=0.20. There were significant improvements in attitudes (mean topic attitude score±SD) toward the value of QI (pre: 9.9±1.8 vs. post: 12.6±1.9, p=0.03) and confidence in QI skills (pre: 13.4±2.8 vs. post: 16.1±3.0, p=0.05). Proposals lacked sufficient analysis of interventions and evaluation plans. Reaction was mixed, including appreciation for the experience and frustration with finding appropriate mentorship.ConclusionClinical-year students were able to conduct a self-directed QI project. Lack of improvement in QI knowledge suggests that self-directed learning in this domain may be insufficient without targeted didactics. Higher order skills such as developing measurement plans would benefit from explicit instruction and mentorship. Lessons from this experience will allow educators to better target QI curricula to medical students in the clinical years.