Search

William C McGaghie, Jeffrey H Barsuk, Diane B Wayne Department of Medical Education, Northwestern University Feinberg School of Medicine, Chicago, IL, USAWe read the analytical review by Drs. Siddaiah-Subramanya, Smith, and Lonie titled, “Mastery learning: how is it helpful?” that appeared recently in Advances in Medical Education and Practice, with great interest.1 We commend the authors for bringing the mastery learning model to the attention of the journal’s readers. However, we note some missing information and wish to amplify the rationale and contributions of mastery learning in medical education by adding four additional points:1. The basic principle of mastery learning is “excellence for all.” This means that all medical learners can reach all learning goals to very high achievement standards with little or no variation in measured learning outcomes.22. The traditional apprenticeship model of clinical medical education is becoming obsolete in light of contemporary approaches to curriculum development and advancements in educational technology, especially medical simulation. As Ericsson has pointed out, “the well-known saying, see one, do one, teach one … implies virtually instantaneous mastery of new procedures among medically trained individuals; however, objective performance measures have invalidated this conventional wisdom.”33. Mastery learning programs in medicine are grounded in carefully designed and managed curricula that engage learners and teachers in active, effortful educational activities, assessments, actionable feedback, and steps toward constant improvement.4 Mastery learning is not a passive enterprise for learners or teachers. This is also the basis for the translational outcomes described below.4. Rigorous medical education mastery learning programs can not only yield shortrun learning outcomes measured as skill and knowledge acquisition in educational settings, but also “downstream” translational results expressed as better patient care practices, improved patient outcomes, and lower health care costs.5 Translational medical education outcomes derive from mastery learning and research programs that are thematic, sustained, and cumulative. View the original article

Purpose: Practicing endoscopists frequently perform and teach screening colonoscopies and polypectomies, but there is no standardized method to train and assess physicians who perform polypectomy procedures. The authors created a polypectomy simulation-based mastery learning (SBML) curriculum and hypothesized that completion of the curriculum would lead to immediate improvement in polypectomy skills and skill retention at 6 and 12 months after training., Method: The authors performed a pretest-posttest cohort study with endoscopists who completed SBML and were randomized to follow-up at 6 or 12 months from May 2021 to August 2022. Participants underwent SBML training, including a pretest, a video lecture, deliberate practice, and a posttest. All learners were required to meet or exceed a minimum passing standard on a 17-item skills checklist before completing training and were randomized to follow-up at 6 or 12 months. The authors compared simulated polypectomy skills performance on the checklist from pretest to posttest and posttest to 6- or 12-month follow-up test., Results: Twenty-four of 30 eligible participants (80.0%) completed the SBML intervention, and 20 of 24 (83.3%) completed follow-up testing. The minimum passing standard was set at 93% of checklist items correct. The pretest passing rate was 4 of 24 participants (16.7%) compared with 24 of 24 participants (100%) at posttest ( P < .001). There were no significant differences in passing rates from posttest to combined 6- and 12-month posttest in which 18 of 20 participants (90.0%) passed., Conclusions: Before training and despite years of clinical experience, practicing endoscopists demonstrated poor performance of polypectomy skills. SBML was an effective method for practicing endoscopists to acquire and maintain polypectomy skills during a 6- to 12-month period., (Copyright © 2023 the Association of American Medical Colleges.)

Introduction: Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness., Methods: This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations., Results: PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment., Conclusions: The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care.

Problem: Ultrasound-guided peripheral intravenous catheter (USGPIV) insertion is an effective method to gain vascular access in patients with difficult intravenous access (DIVA). While USGPIV success rates are reported to be high, some studies have reported a concerning incidence of USGPIV premature failures., Aims: The purpose of this study was to compare differences in USGPIV and landmark peripheral intravenous catheter (PIV) utilization and failure following a hospital-wide USGPIV training program for nurses., Methods: The authors performed a retrospective, electronic medical record review of all USGPIVs and PIVs inserted at a tertiary, urban, academic medical center from September 1, 2018, through September 30, 2019. The primary outcome was differences between USGPIV and PIV time to failure., Results: A total of 43,470 short peripheral intravenous catheters (PIVCs) were inserted in 23,713 patients. Of these, 7972 (16.8%) were USGPIV. At 30 days of follow-up, for PIVCs with an indication for removal documented, USGPIVs had higher Kaplan-Meier survival probabilities than PIVs ( p  < 0.001)., Conclusions: The use of simulation-based mastery associated with USGPIVs, demonstrated lower failure rates than standard PIVs after 2 days and USGPIVs exhibited improved survival rates in patients with DIVA. These findings suggest that rigorous simulation-based insertion training demonstrates improved USGPIV survival when compared to traditional PIVCs. SBML is an extremely useful tool to ensure appropriately trained clinicians acquire the necessary knowledge and skillset to improve USGPIV outcomes., Competing Interests: Declaration of conflicting interestsThe author(s) declared the following potential conflicts of interest with respect to the research, authorship, and/or publication of this article: The authors have no relevant financial disclosures to declare. The ultrasound machines were provided to the facility by FUJIFILM-Sonosite. The simulators were donated to the facility by Simulab Corporation.

Background: It is unknown whether traditional medical education ensures competence among fellows in the key skill of breaking bad news (BBN). While simulation-based mastery learning (SBML) has been used to train fourth-year medical students (M4s) in BBN, it is unclear if it adds similar value for fellows., Objective: We examined the effect of traditional medical training on BBN skills by comparing baseline fellow and M4 skills and confidence and assessed the impact of a BBN SBML curriculum for fellows., Methods: Fellows training in six programs at Northwestern University from November 2018 to May 2019 were eligible for inclusion. Fellows completed a BBN SBML curriculum including a pretest, individualized feedback using a previously published assessment tool, and ongoing deliberate practice until all achieved a minimum passing standard (MPS). The primary outcomes were checklist and scaled item scores on the assessment tool. Fellow performance was compared to a historical M4 cohort., Results: Twenty-eight of 38 eligible fellows completed the curriculum and were included for analysis. Fellows reported significantly more experience and confidence in BBN compared to M4s, yet their pre-training performance was significantly worse on checklist (57.1% vs 65.0%, P = .02) and scaled items; only 4% reached the MPS. After training, fellow performance significantly improved on checklist (57.1% to 92.6%, SD = 5.2%, P < .001) and scaled items; all reached the MPS., Conclusions: Despite higher confidence and BBN clinical experience, fellows performed worse than untrained M4s, confirming that experience is not a proxy for skill. Programs must develop competency-based assessments to ensure entrustment of communication skills.

Background: Advanced practice providers (APPs) are essential members of intensive care unit (ICU) interprofessional teams and are expected to be competent in performing procedures. There are no published criteria for establishing when APPs can independently perform procedures. Simulation-based mastery learning (SBML) is an effective strategy for improving critical care skills but has not been applied to practicing ICU APPs., Objective: The purpose of this study was to evaluate if an SBML curriculum could improve the critical care skills and procedural self-confidence of ICU APPs., Methods: We performed a pretest-posttest study of central venous catheter (CVC) insertion, thoracentesis, and mechanical ventilation (MV) management skills among ICU APPs who participated in an SBML course at an academic hospital. For each skill, APPs underwent baseline skills assessments (pretests) on a simulator using previously published checklists, followed by didactic sessions and deliberate practice with individualized feedback. Within 2 weeks, participants were required to meet or exceed previously established minimum passing standards (MPS) on simulated skills assessments (posttests) using the same checklists. Further deliberate practice was provided for those unable to meet the MPS until they retested and met this standard. We compared pretest to posttest skills checklist scores and procedural confidence., Results: All 12 eligible ICU APPs participated in internal jugular CVC, subclavian CVC, and MV training. Five APPs participated in thoracentesis training. At baseline, no APPs met the MPS on all skills. At training completion, all APPs achieved the mastery standard. Internal jugular CVC pretest performance improved from a mean of 67.2% (standard deviation [SD], 28.8%) items correct to 97.1% (SD, 3.8%) at posttest ( P  = 0.005). Subclavian CVC pretest performance improved from 29.2% (SD, 32.7%) items correct to 93.1% (SD 3.9%) at posttest ( P  < 0.001). Thoracentesis pretest skill improved from 63.9% (SD, 30.6%) items correct to 99.2% (SD, 1.7%) at posttest ( P  = 0.054). Pretest MV skills improved from 54.8% (SD, 19.7%) items correct to 92.3% (SD, 5.0%) at posttest ( P  < 0.001). APP procedural confidence improved for each skill from pre to posttest., Conclusion: SBML is effective for training APPs to perform ICU skills. Relying on traditional educational methods does not reliably ensure that APPs are adequately prepared to perform skills such as CVC insertion, thoracentesis, and MV management., (Copyright © 2023 by the American Thoracic Society.)

Background/objectives: To develop and evaluate a post-acute care simulation-based mastery learning (SBML) continuing medical education (CME)/maintenance of certification (MOC) procedure course., Design: Pretest-posttest study of the SBML intervention., Setting: A 2-day post-acute care procedures course., Participants: Sixteen practicing clinicians (5 physicians,11 advanced practice providers). Participants engaged in a skills pretest on knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing using a checklist created for each procedure. Participants received a didactic on each procedure followed by deliberate practice with feedback. Using the same checklists, participants completed a skills posttest and were required to meet a minimum passing standard (MPS) to obtain CME/MOC credit., Measurements: The MPS for each skills checklist was determined by a multidisciplinary panel of 11 experts. Participants completed surveys on procedure self-confidence and a course evaluation., Results: There was statistically significant improvement between pre- and posttests for all four procedures ( p < .001). All participants were able to meet or exceed the MPS for each skill during the 2-day course. Participants' self-confidence regarding each procedure improved significantly ( p < .001)., Conclusion: An SBML training course granting CME/MOC credit for post-acute care providers significantly improves performance of knee aspiration/injection, gastrostomy tube removal/replacement, tracheostomy tube exchange, and basic suturing.

Background: Ventricular assist device simulation-based mastery learning (SBML) results in better patient and caregiver self-care skills compared with usual training., Objective: The aim of this study was to evaluate the effect of SBML on driveline exit site infections., Methods: We compared the probability of remaining infection free at 3 and 12 months between patients randomized to SBML or usual training., Results: The SBML-training group had no infections at 3 months and 2 infections at 12 months, yielding a Kaplan-Meier estimate of the probability of remaining infection free of 0.857 (95% confidence interval [CI], 0.692-1.00) at 12 months. The usual-training group had 6 infections at 3 months with no additional infections by 12 months. Kaplan-Meier estimates of remaining infection free at 3 and 12 months were 0.878 (95% CI, 0.758-1.00) and 0.748 (95% CI, 0.591-0.946), respectively. Time-to-infection distributions for SBML versus usual training showed a difference in 12-month infection rates of 0.109 (P = .07)., Conclusions: Ventricular assist device self-care SBML resulted in fewer 12-month infections., Competing Interests: Dr Wilcox receives consulting honoraria from Boehringer Ingelheim and Medtronic and serves on the scientific advisory board for Cytokinetics. The other authors have no relevant conflicts of interest to report., (Copyright © 2021 Wolters Kluwer Health, Inc. All rights reserved.)

Objectives: Difficult intravenous (IV) access (DIVA) is a prevalent condition in the hospital setting and increases utilization of midline catheters (MCs) and peripherally inserted central catheters (PICCs). Ultrasound-guided peripheral intravenous (USGPIV) insertion is effective at establishing intravenous access in DIVA but remains understudied in the inpatient setting. We evaluated the effect of an USGPIV simulation-based mastery learning (SBML) curriculum for nurses on MC and PICC utilization for hospitalized patients., Methods: We performed a quasi-experimental observational study. We trained nurses across all inpatient units at a large tertiary care hospital. We queried the electronic medical record to compare PICC and MC utilization for patients with DIVA during 3 periods: before USGPIV SBML training (control), during pilot testing of the intervention, and during the SBML intervention. To account for variations in insertion practices over time, we performed an interrupted time series (ITS) analysis between 2 periods, the combined control and pilot periods and the intervention period., Results: One hundred forty-eight nurses completed USGPIV SBML training. Midline catheters inserted monthly per 1000 patient-days for DIVA decreased significantly from 1.86 ± 0.51 (control) to 2.31 ± 0.28 (pilot) to 1.33 ± 0.51 (intervention; P = 0.001). The ITS analysis indicated a significant intervention effect (P < 0.001). Peripherally inserted central catheters inserted monthly per 1000 patient-days for DIVA also significantly decreased over the study periods; however, the ITS failed to show an intervention effect as PICC insertions were already decreasing during the control period., Conclusions: A hospital-wide USGPIV SBML curriculum for inpatient nurses was associated with a significant reduction in MCs inserted for DIVA., Competing Interests: The authors disclose no conflict of interest., (Copyright © 2021 Wolters Kluwer Health, Inc. All rights reserved.)

Background: Longitudinal clerkships provide students with meaningful clinical care roles that promote learning and professional development. It remains unclear how longitudinal primary care clerkships inform students' perceptions of primary care., Objective: To explore perceptions of primary care among medical students enrolled in longitudinal primary care clerkships., Design: Qualitative, semi-structured interviews with medical students over 4 years., Participants: Thirty-eight medical students participated at baseline; 35 participated in a 2-year follow-up interview; 24 participated at 4 years. Each student was enrolled in one of two longitudinal primary care clerkships: a team-based Education-Centered Medical Home (ECMH) or a one-on-one individual preceptorship (IP)., Approach: De-identified interview transcripts were analyzed using a process of open and axial coding, followed by elaborative coding for longitudinal analysis. Codes were compiled into a set of themes and compared across time periods and between clerkships., Key Results: Students reported that primary care serves as a first point of contact, emphasizing longitudinal care with a wide scope of practice and approaching patient care with a biopsychosocial perspective. Student perceptions of primary care greatly expanded over the course of 4 years: for instance, initial perceptions of primary care physicians evolved from "passive gatekeeper" to a more nuanced "quarterback." Students in ECMH, whose clerkship provided more opportunity for patient continuity, further reflected on the relationships they themselves developed with patients., Conclusions: Regardless of their eventual specialty choice, longitudinal experiences may aid all students in fostering a sense of the broad scope and importance of primary care. However, without numerous opportunities to witness continuity of care, students may perceive primary care as having limited scope and importance. Longitudinal clerkships, emphasizing continuity with patients and preceptors, may foster in students a broad and nuanced perspective of the scope of primary care as a field., (© 2021. Society of General Internal Medicine.)

Mastery learning is a form of competency-based education in which learning time varies but outcomes are uniform. Trainees must meet a minimum passing standard (MPS) before completing a mastery learning curriculum. The objective of this study was to establish a curriculum for fall risk and gait assessment for medical students, determine an MPS for a fall risk and gait assessment clinical skills examination (CSE), and apply the MPS to a sample of medical students completing a fall risk and gait assessment CSE. Medical students completed an interactive session about fall risk and gait assessment including the Timed Up and Go (TUG) test and completed deliberate practice with 3 patients. Skills were evaluated using an 18-item skills checklist. A panel of clinical experts set the MPS at 82%. Eighty-seven medical students participated. The average score on the checklist was 14.7 of 18 (81.4%.) Although almost all performed the TUG correctly, only 61% met the MPS for the checklist. Our results suggest that a mastery learning approach may better prepare the 39% of students that did not meet MPS to complete a fall risk and gait assessment.

Introduction: Resident physicians are expected to acquire competence at central venous catheter (CVC) insertion to a mastery standard. Valid competence decisions about resident physicians' CVC performance rely on reliable data and rigorous achievement standards. This study used data from 3 CVC simulation-based mastery learning studies involving internal medicine (IM) and emergency medicine (EM) residents to address 2 questions: What is the effectiveness of a CVC mastery learning education intervention? Are minimum passing standards (MPSs) set by faculty supported by item response theory (IRT) analyses?, Methods: Pretraining and posttraining skills checklist data were drawn from 3 simulation-based mastery learning research reports about CVC internal jugular (IJ) and subclavian (SC) insertion skill acquisition. Residents were required to meet or exceed a posttest skills MPS. Generalized linear mixed effect models compared checklist performance from pre to postintervention. Minimum passing standards were determined by Angoff and Hofstee standard setting methods. Item response theory models were used for cut-score evaluation., Results: Internal medicine and EM residents improved significantly on every IJ and SC checklist item after mastery learning. Item response theory analyses support the IJ and SC MPSs., Conclusions: Mastery learning is an effective education intervention to achieve clinical skill acquisition among IM and EM residents. Item response theory analyses reveal desirable measurement properties for the MPSs previously set by expert faculty panels. Item response theory analysis is useful for evaluating standards for mastery learning interventions. The CVC mastery learning curriculum, reliable outcome data, and high achievement standards together contribute to reaching valid decisions about the competence of resident physicians to perform the clinical procedure., Competing Interests: The authors declare no conflict of interest., (Copyright © 2020 Society for Simulation in Healthcare.)

Objectives: The aims of the study were to identify perceived barriers and facilitators to central venous catheter (CVC) insertion among healthcare providers and to understand the extent to which an existing Simulation-Based Mastery Learning (SBML) program may address barriers and leverage facilitators., Methods: Providers participating in a CVC insertion SBML train-the-trainer program, in addition to intensive care unit nurse managers, were purposively sampled from Veterans Administration Medical Centers located in geographically diverse areas. We conducted semistructured interviews to assess perceptions of barriers and facilitators to CVC insertion. Deidentified transcripts were analyzed using a grounded theory approach and the constant comparative method. We subsequently mapped identified barriers and facilitators to our SBML curriculum to determine whether or not the curriculum addresses these factors., Results: We interviewed 28 providers at six Veterans Administration Medical Centers, identifying the following five overarching factors of perceived barriers to CVC insertion: (1) equipment, (2) personnel/staff, (3) setting or organizational context, (4) patient or provider, and (5) time-related barriers. Three overarching factors of facilitators emerged: (1) equipment, (2) personnel, and (3) setting or organizational context facilitators. The SBML curriculum seems to address most identified barriers, while leveraging many facilitators; building on the commonly identified facilitator of nursing staff contribution by expanding the curriculum to explicitly include nurse involvement could improve team efficiency and organizational culture of safety., Conclusions: Many identified facilitators (e.g., ability to use ultrasound, personnel confidence/competence) were also identified as barriers. Evidence-based SBML programs have the potential to amplify these facilitators while addressing the barriers by providing an opportunity to practice and master CVC insertion skills., Competing Interests: J.H.B. and D.B.W. received consulting fees from MERCI. J.H.B., D.B.W. and E.R.C. received royalties for the central venous catheter insertion simulation-based mastery learning curriculum from Northwestern University. The remaining authors disclose no conflict of interest., (Copyright © 2018 Wolters Kluwer Health, Inc. All rights reserved.)

Background and study aims  Practicing endoscopists have variable polypectomy skills during colonoscopy and limited training opportunities for improvement. Simulation-based training enhances procedural skill, but its impact on polypectomy is unclear. We developed a simulation-based polypectomy intervention to improve polypectomy competency. Methods  All faculty endoscopists at our tertiary care center who perform colonoscopy with polypectomy were recruited for a simulation-based intervention assessing sessile and stalked polypectomy. Endoscopists removed five polyps in a simulation environment at pretest followed by a training intervention including a video, practice, and one-on-one feedback. Within 1-4 weeks, endoscopists removed five new simulated polyps at post-test. We used the Direct Observation of Polypectomy Skills (DOPyS) checklist for assessment, evaluating individual polypectomy skills, and global competency (scale: 1-4). Competency was defined as an average global competency score of ≥ 3. Results  83 % (29/35) of eligible endoscopists participated and 95 % (276/290) of planned polypectomies were completed. Only 17 % (5/29) of endoscopists had average global competency scores that were competent at pretest compared with 52 % (15/29) at post-test ( P  = 0.01). Of all completed polypectomies, the competent polypectomy rate significantly improved from pretest to post-test (55 % vs. 71 %; P  < 0.01). This improvement was significant for sessile polypectomy (37 % vs. 65 %; P  < 0.01) but not for stalked polypectomy (82 % vs. 80 %; P  = 0.70). Conclusions  Simulation-based training improved polypectomy skills among practicing endoscopists. Further studies are needed to assess the translation of simulation-based education to clinical practice., Competing Interests: Competing interests Dr. Wani is a consultant for Medtronic, Boston Scientific, Interpace, and Cernostics. He is supported by the University of Colorado Department of Medicine Outstanding Early Scholars Program. The remaining authors declare that they have no conflict of interest., (The Author(s). This is an open access article published by Thieme under the terms of the Creative Commons Attribution-NonDerivative-NonCommercial License, permitting copying and reproduction so long as the original work is given appropriate credit. Contents may not be used for commercial purposes, or adapted, remixed, transformed or built upon. (https://creativecommons.org/licenses/by-nc-nd/4.0/).)

Background: We developed a simulation-based mastery learning (SBML) curriculum that boosted self-care skills for patients with a ventricular assist device (VAD). In this study, we evaluated short-term skills retention., Methods: We assessed skill retention among patients and caregivers who participated in VAD self-care SBML at a tertiary care center. We compared discharge skills tests (immediately after completing SBML) to 1- and 3-month follow-up tests to assess skill retention., Results: Fifteen patients and 15 caregivers completed discharge and follow-up testing. Skills were largely retained at 1- and 3-months., Conclusions: SBML results in short-term retention of VAD self-care skills., Competing Interests: Conflict of Interest Disclosures: The authors have no relevant financial disclosures to report.

Background: The American Board of Psychiatry and Neurology and the Accreditation Council for Graduate Medical Education (ACGME) developed Milestones that provide a framework for residents' assessment. However, Milestones do not provide a description for how programs should perform assessments., Objectives: We evaluated graduating residents' status epilepticus (SE) identification and management skills and how they correlate with ACGME Milestones reported for epilepsy and management/treatment by their program's clinical competency committee (CCC)., Methods: We performed a cohort study of graduating neurology residents from 3 academic medical centers in Chicago in 2018. We evaluated residents' skills identifying and managing SE using a simulation-based assessment (26-item checklist). Simulation-based assessment scores were compared to experience (number of SE cases each resident reported identifying and managing during residency), self-confidence in identifying and managing these cases, and their end of residency Milestones assigned by a CCC based on end-of-rotation evaluations., Results: Sixteen of 21 (76%) eligible residents participated in the study. Average SE checklist score was 15.6 of 26 checklist items correct (60%, SD 12.2%). There were no significant correlations between resident checklist performance and experience or self-confidence. The average participant's level of Milestone for epilepsy and management/treatment was high at 4.3 of 5 (SD 0.4) and 4.4 of 5 (SD 0.4), respectively. There were no significant associations between checklist skills performance and level of Milestone assigned., Conclusions: Simulated SE skills performance of graduating neurology residents was poor. Our study suggests that end-of-rotation evaluations alone are inadequate for assigning Milestones for high-stakes clinical skills such as identification and management of SE., Competing Interests: Conflict of interest: The authors declare they have no competing interests.

Background: Medical procedures are traditionally taught informally at patients' bedside through observation and practice using the adage "see one, do one, teach one." This lack of formalized training can cause trainees to be unprepared to perform procedures independently. Simulation based education (SBE) increases competence, reduces complications, and decreases costs. We developed, implemented, and evaluated the efficacy of a right heart catheterization (RHC) SBE curriculum., Methods: The RHC curriculum consisted of a pretest, video didactics, deliberate practice, and a posttest. Pre-and posttest skills examinations consisted of a dichotomous 43-item checklist on RHC skills and a 14-item hemodynamic waveform quiz. We enrolled two groups of fellows: 6 first-year, novice cardiology fellows at Northwestern University in their first month of training, and 11 second- and third-year fellows who had completed traditional required, level I training in RHC. We trained the first-year fellows at the beginning of the 2018-2019 year using the SBE curriculum and compared them to the traditionally-trained cardiology fellows who did not complete SBE., Results: The SBE-trained fellows significantly improved RHC skills, hemodynamic knowledge, and confidence from pre- to posttesting. SBE-trained fellows performed similarly to traditionally-trained fellows on simulated RHC skills checklists (88.4% correct vs. 89.2%, p = .84), hemodynamic quizzes (94.0% correct vs. 86.4%, p = .12), and confidence (79.4 vs. 85.9 out of 100, p = .15) despite less clinical experience., Conclusions: A SBE curriculum for RHC allowed novice cardiology fellows to achieve level I skills and knowledge at the beginning of fellowship and can train cardiology fellows before patient contact., (© 2020 Wiley Periodicals LLC.)

Background: Caring for patients requiring mechanical ventilation is complex, and residents may lack adequate skill for managing these patients. Simulation-based mastery learning (SBML) is an educational model that trains clinicians to a high standard and can reduce complications. The mastery learning model has not been applied to ventilator management. Objective: The purpose of this study was to determine whether SBML, as compared with traditional training, is an effective strategy for teaching residents the skills necessary to manage patients requiring mechanical ventilation. Methods: We developed an SBML curriculum and a 47-item skills checklist to test ventilator management for patients with normal, restricted, and obstructed lung physiology. A minimum passing standard (MPS) on the checklist was set using the Mastery Angoff method. Residents rotating through the medical intensive care unit in Academic Year 2017-2018 were assigned to SBML or traditional training based on their medical intensive care unit team. The SBML group was pretested on a ventilator simulator using the skills checklist. They then received a 1.5-hour session (45 min didactic and 45 min deliberate practice on the simulator with feedback). At rotation completion, they were posttested on the simulator using the checklist until the MPS was met. Both SBML-trained and traditionally trained groups received teaching during daily bedside rounds and twice weekly didactic lectures. At rotation completion, traditionally trained residents were tested using the same skills checklist on the simulator. We compared pretest and posttest performance among SBML-trained residents and end of the rotation test performances between the SBML-trained and traditionally trained residents. Results: The MPS was set at 87% on the checklist. Fifty-seven residents were assigned to the SBML-trained group and 49 were assigned to the traditionally trained group. Mean checklist scores for SBML-trained residents improved from 51.4% (standard deviation [SD] = 17.5%) at pretest to 86.1% (SD = 7.6%) at initial posttest and 92.5% (SD = 3.7%) at final (mastery) posttest (both P  < 0.001). Forty-two percent of residents required more than one attempt at the posttest to meet or exceed the MPS. At rotation completion, the traditionally trained residents had a mean test score of 60.9% (SD = 13.3%). Conclusion: SBML is an effective strategy to train residents on mechanical ventilator management. An SBML curriculum may augment traditional training methods to further equip residents to safely manage ventilated patients., (Copyright © 2021 by the American Thoracic Society.)

Background: The US Medical Licensing Examination (USMLE) Step 1 and Step 2 scores are often used to inform a variety of secondary medical career decisions, such as residency selection, despite the lack of validity evidence supporting their use in these contexts., Objective: We compared USMLE scores between non-chief residents (non-CRs) and chief residents (CRs), selected based on performance during training, at a US academic medical center that sponsors a variety of graduate medical education programs., Methods: This was a retrospective cohort study of residents' USMLE Step 1 and Step 2 Clinical Knowledge (CK) scores from 2015 to 2020. The authors used archived data to compare USMLE Step 1 and Step 2 CK scores between non-CR residents in each of the eligible programs and their CRs during the 6-year study period., Results: Thirteen programs enrolled a total of 1334 non-CRs and 211 CRs over the study period. There were no significant differences overall between non-CRs and CRs average USMLE Step 1 (239.81 ± 14.35 versus 240.86 ± 14.31; P = .32) or Step 2 scores (251.06 ± 13.80 versus 252.51 ± 14.21; P = .16)., Conclusions: There was no link between USMLE Step 1 and Step 2 CK scores and CR selection across multiple clinical specialties over a 6-year period. Reliance on USMLE Step 1 and 2 scores to predict success in residency as measured by CR selection is not recommended., Competing Interests: Conflict of interest: The authors declare they have no competing interests., (Accreditation Council for Graduate Medical Education 2020.)

Purpose: It is challenging to add rigorous, competency-based communication skills training to existing clerkship structures. The authors embedded a simulation-based mastery learning (SBML) curriculum into a medicine subinternship to demonstrate feasibility and determine the impact on the foundational skill of breaking bad news (BBN)., Method: All fourth-year students enrolled in a medicine subinternship at Northwestern University Feinberg School of Medicine from September 2017 through August 2018 were expected to complete a BBN SBML curriculum. First, students completed a pretest with a standardized patient using a previously developed BBN assessment tool. Learners then participated in a 4-hour BBN skills workshop with didactic instruction, focused feedback, and deliberate practice with simulated patients. Students were required to meet or exceed a predetermined minimum passing standard (MPS) at posttest. The authors compared pretest and posttest scores to evaluate the effect of the intervention. Participant demographic characteristics and course evaluations were also collected., Results: Eighty-five students were eligible for the study, and 79 (93%) completed all components. Although 55/79 (70%) reported having personally delivered serious news to actual patients, baseline performance was poor. Students' overall checklist performance significantly improved from a mean of 65.0% (SD = 16.2%) items correct to 94.2% (SD = 5.9%; P < .001) correct. There was also statistically significant improvement in scaled items assessing quality of communication, and all students achieved the MPS at mastery posttest. All students stated they would recommend the workshop to colleagues., Conclusions: It is feasible to embed SBML into a required clerkship. In the context of this study, rigorous SBML resulted in uniformly high levels of skill acquisition, documented competency, and was positively received by learners.

Purpose: Infusing continuity of care into medical student clerkships may accelerate professional development, preserve patient-centered attitudes, and improve primary care training. However, prospective, randomized studies of longitudinal curricula are lacking., Method: All entering Northwestern University Feinberg School of Medicine students in 2015 and 2016 were randomized to the Education Centered Medical Home (ECMH), a 4-year, team-based primary care clerkship; or a mentored individual preceptorship (IP) for 2 years followed by a traditional 4-week primary care clerkship. Students were surveyed 4 times (baseline, M1, M2, and M3 year [through 2018]); surveys included the Maslach Burnout Inventory (MBI); the Communication, Curriculum, and Culture (C3) survey assessing the hidden curriculum; and the Attitudes Toward Health Care Teams (ATHCT) scale. The authors analyzed results using an intent-to-treat approach., Results: Three hundred twenty-nine students were randomized; 316 (96%) participated in surveys. Seventy percent of all respondents would recommend the ECMH to incoming first-year students. ECMH students reported a more positive learning environment (overall quality, 4.4 ECMH vs 4.0 IP, P < .001), greater team-centered attitudes (ATHCT scale, 3.2 vs 3.0, P = .007), less exposure to negative aspects of the hidden curriculum (C3 scale, 4.6 vs 4.3, P < .001), and comparable medical knowledge acquisition. ECMH students established more continuity relationships with patients (2.2 vs 0.3, P < .001) and reported significantly higher professional efficacy (MBI-PE, 4.1 vs 3.9, P = .02)., Conclusions: In this randomized medical education trial, the ECMH provided superior primary care training across multiple outcomes compared with a traditional clerkship-based model, including improved professional efficacy.

Background: Underrepresented minority (URM) trainees face unique challenges in academic medicine. Near-peer mentorship is an under-described method to support URM trainees., Objective: We created and evaluated the Student to Resident Institutional Vehicle for Excellence (STRIVE) program in a large urban medical school and associated residency programs., Methods: All URM residents were invited to participate in the STRIVE mentorship program consisting of 3 pillars of programming: medical school curriculum review sessions, panel discussions, and social events for medical students. The program was evaluated through participation rates and a 7-item survey delivered in May 2019 after 3 years of implementation., Results: The STRIVE initiative conducted 25 events. Thirty-five of 151 eligible (23%) URM residents participated as mentors for an average of 50 of 110 eligible (45%) URM medical students annually. Resident mentors participated for an average of 3 to 4 hours each year. Twenty of 32 eligible resident mentors (63%) completed the survey. Ninety-five percent (19 of 20) of survey respondents agreed that STRIVE made them a better mentor; 90% (18 of 20) reported that they would have appreciated an equivalent program during their medical school training; and 75% (15 of 20) agreed that the program helped them address the challenges of underrepresentation in medicine., Conclusions: Over a 3-year period, STRIVE required a modest amount of resident time and was valued by the URM residents and medical students who participated in the program., Competing Interests: Conflict of interest: The authors declare they have no competing interests., (Accreditation Council for Graduate Medical Education 2020.)

Background: Patients who undergo ventricular assist device (VAD) implantation and their caregivers must rapidly learn a significant amount of self-care skills and knowledge., Objective: The aim of this study was to explore patient, caregiver, VAD coordinator, and physician perspectives and perceptions of existing VAD self-care training to inform development of a simulation-based mastery learning (SBML) curriculum to teach patients and caregivers VAD self-care skills and knowledge., Methods: We conducted semistructured, in-person interviews with patients with a VAD, their caregivers, VAD coordinators, and physicians (cardiac surgeons, an infectious disease physician, and advanced heart failure cardiologists). We used a 2-cycle team-based iterative inductive approach to coding and analysis., Results: We interviewed 16 patients, 12 caregivers, 7 VAD coordinators, and 11 physicians. Seven major themes were derived from the interviews including (1) identification of critical curricular content, (2) need for standardization and assessment, (3) training modalities, (4) benefits of repetition, (5) piercing it all together, (6) need for refresher training, and (7) provision of training before implant., Conclusions: Findings from this study suggest that SBML is a natural fit for the high-risk tasks needed to save VAD self-care. The 7 unique training-related themes derived from the qualitative data informed the design and development of a VAD SBML self-care curriculum.

Background: No recognized standards exist for teaching patients and their caregivers ventricular assist device (VAD) self-care skills. We compared the effectiveness of a VAD simulation-based mastery learning (SBML) self-care training curriculum with usual VAD self-care training., Methods and Results: VAD patients and their caregivers were randomized to SBML or usual training during their implant hospitalization. The SBML group completed a pretest on 3 VAD self-care skills (controller, power source, and dressing change), then viewed videos and participated in deliberate practice on a simulator. SBML participants took a posttest and were required to meet or exceed a minimum passing standard for each of the skills. The usual training group completed the existing institutional VAD self-care teaching protocol. Before hospital discharge, the SBML and usual training groups took the same 3 VAD self-care skills tests. We compared demographic and clinical information, self-confidence, total participant training time, and skills performance between groups. Forty participants completed the study in each group. There were no differences in demographic and clinical information, self-confidence, or training time between groups. More participants in the SBML group met the minimum passing standard compared with the usual training group for controller (37/40 [93%] versus 25/40 [63%]; P =0.001), power source (36/40 [90%] versus 9/40 [23%]; P <0.001), and dressing change skills (19/20 [95%] versus 0/20; P <0.001)., Conclusions: SBML provided superior VAD self-care skills learning outcomes compared with usual training. This study has important implications for patients due to the morbidity and mortality associated with improper VAD self-care., Clinical Trial Registration: URL: http://www.clinicaltrials.gov. Unique identifier: NCT03073005.

Problem: Thirteen measurable Entrustable Professional Activities (EPAs) have been proposed by the Association of American Medical Colleges as a means to operationalize medical school graduates' patient care qualifications. Mastery learning is an effective method for boosting clinical skills, but its applicability to the EPAs remains to be studied. The authors designed this study to evaluate a mastery learning intervention to teach and assess components of 3 of the 13 EPAs in a 4th-year capstone course., Intervention: The course featured mastery learning principles and addressed three EPA-based skills: (a) obtain informed consent, (b) develop a differential diagnosis and write admission orders, and (c) write discharge prescriptions. All students underwent a baseline skills assessment, received feedback, engaged in deliberate practice with actionable feedback, and completed a similar skills-based posttest assessment. Students continued with practice and testing until the minimum passing standards (MPSs) were reached for each posttest., Context: All medical students at a single medical school (Northwestern University, Feinberg School of Medicine) who matriculated in 2012 and graduated with the class of 2016 participated in a required transition to residency course immediately prior to graduation., Outcome: There were 134 students eligible to participate, and 130 (97.0%) completed all curricular requirements and assessments. All 130 medical students who completed the course met or exceeded the MPS for each of the three EPA-based clinical skills. Reliability coefficients for outcome data were uniformly high. Measures for each of the three clinical skills showed statistically significant improvement., Lessons Learned: The capstone course was an effective approach to teach and assess components of three EPA-based clinical skills to mastery learning standards in a 4th-year capstone course. We learned that this approach for implementation is feasible and results in significant improvement in components of EPA skill performance. Next steps will include developing assessments incorporating the mastery model into components of additional EPAs, identifying the best location within the curriculum to insert this content, and expanding the number of assessments as part of a larger assessment system.

Introduction: Physician communication impacts patient outcomes. However, communication skills, especially around difficult conversations, remain suboptimal, and there is no clear way to determine the validity of entrustment decisions. The aims of this study were to 1) describe the development of a simulation-based mastery learning (SBML) curriculum for breaking bad news (BBN) conversation skills and 2) set a defensible minimum passing standard (MPS) to ensure uniform skill acquisition among learners., Innovation: An SBML BBN curriculum was developed for fourth-year medical students. An assessment tool was created to evaluate the acquisition of skills involved in a BBN conversation. Pilot testing was completed to confirm improvement in skill acquisition and set the MPS., Outcomes: A BBN assessment tool containing a 15-item checklist and six scaled items was developed. Students' checklist performance improved significantly at post-test compared to baseline (mean 65.33%, SD = 12.09% vs mean 88.67%, SD = 9.45%, P < 0.001). Students were also significantly more likely to have at least a score of 4 (on a five-point scale) for the six scaled questions at post-test. The MPS was set at 80%, requiring a score of 12 items on the checklist and at least 4 of 5 for each scaled item. Using the MPS, 30% of students would require additional training after post-testing., Comments: We developed a SBML curriculum with a comprehensive assessment of BBN skills and a defensible competency standard. Future efforts will expand the mastery model to larger cohorts and assess the impact of rigorous education on patient care outcomes., (Copyright © 2018 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.)

Background: Patients and caregivers need to perform ventricular assist device (VAD) self-care safely to help prevent complications (e.g., infection). We developed a VAD self-care simulation-based mastery learning (SBML) curriculum. We determined optimal minimum passing scores (MPSs) and evaluated effects of judge selection., Methods: A multidisciplinary team created a VAD self-care SBML curriculum including simulated skills and knowledge examinations. Patients, caregivers, VAD coordinators, and physicians were expert judges who determined MPSs using the Mastery Angoff method., Results: MPSs for the skills and knowledge examinations were high (range = 94-99% and 97% correct), respectively. Judges closely agreed on MPSs., Conclusions: Stakeholders set stringent MPSs for high-stakes VAD self-care., Competing Interests: Conflict of Interest Disclosures: The authors have no relevant financial disclosures to report.

Phenomenon: Teaching patient-centered care (PCC) is a key component of undergraduate medical curricula. Prior frameworks of PCC describe multiple domains of patient-centeredness, ranging from interpersonal encounters to systems-level issues. Medical students' perceptions of PCC are thought to erode as they progress through school, but little is known about how students view PCC toward the beginning of training. This study explores the perceptions of PCC among 1st-year medical students to inform curricular development and evaluation. Approach: Medical students participated in semistructured, in-person interviews within 4 months of starting medical school as part of a longitudinal study. Transcripts were analyzed using a grounded theory approach and the constant comparative method to describe responses and characterize emergent themes. Transcripts were reviewed to compare codes and compile a final codebook. Findings: Thirty-eight students completed interviews. Students provided heterogeneous definitions of PCC, including perceptions that PCC is implicit and obvious. Many students were unable to provide a concrete definition of PCC, juxtaposing PCC with other priorities such as profit- or physician-centered care, whereas others thought the term was jargon. Some participants defined PCC as upholding patient values using hypothetical examples centered around physician behavior. Insights: Although students appeared to enter medical school with a range of perceptions about PCC, many of their descriptions were limited and only scratch the surface of existing frameworks. Rather than their perceptions of PCC eroding during medical school, students may never fully develop a foundational understanding of PCC. Our findings reinforce the need for authentic, clinically experiential learning opportunities that promote PCC from the earliest stages of medical education.

Purpose: Defensible minimum passing standards (MPSs) must be used to evaluate learner performance outcomes in health professions education. In this study, the authors compared the results of traditional Angoff and Hofstee standard-setting exercises with the Mastery Angoff and Patient-Safety approaches for central venous catheter (CVC) insertion skills examinations. The authors also evaluated how these standards affected the historical performance of residents who participated in a simulation-based mastery learning (SBML) curriculum for CVC insertion skills., Method: In April and May 2015, 12 physicians with expertise in CVC insertion set MPSs for previously published internal jugular (IJ) and subclavian (SC) CVC insertion checklists using Angoff, Hofstee, Mastery Angoff, and Patient-Safety approaches. The resulting MPSs were compared using historical performance of internal medicine and emergency medicine residents who participated in CVC insertion SBML., Results: The MPSs were set as follows: Angoff: IJ 91% checklist items correct, SC 90%. Hofstee: IJ 88%, SC 90%. Mastery Angoff: IJ 98%, SC 98%. Patient-Safety: IJ 98%, SC 98%. Based on the historical performance of 143 residents assessed on IJ and SC insertion, applying the 98% MPS would result in additional practice and retesting of 55/123 residents (45%) who had previously passed the IJ examination and 36/130 residents (28%) who had passed the SC examination using the Angoff and Hofstee MPSs., Conclusions: The Mastery Angoff and Patient-Safety standard-setting approaches resulted in higher CVC insertion SBML MPSs compared with traditional standard-setting methods. Further study should assess the impact of these more rigorous standards on patient outcomes.

Objectives: The aim of this study is to determine whether simulation-based education (SBE) translates into reduced procedure time, radiation, and contrast use in actual clinical care., Background: As a high volume procedure often performed by novice cardiology fellows, diagnostic coronary angiography represents an excellent target for SBE. Reports of SBE in interventional cardiology are limited and there is little understanding of the potential downstream clinical impact of these interventions., Methods: All diagnostic coronary angiograms performed at a single center between January 1, 2011 and June 30, 2015 were analyzed. Random effects linear regression models were used to compare outcomes between procedures performed by 12 cardiology fellows who underwent simulation-based training and those performed by 20 traditionally trained fellows., Results: Thirty-two cardiology fellows performed 2,783 diagnostic coronary angiograms. Procedures performed by fellows trained with SBE were shorter (mean of 23.98 min vs. 24.94 min, P = 0.034) and were performed with decreased radiation (mean of 56,348 mGycm 2 vs. 66,120 mGycm 2 , P < 0.001). After controlling for year in training, procedure year, access site, and supervising attending physician, training on the simulator was independently associated with 117 fewer seconds of fluoroscopy time per procedure (P = 0.04)., Conclusions: Diagnostic coronary angiography SBE is associated with decreased use of fluoroscopy in downstream clinical care. SBE may be a useful tool to reduce radiation exposure in the cardiac catheterization laboratory., (© 2017 Wiley Periodicals, Inc.)

Purpose: Physicians-in-training often perform bedside thoracenteses in academic medical centers, and complications are more common among less experienced clinicians. Simulation-based mastery learning (SBML) is one potential solution to this problem. This study evaluated the effects of a randomized trial of thoracentesis SBML on patient complications: iatrogenic pneumothorax (IP), hemothorax, and reexpansion pulmonary edema (REPE)., Method: The authors randomized internal medicine residents to undergo thoracentesis SBML at a tertiary care academic center from December 2012 to May 2016. They subsequently compared thoracentesis complications from procedures performed by SBML-trained residents, traditionally trained residents (no simulation training), and those referred to pulmonary medicine or interventional radiology (IR)., Results: During the study period, 917 thoracenteses were performed on 709 patients. IP occurred in 60 (6.5%) procedures, of which 7 (11.6%) were clinically meaningful. SBML-trained residents performed procedures with a trend toward lower combined clinically meaningful complications (IP, hemothorax, REPE) compared with traditionally trained residents (7.9% vs. 0%; P = .06). SBML-trained residents caused fewer clinically meaningful IPs compared with traditionally trained residents, pulmonary, and IR referrals (P = .02). Hemothorax occurred after 4 (0.4%) thoracenteses, and SBML-trained residents had a trend toward lower hemothorax (0) compared with other groups (P = .07). REPE occurred after 3 (0.3%) procedures, with no differences between groups. SBML-trained residents performed procedures with lower combined clinically meaningful complications compared with other groups (P = .008)., Conclusions: Residents randomized to an SBML intervention performed thoracenteses with low rates of clinically meaningful complications. Rigorous education represents a successful quality improvement strategy.

This article was migrated. The article was marked as recommended. Background Studies show that medical residents do not feel comfortable and lack the skills and confidence to perform common bedside procedures. Regulatory bodies often require a set number of procedures to determine resident competence, yet medical providers' knowledge of competency guidelines are less well known. This study aimed to qualitatively assess existing practices relevant to documentation of competency in central venous catheter (CVC) insertion and explore healthcare providers' awareness and perceptions of those practices at their institutions. Methods The authors performed a qualitative study at Veterans Affairs Medical Centers (VAMCs) from February to December 2014 as part of a larger project related to the dissemination of a simulation-based CVC insertion curriculum. Two authors conducted interviews with hospital staff (including attending physicians, nurses, and residents) at selected VAMCs. Recordings of interviews were transcribed, coded, and analyzed using a grounded theory approach and constant comparative techniques. Results Twenty-six participants were interviewed at six VAMCs. Participants reported varying perspectives regarding their institutions' policies about CVC insertion. Four major themes emerged: (1) knowledge of institutional policy; (2) competency by numbers; (3) documentation of competency; and (4) perceptions of competency measures. Participants reported concern about the reliability of these policies and measures of competence. Conclusions This study demonstrates that healthcare providers' knowledge and perceptions about institutional requirements for procedural competency vary widely. Our findings suggest the need for establishment of consistent competency policies based on evidence-based practices, and highlight the need for increased communication regarding individual institutional policies. Integration of rigorous simulation-based education, implemented consistently across institutions, can provide a reliable mechanism to train and assess procedural competence and ensure patient safety., (Copyright: © 2018 Cohen ER et al.)

Introduction: Lesbian, gay, bisexual, and transgender (LGBT) students face challenges in achieving their educational goals. By understanding concepts surrounding sexual orientation and gender identity, faculty, staff, and students can support LGBT community members and provide a safe educational space. In order to address this we created a condensed training resource that focused on skill building and is easily implemented institution-wide for students, residents, fellows, faculty, and staff., Methods: This module serves as an introduction to concepts integral to the LGBT community. It is structured into two sections and takes approximately 30 minutes to complete, including pre-/postevaluations. The first section of the module focuses on presenting basic information about the LGBT world experience and basic terminology. The second section contains two real-world scenarios aimed at demonstrating skills used to create a safe educational learning space. Each scenario contains interactive questions that allow participants to practice applying their new skills., Results: To date, 89 institutional community members at the Northwestern University Feinberg School of Medicine have completed the module. Survey results demonstrate that the module was well-received and effective at improving attitudes towards creating a safe space., Discussion: While this module provides a foundation in terminology and phenomena relevant to the LGBT experience, it is just one part of creating a positive institutional climate for LGBT community members. Additional in-person skills-based training should also be considered to complement and enhance this module's contents., Competing Interests: None to report.

This article describes the development, implementation, and modification of an institutional process to evaluate and fund graduate medical education simulation curricula. The goals of this activity were to (a) establish a standardized mechanism for proposal submission and evaluation, (b) identify simulation-based medical education (SBME) curricula that would benefit from mentored improvement before implementation, and (c) ensure that funding decisions were fair and defensible. Our intent was to develop a process that was grounded in sound educational principles, allowed for efficient administrative oversight, ensured approved courses were high quality, encouraged simulation education research and scholarship, and provided opportunities for medical specialties that had not previously used SBME to receive mentoring and faculty development.

Context: Although code status discussions (CSD) occur frequently in the hospital setting, discussions often lack content necessary for informed decision making. Simulation-based mastery learning (SBML) has been used to improve clinical skills among resident physicians and may provide a novel way to improve hospitalists' CSD skills., Objectives: The objective of this pilot randomized controlled trial was to develop and evaluate a CSD SBML intervention for hospitalists., Methods: Twenty hospitalists were randomized to control vs. a CSD SBML intervention. Hospitalists conducted a baseline standardized patient encounter (pretest) that was scored using a 19-item CSD checklist and controls completed a repeat standardized patient encounter six months later (post-test). Intervention group hospitalists received at least one two-hour training session featuring deliberate practice and feedback and were expected to meet a minimum passing score (MPS) on the post-test of 84% set by an expert panel., Results: Only two of the 20 hospitalists met the MPS at pretest. Seventy percentage of intervention hospitalists achieved the MPS after a single training session. Post-test median checklist scores were higher for intervention hospitalists compared with controls (16.5 vs. 12.0, P = 0.0001). Intervention hospitalists were significantly more likely to ask about previous experiences with end-of-life decision making (70% vs. 20%, P = 0.03), explore values/goals (100% vs. 50%, P = 0.01), ask permission to make a recommendation regarding code status (60% vs. 0%, P = 0.003), and align recommendations with patient values/goals (90% vs. 40%, P = 0.02) than controls., Conclusion: Few hospitalists demonstrated mastery of CSD skills at baseline; SBML was an effective way to improve these skills., (Copyright © 2017 American Academy of Hospice and Palliative Medicine. Published by Elsevier Inc. All rights reserved.)

Background: Many medical certifying bodies require that a minimum number of clinical procedures be completed during residency training to obtain board eligibility. However, little is known about the relationship between the number of procedures residents perform and their clinical competence., Objective: This study evaluated associations between residents' medical procedure skills measured in a simulation laboratory and self-reported procedure experience and year of training., Methods: This research synthesis extracted and summarized data from multiple cohorts of internal medicine, emergency medicine, anesthesiology, and neurology resident physicians who performed simulated clinical procedures. The procedures were central venous catheter insertion, lumbar puncture, paracentesis, and thoracentesis. We compared residents' baseline simulated performance to their self-reported procedure experience using data from 7 research reports written by Northwestern University investigators between 2006 and 2016. We also evaluated how performance differed by postgraduate year (PGY)., Results: A total of 588 simulated procedures were performed during the study period. We found significant associations between passing the skills examinations and higher number of self-reported procedures performed ( P  = .011) and higher PGY ( P  < .001). However, performance for all procedures was poor, as only 10% of residents passed the assessments with a mean of 48% of checklist items correct (SD = 24.2). The association between passing the skills examination and year of training was mostly due to differences between PGY-1 and subsequent years of training., Conclusions: Despite positive associations between self-reported experience and simulated procedure performance, overall performance was poor. Residents' clinical experience is not a proxy for skill., Competing Interests: Conflict of interest: The authors declare they have no competing interests.

Background: Unprofessional behaviors undermine the hospital learning environment and the quality of patient care., Objective: To assess the impact of an interactive workshop on the perceptions of and self-reported participation in unprofessional behaviors., Methods: We conducted a pre-post survey study at 3 internal medicine residency programs. For the workshop we identified unprofessional behaviors related to on-call etiquette: "blocking" an admission, disparaging a colleague, and misrepresenting a test as urgent. Formal debriefing tools were utilized to guide the discussion. We fielded an internally developed 20-item survey on perception and participation in unprofessional behaviors prior to the workshop. An online "booster" quiz was delivered at 4 months postworkshop, and the 20-item survey was repeated at 9 months postworkshop. Results were compared to a previously published control from the same institutions, which showed that perceptions of unprofessional behavior did not change and participation in the behaviors worsened over the internship., Results: Of 237 eligible residents, 181 (76%) completed both pre- and postsurvey. Residents perceived blocking an admission and the misrepresentation of a test as urgent to be more unprofessional at a 9-month follow-up (2.0 versus 1.74 and 2.63 versus 2.28, respectively; P  < .05), with no change in perception for disparaging a colleague. Participation in unprofessional behaviors did not decrease after the workshop, with the exception of misrepresenting a test as urgent (61% versus 50%, P  = .019)., Conclusions: The results of this multi-site study indicate that an interactive workshop can change perception and may lower participation in some unprofessional behaviors., Competing Interests: Conflict of interest: Dr Arora is a current member of the Board of Directors of the American Board of Internal Medicine, but was not during the time this work was performed. The curriculum and results in this article have been presented as an abstract poster at the Association of Program Directors of Internal Medicine Spring Conference, Nashville, Tennessee, April 6–10, 2014; as a workshop at the Academy for Professionalism in Health Care Annual Meeting, Chicago, Illinois, May 8–10, 2014; and as an oral abstract presentation at the Accreditation Council for Graduate Medical Education Annual Educational Conference, San Diego, California, February 27–March 2, 2014.