Search

This survey study examines the frequency, types, and sources of perceived workplace mistreatment and the prevalence of suicidal ideation among emergency medicine residents in the US., Key Points Question What is the prevalence of workplace mistreatment and suicidal thoughts among emergency medicine residents? Findings In this survey study of 7680 emergency medicine residents, 45.1% reported exposure to some type of workplace mistreatment (eg, discrimination, abuse, or harassment) and 2.5% reported having suicidal thoughts during the most recent academic year. The prevalence of workplace mistreatment and suicidal thoughts was similar by gender and race/ethnicity. Meaning The findings suggest that educational interventions are warranted to reduce workplace mistreatment and ensure emergency medicine residents’ well-being during training., Importance The prevalence of workplace mistreatment and its association with the well-being of emergency medicine (EM) residents is unclear. More information about the sources of mistreatment might encourage residency leadership to develop and implement more effective strategies to improve professional well-being not only during residency but also throughout the physician’s career. Objective To examine the prevalence, types, and sources of perceived workplace mistreatment during training among EM residents in the US and the association between mistreatment and suicidal ideation. Design, Setting, and Participants In this survey study conducted from February 25 to 29, 2020, all residents enrolled in EM residencies accredited by the Accreditation Council for Graduate Medical Education (ACGME) who participated in the 2020 American Board of Emergency Medicine computer-based In-training Examination were invited to participate. A multiple-choice, 35-item survey was administered after the examination asking residents to self-report the frequency, sources, and types of mistreatment experienced during residency training and whether they had suicidal thoughts. Main Outcomes and Measures The types and frequency of workplace mistreatment and the sources of the mistreatment were identified, and rates of self-reported suicidality were obtained. Multivariable logistic regression models were used to examine resident and program characteristics associated with suicidal thoughts. Results Of 8162 eligible EM residents, 7680 (94.1%) responded to at least 1 question on the survey; 6503 (79.7%) completed the survey in its entirety. A total of 243 ACGME-accredited residency programs participated, and 1 did not. The study cohort included 4768 male residents (62.1%), 2698 female residents (35.1%), 4919 non-Hispanic White residents (64.0%), 2620 residents from other racial/ethnic groups (Alaska Native, American Indian, Asian or Pacific Islander, African American, Mexican American, Native Hawaiian, Puerto Rican, other Hispanic, or mixed or other race) (34.1%), 483 residents who identified as lesbian, gay, bisexual, transgender, queer, or other (LGBTQ+) (6.3%), and 5951 residents who were married or in a relationship (77.5%). Of the total participants, 3463 (45.1%) reported exposure to some type of workplace mistreatment (eg, discrimination, abuse, or harassment) during the most recent academic year. A frequent source of mistreatment was identified as patients and/or patients’ families; 1234 respondents (58.7%) reported gender discrimination, 867 (67.5%) racial discrimination, 282 (85.2%) physical abuse, and 723 (69.1%) sexual harassment from patients and/or family members. Suicidal thoughts occurring during the past year were reported by 178 residents (2.5%), with similar prevalence by gender (108 men [2.4%]; 59 women [2.4%]) and race/ethnicity (113 non-Hispanic White residents [2.4%]; 65 residents from other racial/ethnic groups [2.7%]). Conclusions and Relevance In this survey study, EM residents reported that workplace mistreatment occurred frequently. The findings suggest common sources of mistreatment for which educational interventions may be developed to help ensure resident wellness and career satisfaction.

INTRODUCTION: Beginning in 1999, residents in emergency medicine have been expected to demonstrate competence in the six Accreditation Council on Graduate Medical Education (ACGME) Core Competencies. Expectations were further refined and clarified through the introduction of the Milestones in 2013. Emerging research and data from milestone reporting has illustrated the need for modification of the original milestones. Against this backdrop, the ACGME convened a committee to review and revise the original milestones. METHODS: The working group was convened in December 2018 and consisted of representatives from the American Board of Emergency Medicine, American Osteopathic Association, Council of Residency Directors in Emergency Medicine, Association of American Medical Colleges, ACGME‐Emergency Medicine Review Committee, three community members, a resident member, and a public member. This group also included members from both academic and community emergency medicine programs. The group was overseen by the ACGME vice president for milestones development and met in person one time followed by four virtual sessions to revise and draft the Emergency Medicine Milestones and Supplemental Guide as part of the ACGME Milestones 2.0 Project. RESULTS: Using data from milestones reporting, needs assessment data, stakeholder interviews, and community commentary, the working group engaged in revisions and updates for the Emergency Medicine Milestones and created a supplemental guide to aid programs in the design of programmatic assessment for the milestones. CONCLUSION: The Emergency Medicine Milestones 2.0 provide updated specialty‐specific, competency‐based behavioral anchors to guide the assessment of residents, the design of curricula, and the advancement of emergency medicine training programs.

Background Graduates of emergency medicine residency programs can seek certification from the American Board of Emergency Medicine (ABEM), yet the costs and perceived value by residents is not clear. Objective This report sought to better define the value of board certification by asking physicians taking the ABEM Oral Certification Examination (OCE) to describe its costs (eg, time, money) and perceived benefits. Methods A descriptive, cross-sectional, voluntary, anonymous survey was administered to physicians taking the 2018 spring and fall ABEM OCEs. Response frequencies were used to report response rates. Results There were 2016 physicians who participated in the 2018 OCEs, of whom 1565 (78%) completed a survey. With respect to preparation, 38% (599 of 1565 responses) spent more than 30 hours preparing for the examination. Regarding the expense of preparing for the examination, 21% (328) spent nothing, 50% (776) spent less than $1,000, and 2% (38) spent more than $3,000. Most physicians (80%, 1254) reported a learning benefit to preparing for and taking the OCE. There were 49% (765) of respondents who reported that preparing for the examination reinforced their knowledge of emergency medicine; 20% (311) reported no learning benefit. Most physicians (92%, 1442) reported that ABEM certification provided a career benefit, the most common of which was more career opportunities (69%, 1076). Conclusions Initial certification requires a considerable investment of time and money. Physicians seeking initial ABEM certification found both learning and professional benefits, with the most frequently reported being reinforcement of medical knowledge and more career opportunities.

Supplemental Digital Content is available in the text., Purpose To investigate whether clinical competency committees (CCCs) were consistent in applying milestone ratings for first-year residents over time or whether ratings increased or decreased. Method Beginning in December 2013, the Accreditation Council for Graduate Medical Education (ACGME) initiated a phased-in requirement for reporting milestones; emergency medicine (EM), diagnostic radiology (DR), and urology (UR) were among the earliest reporting specialties. The authors analyzed CCC milestone ratings of first-year residents from 2013 to 2016 from all ACGME-accredited EM, DR, and UR programs for which they had data. The number of first-year residents in these programs ranged from 2,838 to 2,928 over this time period. The program-level average milestone rating for each subcompetency was regressed onto the time of observation using a random coefficient multilevel regression model. Results National average program-level milestone ratings of first-year residents decreased significantly over the observed time period for 32 of the 56 subcompetencies examined. None of the other subcompetencies showed a significant change. National average in-training examination scores for each of the specialties remained essentially unchanged over the time period, suggesting that differences between the cohorts were not likely an explanatory factor. Conclusions The findings indicate that CCCs tend to become more stringent or maintain consistency in their ratings of beginning residents over time. One explanation for these results is that CCCs may become increasingly comfortable in assigning lower ratings when appropriate. This finding is consistent with an increase in confidence with the milestone rating process and the quality of feedback it provides.

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine-sponsored residency and fellowship programs, residents and fellows training in those programs, and all fellows for whom ABEM issues subspecialty certifications. We present the 2019 annual report on the status of US emergency medicine training programs.

Objectives Burnout afflicts emergency physicians (EPs) to a significant degree. The impact of burnout spans from decreased clinical efficiency to increased medical errors to heightened risk of physician suicide. This large‐scale study captures responses from emergency medicine (EM) residents regarding two burnout items and examines the correlation between in‐training examination (ITE) scores and burnout risk as well as that between residency year and burnout risk. Methods This was a prospective, mixed‐methods, cross‐sectional cohort study. All residents in U.S. categorical EM residents who took the 2019 ITE were included. At the end of the ITE, residents were invited to complete a voluntary survey that included two items from the Maslach Burnout Inventory (MBI) that have been found to be strongly indicative of burnout: one about self‐perception of being burned out and one about feelings of callousness. Responses were on a 7‐level Likert scale (1–7), ranging from very low frequency (1) to very high frequency (7). Measurements included the number of residents in each year‐level of training (EM1–EM4), the MBI item ratings, and the ABEM ITE score. Performance, as measured by the scaled, equated score, was compared to the MBI item responses. A corrected Spearman’s correlation coefficient (ρ) was used to compare continuous data (score) against a discrete ordinal variable (MBI Likert response). Results There were 2,501 EM1 residents, 2,389 EM2 residents, 2,206 EM3 residents, and 616 EM4 residents in the study group. There were 7,206 (93.4%) physicians who completed the first MBI question about burnout; 7,172 (93%) completed the second MBI question about callousness. There was no statistically significant association between the burnout item response and ITE performance (ρ = –0.03; p = 0.015). There was a positive, statistically significant association between the callousness item response and higher ITE performance (ρ = 0.07; p < 0.001). There was a statistically significant association between the response to the burnout item and training level (ρ = 0.07; p

The American Board of Emergency Medicine gathers extensive background information on Accreditation Council for Graduate Medical Education (ACGME)–accredited emergency medicine residency and fellowship programs, as well as the residents and fellows training in those programs. We present the 2020 annual report on the status of physicians training in ACGME-accredited emergency medicine training programs in the United States.

Background In 2013, milestone ratings became a reporting requirement for emergency medicine (EM) residency programs. Programs rate each resident in the fall and spring on 23 milestone subcompetencies. Objective This study examined the incidence of straight line scoring (SLS) for EM Milestone ratings, defined as a resident being assessed the same score across the milestone subcompetencies. Methods This descriptive analysis measured the frequencies of SLS for all Accreditation Council for Graduate Medical Education (ACGME)–accredited EM programs during the 2015–2016 academic year. Outcomes were the frequency of SLS in the fall and spring milestone assessments, changes in the number of SLS reports, and reporting trends. Chi-square analysis compared nominal variables. Results There were 6257 residents in the fall and 6588 in the spring. Milestone scores were reported for 6173 EM residents in the fall (99% of 6257) and spring (94% of 6588). In the fall, 93% (5753 residents) did not receive SLS ratings and 420 (7%) did, with no significant difference compared with the spring (5776 [94%] versus 397 [6%]). Subgroup analysis showed higher SLS results for residents' first ratings (183 of 2136 versus 237 of 4220, P < .0001) and for their final ratings (200 of 2019 versus 197 of 4354, P < .0001). Twenty percent of programs submitted 10% or more SLS ratings, and a small percentage submitted more than 50% of ratings as SLS. Conclusions Most programs did not submit SLS ratings. Because of the statistical improbability of SLS, any SLS ratings reduce the validity assertions of the milestone assessments.

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine residency programs and the residents training in those programs. We present the 2017 annual report on the status of US emergency medicine training programs.

Author(s): Hart, Danielle; Franzen, Douglas; Beeson, Michael; Bhat, Rahul; Kulkarni, Miriam; Thibodeau, Lorraine; Weizberg, Moshe; Promes, Susan | Abstract: Introduction: Medical education is moving toward a competency-based framework with a focus on assessment using the Accreditation Council for Graduate Medical Education Milestones. Assessment of individual competencies through milestones can be challenging. While competencies describe characteristics of the person, the entrustable professional activities (EPAs) concept refers to work-related activities. EPAs would not replace the milestones but would be linked to them, integrating these frameworks. Many core specialties have already defined EPAs for resident trainees, but EPAs have not yet been created for emergency medicine (EM). This paper describes the development of milestone-linked EPAs for EM. Methods: Ten EM educators from across North America formed a consensus working group to draft EM EPAs, using a modified Glaser state-of-the-art approach. A reactor panel with EPA experts from the United States, Canada and the Netherlands was created, and an iterative process with multiple revisions was performed based on reactor panel input. Following this, the EPAs were sent to the Council of Residency Directors for EM (CORD-EM) listserv for additional feedback.Results: The product was 11 core EPAs that every trainee from every EM program should be able to perform independently by the time of graduation. Each EPA has associated knowledge, skills, attitudes and behaviors (KSAB), which are either milestones themselves or KSABs linked to individual milestones. We recognize that individual programs may have additional focus areas or work-based activities they want their trainees to achieve by graduation; therefore, programs are also encouraged to create additional program-specific EPAs. Conclusion: This set of 11 core, EM-resident EPAs can be used as an assessment tool by EM residency programs, allowing supervising physicians to document the multiple entrustment decisions they are already making during clinical shifts with trainees. The KSAB list within each EPA could assist supervisors in giving specific, actionable feedback to trainees and allow trainees to use this list as an assessment-for-learning tool. Linking each KSAB to individual EM milestones allows EPAs to directly inform milestone assessment for clinical competency committees. These EPAs serve as another option for workplace-based assessment, and are linked to the milestones to create an integrated framework.

Background Version 1 (V1) of the National Emergency Medicine Fourth-year Student (EM M4) Examination was released in 2011 and revised along with release of V2 in 2012. Each examination contains 50 multiple-choice questions designed to assess knowledge in the EM M4 clerkship curriculum. Development and initial performance data were described previously. Objective To provide updated V1 performance data, describe development and revision of V2, and to compare performance between academic years and examination forms, and within academic years. Methods Examinations are administered at www.saemtests.org with ongoing performance data provided. After 1 year of use, nine questions on V2 were revised, five because of low discriminatory ability and four because of excessive difficulty. Revision or replacement was done in accordance with the National Board of Medical Examiners (NBME) Item Writing Guidelines. Mean scores were compared for V1 between academic years (i.e., July 2011−June 2012 vs. July 2012−June 2013), V2 compared with V1, and for each examination version for early and late test takers. Results V1 has been administered >10,000 times since its release, and the current form mean is 81.5% (SD 3.7). Average discriminatory value (rpb) is 0.204. V2 has been administered >1500 times, with a mean score of 78.4% (SD 4.4) and average rpb 0.253. V1 and V2 current means differ statistically. Scores from examinees completing V1 or V2 early vs. late in the academic year differ statistically. Conclusions Performance data for V1 remain stable after 2 years. Revisions of poorly performing questions improved question performance on V2. Questions with low rpb or low pdiff will continue to be revised annually. While examination forms differ statistically, the practical utility of the differences is not defined.

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine–sponsored residency and fellowship programs, as well as the residents and fellows training in those programs. We present the 2018 annual report on the status of US emergency medicine training programs.

Introduction: Since 2011 two online, validated exams for fourth-year emergency medicine (EM) students have been available (National EM M4 Exams). In 2013 the National Board of Medical Examiners offered the Advanced Clinical Examination in Emergency Medicine (EM-ACE). All of these exams are now in widespread use; however, there are no data on how they correlate. This study evaluated the correlation between the EM-ACE exam and the National EM M4 Exams. Methods: From May 2013 to April 2014 the EM-ACE and one version of the EM M4 exam were administered sequentially to fourth-year EM students at five U.S. medical schools. Data collected included institution, gross and scaled scores and version of the EM M4 exam. We performed Pearson’s correlation and random effects linear regression. Results: 303 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (279 and 24, respectively). The mean percent correct for the exams were as follows: EM-ACE 74.8 (SD-8.83), V1 83.0 (SD-6.41), V2 78.5 (SD-7.70). Pearson’s correlation coefficient for the V1/EM-ACE was 0.51 (0.42 scaled) and for the V2/EM-ACE was 0.59 (0.41 scaled). The coefficient of determination for V1/EM-ACE was 0.72 and for V2/EM-ACE = 0.71 (0.86 and 0.49 for scaled scores). The R-squared values were 0.25 and 0.30 (0.18 and 0.13, scaled), respectively. There was significant cluster effect by institution. Conclusion: There was moderate positive correlation of student scores on the EM-ACE exam and the National EM M4 Exams. [West J Emerg Med. 2015;16(1):–0.]

In this issue an article, Goal Directed Focused Ultrasound Milestones Revised: A Multi-organizational Consensus, recommends significant change to the PC 12 subcompetency of the Emergency Medicine (EM) Milestones. The membership of this consensus group spans multiple organizations and individuals interested in emergency ultrasound (EUS) as well as resident education. This effort to improve this particular subcompetency is to be lauded. An iterative improvement to the progression of Milestones within PC12 can be justified on the basis of a large body of work produced after the introduction of the EM Milestones. However, there are a number of misperceptions within the article that deserve discussion. As a member of the original Emergency Medicine Milestone Working Group (EMMWG) I can address these suggested changes. This article is protected by copyright. All rights reserved.

The American Board of Emergency Medicine gathers extensive background information on emergency medicine residency programs and the residents in them. We present the 2014 annual report on the status of US emergency medicine training programs.

Background The Model of the Clinical Practice of Emergency Medicine is the basis for the content specifications of all American Board of Emergency Medicine (ABEM) examinations. This study describes the frequency with which ABEM diplomates diagnose and manage the conditions and components listed in the Model of the Clinical Practice of Emergency Medicine. Objectives The objectives of this study were to determine the frequency with which ABEM diplomates diagnose and manage the conditions and components described in the Model of the Clinical Practice of Emergency Medicine. Methods The listing of conditions and components of the Model of the Clinical Practice of Emergency Medicine were sent to 16,230 randomly selected ABEM diplomates. One of five surveys was sent to each diplomate. Each condition and component was assessed by participants for the frequency that emergency physicians diagnose (D) and manage (M) that condition, as seen in their practice of Emergency Medicine. Results Of the 16,230 surveys sent, 5006 were returned (30.8% response rate). The genders of the respondents were 75% male and 24% female. The ages of the respondents were primarily in the age 40–49 years, and 30–39 years age groups. All categories of the listing of conditions and components of the Model of the Clinical Practice of Emergency Medicine were encountered frequently in the practice of Emergency Medicine, as indicated by study participants. Conclusions A survey of practicing ABEM diplomates was useful in defining the frequency with which specific conditions and components are diagnosed and managed in the practice of Emergency Medicine.

Michael S. Beeson, MD, MBA, is Residency Program Director in the Department of Emergency Medicine, Akron General Medical Center; Wallace A. Carter, MD, is Residency Program Director in the Department of Emergency Medicine, New York Presbyterian Hospital; Theodore A. Christopher, MD, is Professor and Chairman of the Department of Emergency Medicine, Thomas Jefferson University and Hospitals; Jonathan W. Heidt, MD, is Clinical Instructor in the Division of Emergency Medicine, Washington University School of Medicine in St Louis; James H. Jones, MD, is Professor of Clinical Emergency Medicine in the Department of Emergency Medicine, Indiana University School of Medicine; Lynne E. Meyer, PhD, MPH, is Executive Director of the Review Committee for Emergency Medicine, Accreditation Council for Graduate Medical Education; Susan B. Promes, MD, is Professor and Vice Chair for Education in the Department of Emergency Medicine, University of California, San Francisco; Kevin G. Rodgers, MD, is Professor in the Department of Emergency Medicine, Indiana University School of Medicine; Philip H. Shayne, MD, is Professor and is Program Director and Vice Chair for Education in the Department of Emergency Medicine, Emory University School of Medicine; Mary Jo Wagner, MD, is Residency Program Director and Chief in the Department of Emergency Medicine, Central Michigan University College of Medicine; and Susan R. Swing, PhD, is Vice President of Outcome Assessment at the Accreditation Council for Graduate Medical Education.

The Model of the Clinical Practice of Emergency Medicine (the EM Model) is a three-dimensional representation of the clinical practice of emergency medicine. It is a product of successful collaboration involving the American Board of Emergency Medicine (ABEM), the American College of Emergency Physicians (ACEP), the Society for Academic Emergency Medicine (SAEM), the Emergency Medicine Residents' Association (EMRA), the Council of Emergency Medicine Residency Directors (CORD), the Residency Review Committee for Emergency Medicine (RRC-EM), and the American Academy of Emergency Medicine (AAEM). In 2017, the most recent update and revision of the EM Model will be published. This document will represent the culmination of nearly 40 years of evolution, from a simple listing of presenting patient complaints, clinical symptoms, and disease states into a three-dimensional representation of the clinical practice of emergency medicine. These dimensions include conditions and components, physician tasks, and patient acuity. In addition, over the years, two other documents have been developed, the Knowledge, Skills, and Abilities (KSAs) and the Emergency Medicine Milestones. Both serve as related and complementary educational and assessment tools. This article will review the development of the EM Model from its inception in 1979 to today.

The American Board of Emergency Medicine (ABEM) gathers extensive background information on emergency medicine residency programs and the residents training in those programs. We present the 2016 annual report on the status of US emergency medicine training programs.

This project was developed from the research network track at the 2012 Academic Emergency Medicine consensus conference on education research in emergency medicine (EM). Using a combination of consensus techniques, the modified Delphi method, and qualitative research methods, the authors describe multiple aspects of developing, implementing, managing, and growing an EM education research network. A total of 175 conference attendees and 24 small-group participants contributed to discussions regarding an education research network; participants were experts in research networks, education, and education research. This article summarizes relevant conference discussions and expert opinion for recommendations on the structure of an education research network, basic operational framework, site selection, leadership, subcommittees, guidelines for authorship, logistics, and measuring success while growing and maintaining the network.

Background Representatives of emergency medicine (EM) were asked to develop a consensus report that provided a review of the past and potential future effects of duty hour requirements for EM residency training. In addition to the restrictions made in 2003 by the Accreditation Council for Graduate Medical Education, the potential effects of the 2008 Institute of Medicine (IOM) report on resident duty hours were postulated. Discussion The elements highlighted include patient safety, resident wellness, and the resident training experience. Many of the changes and recommendations did not affect EM as significantly as other specialties. Current training standards in EM have already emphasized patient safety by requiring continuous onsite supervision of residents. Resident fatigue has been addressed with restrictions of shift lengths and limitation of consecutive days worked. Conclusion One recommendation from the IOM was a required 5-h rest period for residents on call. Emergency department (ED) patient safety becomes an important concern with the decrease in the availability and in the patient load of a resident consultant that may result from this recommendation. Of greater concern is the already observed slower throughput time for admitted patients waiting for resident care, which will increase ED crowding and decrease patient safety in academic institutions. A balance between being overly prescriptive with duty hour restrictions and trying to improve resident wellness was recommended. Discussion is included regarding the appropriate length of EM training programs if clinical experiences were limited by new duty hour regulations. Finally, this report presents a review of the financing issues associated with any changes.

Objectives: To examine the effectiveness of an asynchronous learning tool consisting of web-based lectures for trainees covering major topics pertinent to pediatric emergency medicine (PEM) and to assess resident and student evaluation of this mode of education. Methods: PEM faculty and fellows created a 21-lecture, web-based curriculum. These 20-minute online lectures used Microsoft PowerPoint with the voice-over feature. A 75-question test was created to assess the effectiveness of the web-based learning model, administered online before and after the rotation in the pediatric emergency department (PED). All fourth-year medical students and residents (across all specialties) rotating through the PED were required to complete 10 of the 21 lectures during their 1-month rotation. The main outcome variable was difference in score between pre- and post-rotation tests of participants who viewed no lectures and those who viewed at least one lecture. Evaluation of the program was assessed by anonymous survey using 5-point discrete visual analog scales. Responses of 4 or 5 were considered positive for analysis. Results: One hundred eleven residents and fourth-year medical students participated in the program. An initial 32 completed testing before implementation of the on-line lectures (March 2007–August 2007), and another five did not complete the on-line lectures after implementation (September 2007–February 2008). Seventy-one completed testing and on-line lectures, and all but three completed at least 10 on-line lectures during their rotation. Fourteen of 111 trainees did not complete the pre- or post-test (including two who viewed the lectures). The mean change in score was a 1% improvement from pre-test to post-test for trainees who viewed no lectures and a 6.2% improvement for those who viewed the lectures (mean difference = 5.2%, 95% confidence interval = 2.5% to 7.9%). In the linear regression model, the estimate of the coefficient was 0.43 (p < 0.001), meaning that, for each lecture viewed, post-test score rose by 0.43%. Sixty-nine of 75 test items (92%) had a point biserial correlation greater than 0.15. Thirty of the 72 trainees who completed the online lectures and testing (42%) returned surveys. All were comfortable using the Internet, and 87% (26/30) found the web-site easy to use. All felt that their educational goals were met, and 100% felt that the format would be useful in other areas of education. Conclusions: Although not a replacement for traditional bedside teaching, the use of web-based lectures as an asynchronous learning tool has a positive effect on medical knowledge test scores. Trainees were able to view online lectures on their own schedules, in the location of their choice. This is helpful in a field with shift work, in which trainees rarely work together, making it difficult to synchronously provide lectures to all trainees.

Nationwide survey findings that most U.S. emergency medicine clerkship directors were interested in participating in a methodologically rigorous student testing program prompted the development of the Society for Academic Emergency Medicine (SAEM) Medical Student Online Testing Service (SAEM Tests). This article describes the development of SAEM Tests and details usage and progress since the on-line release in June 2005. Specifically, we review the construction of SAEM Tests and present validity and difficulty statistics obtained at the first analysis of test performance 6 months after its release and again 12 months later after revisions aimed at enhancing test performance. We then review the current status of SAEM Tests and summarize future goals and directions.

Objective: A panel of Council of Emergency Medicine Residency Directors (CORD) members was asked to examine and make recommendations regarding the existing Accreditation Council of Graduate Medical Education (ACGME) EM Program Requirements pertaining to educational conferences, identified best practices, and recommended revisions as appropriate. Methods: Using quasi-Delphi technique, 30 emergency medicine (EM) residency program directors and faculty examined existing requirements. Findings were presented to the CORD members attending the 2008 CORD Academic Assembly, and disseminated to the broader membership through the CORD e-mail list server. Results: The following four ACGME EM Program Requirements were examined, and recommendations made: 1 The 5 hours/week conference requirement: For fully accredited programs in good standing, outcomes should be driving how programs allocate and mandate educational time. Maintain the 5 hours/week conference requirement for new programs, programs with provisional accreditation, programs in difficult political environs, and those with short accreditation cycles. If the program requirements must retain a minimum hours/week reference, future requirements should take into account varying program lengths (3 versus 4 years). 2 The 70% attendance requirement: Develop a new requirement that allows programs more flexibility to customize according to local resources, individual residency needs, and individual resident needs. 3 The requirement for synchronous versus asynchronous learning: Synchronous and asynchronous learning activities have advantages and disadvantages. The ideal curriculum capitalizes on the strengths of each through a deliberate mixture of each. 4 Educationally justified innovations: Transition from process-based program requirements to outcomes-based requirements. Conclusions: The conference requirements that were logical and helpful years ago may not be logical or helpful now. Technologies available to educators have changed, the amount of material to cover has grown, and online on-demand education has grown even more. We believe that flexibility is needed to customize EM education to suit individual resident and individual program needs, to capitalize on regional and national resources when local resources are limited, to innovate, and to analyze and evaluate interventions with an eye toward outcomes.

Legionella pneumophila infection is a recognized but rare cause of rhabdomyolysis. While the mechanism of rhabdomyolysis associated with Legionella is unknown, theories include direct invasion of Legionella into the muscle itself, or the release of its endotoxin into the circulation with subsequent muscle injury. In this case report, we describe a case of Legionella pneumonia presenting as altered mental status, high fever, and rhabdomyolysis with acute renal failure. We review the epidemiology, clinical and laboratory findings, and treatment of the disease.

Objectives: To characterize emergency medicine (EM) program directors (PDs) and compare the data, where possible, with those from other related published studies. Methods: An online survey was e-mailed in 2002 to all EM PDs of programs that were approved by the Accreditation Council of Graduate Medical Education. The survey included questions concerning demographics, work hours, support staff, potential problems and solutions, salary and expenses, and satisfaction. Results: One hundred nine of 124 (88%) PDs (69.7% university, 27.5% community, and 2.8% military) completed the survey; 85.3% were male. Mean age was 43.6 years (95% confidence interval [CI] = 42.6 to 44.7 yr). The mean time as a PD was 5.7 years (95% CI = 4.9 to 6.5 yr), with 56% serving five years or less. The mean time expected to remain as PD is an additional 6.0 years (95% CI = 5.2 to 6.8). A 1995 study noted that 50% of EM PDs had been in the position for less than three years, and 68% anticipated continuing in their position for less than five years. On a scale of 1 to 10 (with 10 as highest), the mean satisfaction with the position of PD was 8.0 (95% CI = 7.2 to 8.3). Those PDs who stated that the previous PD had mentored them planned to stay a mean of 2.0 years longer than did those who were not mentored (95% CI of difference of means = 0.53 to 3.53). Sixty-five percent of PDs had served previously as an associate PD. Most PDs (92%) have an associate or assistant PD, with 54% reporting one; 25%, two; and 9%, three associate or assistant PDs. A 1995 study noted that 62% had an associate PD. Ninety-two percent have a program coordinator, and 35% stated that they have both a residency secretary and a program coordinator. Program directors worked a median of 195 hours per month: clinical, 75 hours; scholarly activity, 20 hours; administrative, 80 hours; and teaching and residency conferences, 20 hours; compared with a median total hours of 220 previously reported. Lack of adequate time to do the job required, career needs interfering with family needs, and lack of adequate faculty help with residency matters were identified as the most important problems (means of 3.5 [95% CI = 3.2 to 3.7], 3.4 [95% CI = 3.2 to 3.6], and 3.1 [95% CI = 2.9 to 3.3], respectively, on a scale of 1 to 5, with 5 as maximum). This study identified multiple resources that were found to be useful by >50% of PDs, including national meetings, lectures, advice from others, and self-study. Conclusions: Emergency medicine PDs generally are very satisfied with the position of PD, perhaps because of increased support and resources. Although PD turnover remains an issue, PDs intend to remain in the position for a longer period of time than noted before this study. This may reflect the overall satisfaction with the position as well as the increased resources and support now available to the PD. PDs have greater satisfaction if they have been mentored for the position.

Introduction: Emergency medicine residents use simulation training for many reasons, such as gaining experience with critically ill patients and becoming familiar with disease processes. Residents frequently criticize simulation training using current high-fidelity mannequins due to the poor quality of physical exam findings present, such as auscultatory findings, as it may lead them down an alternate diagnostic or therapeutic pathway. Recently wireless remote programmed stethoscopes (simulation stethoscopes) have been developed that allow wireless transmission of any sound to a stethoscope receiver, which improves the fidelity of a physical examination and the simulation case. Methods: Following institutional review committee approval, 14 PGY1-3 emergency medicine residents were assessed during 2 simulation-based cases using pre-defined scoring anchors on multiple actions, such as communication skills and treatment decisions (Appendix 1). Each case involved a patient presenting with dyspnea requiring management based off physical examination findings. One case was a patient with exacerbation of heart failure, while the other was a patient with a tension pneumothorax. Each resident was randomized into a case associated with the simulation stethoscope. Following the cases residents were asked to fill out an evaluation questionnaire. Results: Residents perceived the most realistic physical exam findings on those associated with the case using the simulation stethoscope (13/14, 93%). Residents also preferred the simulation stethoscope as an adjunct to the case (13/14, 93%), and they rated the simulation stethoscope case to have significantly more realistic auscultatory findings (4.4/5 vs. 3.0/5 difference of means 1.4, P = 0.0007). Average scores of residents were significantly better in the simulation stethoscope-associated case (2.5/3 vs. 2.3/3 difference of means 0.2, P = 0.04). There was no considerable difference in the total time taken per case.Conclusion: A simulation stethoscope may be a useful adjunct to current emergency medicine simulation-based training. Residents both preferred the use of the simulation stethoscope and perceived physical exam findings to be more realistic, leading to improved fidelity. Potential sources of bias include the small population, narrow scoring range, and the lack of blinding. Further research, focusing on use for resident assessment and clinical significance with a larger population and blinding of graders, is needed. [West J Emerg Med. 2013;14(3):275–277.]

Objectives The Accreditation Council for Graduate Medical Education (ACGME) Milestones describe behavioral markers for the progressive acquisition of competencies during residency. As a key component of the Next Accreditation System, all residents are evaluated for the acquisition of specialty-specific Milestones. The objective was to determine the validity and reliability of the emergency medicine (EM) Milestones. Methods The ACGME and the American Board of Emergency Medicine performed this single-event observational study. The data included the initial EM Milestones performance ratings of all categorical EM residents submitted to the ACGME from October 31, 2013, to January 6, 2014. Mean performance ratings were determined for all 23 subcompetencies for every year of residency training. The internal consistency (reliability) of the Milestones was determined using a standardized Cronbach's alpha coefficient. Exploratory factor analysis was conducted to determine how the subcompetencies were interrelated. Results EM Milestone performance ratings were obtained on 100% of EM residents (n = 5,805) from 162 residency programs. The mean performance ratings of the aggregate and individual subcompetency scores showed discrimination between residency years, and the factor structure further supported the validity of the EM Milestones. The reliability was α = 0.96 within each year of training. Conclusions The EM Milestones demonstrated validity and reliability as an assessment instrument for competency acquisition. EM residents can be assured that this evaluation process has demonstrated validity and reliability; faculty can be confident that the Milestones are psychometrically sound; and stakeholders can know that the Milestones are a nationally standardized, objective measure of specialty-specific competency acquisition.

In the Original Research article entitled “Correlation of the National Board of Medical Examiners Advanced Clinical Examination in Emergency Medicine and the National Emergency Medicine M4 Exams,” published in the January 2015 issue of the Western Journal of Emergency Medicine (2015;16(1):138–142. DOI: 10.5811/westjem.2014.11.24189), there were the following errors in the published article: On page 138, the 1st line of the results section of the abstract should read: 305 students took the EM-ACE and versions 1 (V1) or 2 (V2) of the EM M4 exams (281 and 24, respectively). On page 138, the 2nd line of the results section of the abstract should read: The mean percent correct for the exams were as follows: EM-ACE 74.9 (SD-9.82), V1 83.0 (SD-6.39), V2 78.5 (SD-7.70). On page 138, the 3rd line of the results section of the abstract should read: Pearson’s correlation coefficient for the V1/EM-ACE was 0.53 (0.43 scaled) and for the V2/EM-ACE was 0.58 (0.41 scaled). On page 138, the 4th line of the results section of the abstract should read: The coefficient of determination for V1/EM-ACE was 0.73 and for V2/EM-ACE 0.71 (0.65 and .49 for scaled scores) [ERRATUM]. The R-squared values were 0.28 and 0.30 (0.18 and 0.13 scaled), respectively. On page 140, the 1st line of the results section should read: Five institutions administered both the NBME EM-ACE and one version of the EM M4 exam to 305 fourth-year students at the end of their EM rotation. V1 of the EM M4 was administered to 281 students, and V2 to 24 students. On page 140, the fifth sentence of the results section should read: The mean NBME scaled score for the entire cohort was 68.3 (SD-9.66). On page 141 in the table, the Pearson’s Correlation coefficient for “NBME (raw) V1 EM M4” should be 0.53 and “NBME (scaled) V1 EM M4” 0.43. On page 141 in the table, the R-squared value for “NBME (raw) V1 EM M4” should be 0.28. The correct Figures for “Figure 1” and Figure 2” on page 140 are shown on the following page: Figure 1 Correlation of NBME EM-ACE and National EM M4 V1 and V2. Figure 2 Correlation of NBME EM-ACE and National EM M4 V1 and V2. We apologize for this error.

Background The Next Accreditation System (NAS) is being implemented by the Accreditation Council for Graduate Medical Education with seven specialties, including Emergency Medicine (EM), which began in July 2013. The NAS represents a more structured method of accreditation, with dependence on outcomes and less emphasis on educational process. A key component of the NAS is the individual resident semiannual reporting of the Milestone proficiency levels for all sub-competencies, which are more specific areas of domain for the general competencies. All specialties are struggling to some extent with developing assessment mechanisms for the Milestones. At the heart of this struggle is the conceptualization of the Milestones themselves-descriptors of the individual. In practice, faculty assess clinical care provided to the patient by the resident. This creates difficulty for faculty to assign a resident to a specific sub-competency proficiency level when their focus has been on assessment of clinical care. Objectives The objectives of this article include the discussion of whether Entrustable Professional Activities (EPAs) could be defined and linked to milestones in a way that, once implemented, could inform Clinical Competency Committees of the Milestone proficiency reporting. Discussion EPAs are units of professional work, or clinical care that may help translate aspects of clinical care into Milestone proficiencies. This article explores EPAs in depth, and discusses how EPAs may be used within EM as one method of assigning proficiency levels to residents. Conclusions EPAs may be a useful tool to inform Milestone proficiency placement of residents. Because EPAs are based on clinical descriptions rather than individual physician descriptions, there may be less faculty development needed for Milestone sub-competency assessment.

The Accreditation Council for Graduate Medical Education (ACGME) has outlined its "Next Accreditation System" (NAS) that will focus on resident and residency outcome measurements. Emergency medicine (EM) is one of seven specialties that will implement the NAS beginning July 2013. All other specialties will follow in July 2014. A key component of the NAS is the development of assessable milestones, which are explicit accomplishments or behaviors that occur during the process of residency education. Milestones describe competencies more specifically and identify specialty-specific knowledge, skills, attitudes, and behaviors (KSABs) that can be used as outcome measures within the general competencies. The ACGME and the American Board of Emergency Medicine (ABEM) convened an EM milestone working group to develop the EM milestones. This article describes the development, use within the NAS, and challenges of the EM milestones.

Background A National Board of Medical Examiners examination does not exist for Emergency Medicine (EM) students. To fill this void, the Clerkship Directors in Emergency Medicine tasked a committee with development of an examination for 4th-year (M4) EM students, based on a published syllabus, and consisting of questions written according to published question-writing guidelines. Study Objectives Describe examination development and statistics at 9 months. Methods The committee reviewed an existing EM student question database at www.saemtests.org for statistical performance, compliance with item-writing guidelines, and topic inclusion within the published EM M4 syllabus. For syllabus topics without existing questions, committee members wrote new items. LXR 6.0 software (Applied Measurement Professionals, Inc., Georgetown, SC) was used for examination administration. Data gathered included numbers of examinations completed, mean scores with SD, and point biserial correlation (rpb). Results Of the 553 questions assessed, 157 questions met the stated criteria, and 37 were included in the examination. Thirteen new questions were written by committee members to cover all curriculum topics. The National EM M4 Examination was released online August 1, 2011. Nine months later, the examination had been completed 1642 times by students from 27 clerkships. Mean score was 79.69% (SD 3.89). Individual question difficulties ranged from 26% to 99%. Question rpbs ranged from 0.067 to 0.353, mean 0.213 (SD 0.066). Conclusions A national group of EM educators developed an examination to assess a published clerkship syllabus. The examination contains questions written according to published item-writing guidelines, and exhibits content validity, appropriate difficulty levels, and adequate question discriminatory ability.

Skin necrosis is an uncommon complication of warfarin (Coumadin; Dupont Pharma, Wilmington, DE) therapy. The presentation may mimic other disorders. This article reports a case of a 72-year-old woman who presented to the emergency department complaining of swelling and ecchymosis to her left breast and right foot. The patient had been hospitalized for coronary artery bypass grafting, and had been discharged from the hospital earlier that day. This article reviews the pathophysiology and clinical features of warfarin-induced skin necrosis.

Acute myocardial infarction associated with ventricular septal defect (VSD) occurs infrequently. When a patient with an acquired VSD presents to the emergency department (ED), prompt recognition is required because definitive treatment can greatly decrease mortality. We present the case of a 75-year-old woman with an acute myocardial infarction and a new heart murmur. The diagnosis of acquired VSD was made by echocardiography in the ED, and emergency surgical correction was arranged.

Intussusception is a rare cause of abdominal pain in adults. It occurs in fewer than 1% of all cases of adult small bowel obstruction. In the adult population, most cases are the result of some type of intestinal lesion like adhesions, melanomas, lipomas or adenomatous polyps. Idiopathic intussusceptions are an extremely rare occurrence in adults, comprising only 2-23% of diagnosed intussusceptions. This report describes two cases of transient, idiopathic adult jejunal intussusception in a 19-year-old woman and a 39-year-old man, both presenting to the same hospital 1 week apart. Both patients complained of nonspecific abdominal pain and nausea and were diagnosed with intussusception by computed tomography (CT) scan. In both cases, no underlying bowel abnormality was identified and neither required a bowel resection. This report discusses the common presentation, diagnosis, and treatment of adult intussusception and questions whether patients with transient intussusceptions require exploratory laparotomy.

Education research in emergency medicine has made some advances, but still suffers from poorly designed studies and isolated projects that are small and cannot be generalized to other institutions. This commentary argues for the need of an emergency medicine education research group (EMERG). EMERG would facilitate and coordinate better quality educational research projects at multiple institutions. This in turn would promote faculty development in education research and potentially result in improved educational outcomes and patient care.

Dislocations of the shoulder are the most common joint dislocations seen in the emergency department, and complications of shoulder dislocations are more frequent than is generally believed. It is vital that emergency physicians have current knowledge of complications associated with shoulder dislocations because of their important role in recognition and prevention. Delayed recognition of complications can have an impact on the long-term outcome of patients. Prompt recognition and follow-up are essential. Most references address reduction methods rather than recognition of specific complications. Emergency physicians have few opportunities to update their knowledge of complications of shoulder dislocations. This article briefly reviews mechanisms of shoulder dislocation and discusses complications in light of the mechanisms of injury.

Milestones are the most recent development in evaluating resident performance. Each specialty has developed milestones appropriate for the unique specialty. The development of milestones for emergency medicine has been a careful, deliberate and well considered process to better define the work of an emergency physician and the progress of an emergency physician in training.