Search

Introduction Over the past decade, the growth of accelerated three-year MD (3YMD) programs has flourished. In 2015, with support from the Josiah Macy Jr. Foundation, the Consortium of Medical Pathway Programs (CAMPP) started with eight North American medical schools. The objective of this paper is to evaluate the current state of the 3YMD programs.Material and Methods Since 2015, the CAMPP has tracked new and prospective 3YMD programs. An electronic survey collecting curricular and programmatic information about the programs was disseminated to all members of the CAMPP in August 2023. The survey included elements related to year of initiation, number of graduates, and curricular elements.Results Of the schools with known established three-year MD programs, 29 of 32 programs responded (response rate 90%). There is growth of Accelerated Medical Pathway Programs over time with almost 20% of United States Allopathic Medical Schools having or developing an accelerated program. There have been 817 graduates from these programs from 2013–2023. Most schools include an opportunity for a ‘directed pathway’ experience for students. A directed pathway is where a student completes the MD degree in three-years and then has a direct placement into an affiliated residency program, provided they meet the goals and objectives of the curriculum. Most of the schools report a mission to reduce medical student debt and build a workforce for a specialty, for a population of patients, or geographical distribution.Conclusions Accelerated three-year medical pathway programs have grown significantly over the last decade, consistent with an overall effort to redesign medical curricula, reduce debt and contribute to the workforce.

Abstract Objectives: The American Board of Emergency Medicine (ABEM) requires a written examination (the Qualifying Examination) followed by the Oral Certifying Examination (OCE) to obtain ABEM certification. Maintaining ABEM certification is associated with fewer state medical board (SMB) disciplinary actions. We sought to determine the association between poor initial performance on the OCE and subsequent severe SMB disciplinary action. Methods We included physicians who completed US categorical emergency medicine residencies in 2016 and earlier. We classified OCE performance as good (passed on first attempt) and poor (never passed or required > 1 attempt to pass). We obtained data on physician SMB disciplinary actions from the National Practitioner Data Bank that were limited to actions that denied licensure or altered the status of a medical license (eg, suspension). We determined the association between poor OCE performance and subsequent severe SMB disciplinary action. Results Of 34,871, 93.5% passed the OCE on the first attempt, 6.1% required multiple attempts, and 0.3% never passed. Of the physicians (93.5%) with good OCE performance, 1.0% received a severe SMB action. Among physicians with poor OCE performance, 2.3% received a severe action; and of those who never passed, 1.7% received a severe action (Table 1). Poor OCE performance was associated with an increased odds of severe SMB disciplinary action (OR 2.21, 95% CI: 1.57–3.12). Conclusion Physicians with poor OCE performance exhibited higher odds of experiencing a subsequent severe SMB disciplinary action. The OCE may have utility as a predictor of future professionalism or clinical performance.

BackgroundThe rapid trajectory of artificial intelligence (AI) development and advancement is quickly outpacing society's ability to determine its future role. As AI continues to transform various aspects of our lives, one critical question arises for medical education: what will be the nature of education, teaching, and learning in a future world where the acquisition, retention, and application of knowledge in the traditional sense are fundamentally altered by AI? ObjectiveThe purpose of this perspective is to plan for the intersection of health care and medical education in the future. MethodsWe used GPT-4 and scenario-based strategic planning techniques to craft 4 hypothetical future worlds influenced by AI's integration into health care and medical education. This method, used by organizations such as Shell and the Accreditation Council for Graduate Medical Education, assesses readiness for alternative futures and effectively manages uncertainty, risk, and opportunity. The detailed scenarios provide insights into potential environments the medical profession may face and lay the foundation for hypothesis generation and idea-building regarding responsible AI implementation. ResultsThe following 4 worlds were created using OpenAI’s GPT model: AI Harmony, AI conflict, The world of Ecological Balance, and Existential Risk. Risks include disinformation and misinformation, loss of privacy, widening inequity, erosion of human autonomy, and ethical dilemmas. Benefits involve improved efficiency, personalized interventions, enhanced collaboration, early detection, and accelerated research. ConclusionsTo ensure responsible AI use, the authors suggest focusing on 3 key areas: developing a robust ethical framework, fostering interdisciplinary collaboration, and investing in education and training. A strong ethical framework emphasizes patient safety, privacy, and autonomy while promoting equity and inclusivity. Interdisciplinary collaboration encourages cooperation among various experts in developing and implementing AI technologies, ensuring that they address the complex needs and challenges in health care and medical education. Investing in education and training prepares professionals and trainees with necessary skills and knowledge to effectively use and critically evaluate AI technologies. The integration of AI in health care and medical education presents a critical juncture between transformative advancements and significant risks. By working together to address both immediate and long-term risks and consequences, we can ensure that AI integration leads to a more equitable, sustainable, and prosperous future for both health care and medical education. As we engage with AI technologies, our collective actions will ultimately determine the state of the future of health care and medical education to harness AI's power while ensuring the safety and well-being of humanity.

Abstract Objective This study compares performance data from physicians completing 3‐year versus 4‐year emergency medicine residency training programs. Currently, there are 2 training formats and little is known about objective performance differences. Methods This was a retrospective cross‐sectional analysis of emergency residents and physicians. Multiple analyses were conducted comparing physicians’ performances, including Accreditation Council of Graduate Medical Education Milestones and American Board of Emergency Medicine In‐training Examination (ITE), Qualifying Examination (QE), Oral Certification Examination (OCE), and program extensions from 3‐year and 4‐year residency programs. Some confounding variables were not or could not be considered, such as rationale for medical students to choose one format over another, as well as application and final match rates. Results Milestone scores are higher for emergency medicine 3 residents in 1‐3 programs (3.51) versus emergency medicine 3 residents in 1‐4 programs (3.07; P

Human trafficking is an ongoing, global human rights crisis and one of the largest illicit industries worldwide. Although there are thousands of victims identified each year within the United States, the true extent of this problem remains unknown due to the paucity of data. Many victims seek care in the emergency department (ED) while being trafficked but are often not identified by clinicians due to lack of knowledge or misconceptions about trafficking. We present a case of an ED patient being trafficked in Appalachia as an educational stimulus and discuss several unique aspects of trafficking in rural communities, including lack of awareness, prevalence of familial trafficking, high rates of poverty and substance use, cultural differences, and a complex highway network system. The lack of data, appropriate resources, and training for healthcare professionals also poses distinct issues. We propose an approach to identify and treat victims of human trafficking in the ED, with a focus on rural EDs. This approach includes improving data collection and availability on local patterns of trafficking, improving clinician training in identification, and care of victims using trauma-informed techniques. While this case illustrates unique features of human trafficking in the Appalachian region, many of these themes are common to rural areas across the US. Our recommendations emphasize strategies to adapt evidence-based protocols, largely designed in and for urban EDs, to rural settings where clinicians may be less familiar with human trafficking.

Abstract Background Emergency pediatric care curriculum (EPCC) was developed to address the need for pediatric rapid assessment and resuscitation skills among out-of-hospital emergency providers in Armenia. This study was designed to evaluate the effectiveness of EPCC in increasing physicians’ knowledge when instruction transitioned to local instructors. We hypothesize that (1) EPCC will have a positive impact on post-test knowledge, (2) this effect will be maintained when local trainers teach the course, and (3) curriculum will satisfy participants. Methods This is a quasi-experimental, pre-test/post-test study over a 4-year period from October 2014‑November 2017. Train-the-trainer model was used. Primary outcomes are immediate knowledge acquisition each year and comparison of knowledge acquisition between two cohorts based on North American vs local instructors. Descriptive statistics was used to summarize results. Pre-post change and differences across years were analyzed using repeated measures mixed models. Results Test scores improved from pretest mean of 51% (95% CI 49.6 to 53.0%) to post-test mean of 78% (95% CI 77.0 to 79.6%, p

Emergency physicians (EP) make clinical decisions multiple times daily. In some instances, medical errors occur due to flaws in the complex process of clinical reasoning and decision-making. Cognitive error can be difficult to identify and is equally difficult to prevent. To reduce the risk of patient harm resulting from errors in critical thinking, it has been proposed that we train physicians to understand and maintain awareness of their thought process, to identify error-prone clinical situations, to recognize predictable vulnerabilities in thinking, and to employ strategies to avert cognitive errors. The first step to this approach is to gain an understanding of how physicians make decisions and what conditions may predispose to faulty decision-making. We review the dual-process theory, which offers a framework to understand both intuitive and analytical reasoning, and to identify the necessary conditions to support optimal cognitive processing. We also discuss systematic deviations from normative reasoning known as cognitive biases, which were first described in cognitive psychology and have been identified as a contributing factor to errors in medicine. Training physicians in common biases and strategies to mitigate their effect is known as debiasing. A variety of debiasing techniques have been proposed for use by clinicians. We sought to review the current evidence supporting the effectiveness of these strategies in the clinical setting. This discussion of improving clinical reasoning is relevant to medical educators as well as practicing EPs engaged in continuing medical education.

Introduction: Scholarship and academic networking are essential for promotion and productivity. To develop education scholarship, the Council of Emergency Medicine Directors (CORD) and Clerkship Directors of Emergency Medicine (CDEM) created an annual Special Issue in Educational Research and Practice of the Western Journal of Emergency Medicine. The objective of this study was to evaluate the network created by the special Issue, and explore changes within the network over time. Methods: Researchers used bibliometric data from Web of Science to create a social network analysis of institutions publishing in the first four years of the special issue using UCINET software. We analyzed whole-network and node-level metrics to describe variations and changes within the network. Results: One hundred and three (56%) Accreditation Council for Graduate Medical Education-accredited emergency medicine programs were involved in 136 articles. The majority of institutions published in one or two issues. Nearly 25% published in three or four issues. The network analysis demonstrated that the mean number of connections per institution increased over the four years (mean of 5.34; standard deviation [SD] 1.27). Mean degree centralization was low at 0.28 (SD 0.05). Network density was low (mean of 0.09; SD 0.01) with little change across four issues. Five institutions scored consistently high in betweenness centrality, demonstrating a role as connectors between institutions within the network and the potential to connect new members to the network. Conclusion: Network-wide metrics describe a consistently low-density network with decreasing degree centralization over four years. A small number of institutions within the network were persistently key players in the network. These data indicate that, aside from core institutions that publish together, the network is not widely connected. There is evidence that new institutions are coming into the network, but they are not necessarily connected to the core publishing groups. There may be opportunities to intentionally increase connections across the network and create new connections between traditionally high-performing institutions and newer members of the network. Through informal discussions with authors from high-performing institutions, there are specific behaviors that departments may use to promote education scholarship and forge these new connections.

Introduction: Healthcare systems often expose patients to significant, preventable harm causing an estimated 44,000 to 98,000 deaths or more annually. This has propelled patient safety to the forefront, with reporting systems allowing for the review of local events to determine their root causes. As residents engage in a substantial amount of patient care in academic emergency departments, it is critical to use these safety event reports for resident-focused interventions and educational initiatives. This study analyzes reports from the Virginia Commonwealth University Health System to understand how the reports are categorized and how it relates to opportunities for resident education. Methods: Identifying categories from the literature, three subject matter experts (attending physician, nursing director, registered nurse) categorized an initial 20 reports to resolve category gaps and then 100 reports to determine inter-rater reliability. Given sufficient agreement, the remaining 400 reports were coded individually for type of event and education among other categories. Results: After reviewing 513 events, we found that the most common event types were issues related to staff and resident training (25%) and communication (18%), with 31% requiring no education, 46% requiring directed educational feedback to an individual or group, 20% requiring education through monthly safety updates or meetings, 3% requiring urgent communication by email or in-person, and

Mistreatment of trainees is common in the clinical learning environment. Resident mistreatment is less frequently tracked than medical student mistreatment, but data suggest mistreatment remains prevalent at the resident level. To address resident mistreatment, the authors developed an Educational Advance to engage emergency medicine residents and faculty in understanding and improving their learning environment. The authors designed a small-group session with the following goals: 1) Develop a shared understanding of mistreatment and its magnitude; 2) Recognize the prevalence of resident mistreatment data and identify the most common types of mistreatment; 3) Relate study findings to personal or institutional experiences; and 4) Generate strategies for combating mistreatment and strengthening the clinical learning environment at their home institutions. Design was a combination of presentation, small group discussion, and facilitated discussion. Results were presented to participants from a previously administered survey of resident mistreatment. Public humiliation and sexist remarks were the most commonly reported forms. Faculty were the most frequent perpetrators, followed by residents and nurses. A majority of respondents who experienced mistreatment did not report the incident. Session participants were then asked to brainstorm strategies to combat mistreatment. Participants rated the session as effective in raising awareness about resident mistreatment and helping departments develop methods to improve the learning environment. Action items proposed by the group included coaching residents about how to respond to mistreatment, displaying signage in support of a positive learning environment, zero tolerance for mistreatment, clear instructions for reporting, and intentionality training to improve behavior.

Introduction: Leading change effectively is critical to advancing medical education. Residency didactics often require change in order to meet stakeholder’s needs. Kotter’s change management model (KCMM) is an 8-step method for implementing change that can be applied to educational initiatives. This innovation improved an emergency medicine residency didactics curriculum through application of KCMM. Methods: An initiative to improve residency didactics curriculum was titled the “Didactics Revolution” and implemented according to KCMM: establish a sense of urgency, form a powerful guiding coalition, create a vision, communicate the vision, empower others to act on the vision, plan for and create short-term wins, consolidate improvements and produce still more change, and institutionalize new approaches. Data from the Annual Program Review was utilized to assess the impact of the KCMM strategy. Results: The percentage of residents who agreed or strongly agreed that lectures provide a valuable learning experience increased from 39.1% in the year prior to 88.0% in the year during the implementation (p < .001), and remained relatively high at 73.5% in the year following. The percentage of residents who agreed or strongly agreed that they felt well-prepared for the written boards increased from 60.9% in the year prior to 92.0% in the year during the implementation (p = .01) and remained high at 73.5% in the year following. Conclusion: Residency didactics can be improved through the use of KCMM, a change management model originally developed in the corporate context.

Introduction: Forming effective networks is important for personal productivity and career development. Although critical for success, these networks are not well understood. The objective of this study was to usze a social network analysis tool to demonstrate the growth of institutional publication networks for education researchers and show how a single institution has expanded its publication network over time. Methods: Publications from a single institution’s medical education research group (MERG) were pulled since its inception in 2010 to 2019 using Web of Science to collect publication information. Using VOSViewer software, we formed and plotted a network sociogram comparing the first five years to the most recent 4.25 years to compare the institutions of authors from peer reviewed manuscripts published by this group. Results: We found 104 peer-reviewed research articles, editorials, abstracts, and reviews for the MERG authors between 2010 and 2019 involving 134 unique institutions. During 2010–2014, there were 26 publications involving 56 institutions. From 2015–2019, there were 78 publications involving 116 unique institutions. Conclusion: This brief report correlates successful research productivity in medical education with the presence of increased inter-institutional collaborations as demonstrated by network sociograms. Programs to intentionally expand collaborative networks may prove to be an important element of facilitating successful careers in medical education scholarship.

Introduction: In 2015, with a stated goal of disseminating best teaching practices and developing a community of educational scholars, the Council of Emergency Medicine Directors (CORD) and the Clerkship Directors of Emergency Medicine (CDEM) created an annual Special Issue in Educational Research and Practice (Special Issue) in cooperation with the Western Journal of Emergency Medicine. The intention of this study was to analyze the impact of this effort to date. Methods: Bibliometric data was gathered on all four special issues, 2015–2019, from the Web of Science and then verified with the eScholarship website. Authorship, academic affiliation, date published, article type, and format were tabulated for descriptive analysis. Using metrics from Google Scholar, alternative scholarly impact metrics (altmetrics), and the eScholarship website, the authors identified top articles and grouped them into themes. Results: Of the 136 articles included in the first four years of the Special Issue, 126 represented peer-reviewed publications with an overall acceptance rate of 25.0% (126/505). Authors from this cohort represented 103 of the 182 (56.6%) Accreditation Council for Graduate Medical Education (ACGME) programs in existence at the time of the inaugural issue. Multi-institutional studies represented 34.9% (44/126) of the peer-reviewed publications. Traditional and alternative publication metrics are reported to assess the impact of articles from the Special Issues. Conclusion: The Special Issue is a proven outlet to share best practices, innovations, and research related to education. Additionally, the infrastructure of this process promotes the development of individual faculty and a community of teaching scholars.

Introduction: Audience response systems (ARS) are increasingly popular; however, their contribution to education is not completely clear. Our study found that scores from review quizzes delivered by an ARS correlate with in-training exam (ITE) scores and are viewed positively by residents. This information may be useful in identifying poor performers early so that targeted educational interventions can be made. The objective was to determine if scores on review quizzes delivered by an ARS correlate with ITE scores and to obtain participant feedback on use of the ARS for ITE preparation. Methods: This was a prospective observational study of emergency medicine (EM) residents at six accredited EM residency programs. Subjects included residents who had taken previous ITEs. Subjects participated in bimonthly review sessions using an ARS. Twelve review quizzes were administered, each consisting of 10 multiple-choice questions. After the ITE, subjects completed an attitudinal survey consisting of six Likert-scale items and one “yes/no” item. We used a mixed linear model to analyze the data, accounting for prior 2012 ITE scores and nesting due to institution. Results: Among 192 participants, 135 (70.3%) completed the ITE in both 2012 and 2013; we analyzed their data for the first objective. Results from the mixed linear model indicate that the total mean score on the review quizzes was a significant [t(127) = 6.68; p < 0.001] predictor of the 2013 ITE after controlling for the 2012 ITE score. One hundred forty-six (76.0%) participants completed the attitudinal survey; 96% of respondents stated that they would like ARS to be used more often in resident education. Respondents felt the sessions aided in learning (mean 7.7/10), assisted in preparation for the ITE (mean 6.7/10), and helped identify content areas of weakness (mean 7.6/10). Conclusion: Our results suggest that scores from review quizzes delivered by an audience response system correlate with in-training exam scores and is viewed positively by residents. [West J Emerg Med. 2017;18(3)525-530.]

Recognizing the profound impact that emergency medicine residency graduates have on the quality of the emergency care of children, residency training programs must provide a broad clinical eScholarship provides open access, scholarly publishing services to the University of California and delivers a dynamic research platform to scholars worldwide. experience and training in pediatric care. Traditionally, part of this training has included a hospital ward rotation in inpatient pediatrics. However, these experiences may be perceived by learners as being educationally low-yield in terms of direct applicability to the practice of emergency medicine. This educational innovation describes the development of a novel curriculum for teaching pediatrics to emergency medicine residents. Rather than focusing on tasks disconnected from emergency medicine practice, residents provide the initial clinical care for patients in the emergency department in a professional setting situated to mirror their ultimate professional practice. The innovation involves longitudinal patient follow-up, with mentored supervision and discussion to reinforce learning. The curriculum includes dedicated Pediatric ED time, deliberate inpatient and phone follow-up, ward rounds, focused pediatric topics, and direct observation assessment and feedback on pediatric clinical skills. This novel curriculum emphasizes the importance of situated learning, and is one component of a longitudinal teaching plan for pediatrics within an emergency medicine residency.

Introduction: Problem residents are common in graduate medical education, yet little is known about their characteristics, deficits, and the consequences for emergency medicine (EM) residencies. The American Board of Internal Medicine (ABIM) defines a problem resident as “a trainee who demonstrates a significant enough problem that requires intervention by someone of authority, usually the program director [PD] or chief resident.” Although this is a comprehensive definition, it lacks specificity. Our study seeks to add granularity and nuance to the definition of “problem resident,” which can be used to guide the recruitment, selection, and training of residents. Methods: We conducted semi-structured interviews with a convenience sample of EM PDs between 2011 and 2012. We performed qualitative analysis of the resulting transcripts with our thematic analysis based on the principles of grounded theory. We reached thematic sufficiency after 17 interviews. Interviews were coded as a team through consensus. Results: The analysis identified diversity in the type, severity, fixability, and attribution of problems among problem residents. PDs applied a variety of thresholds to define a problem resident with many directly rejecting the ABIM definition. There was consistency in defining academic problems and some medical problems as “fixable.” In contrast, personality problems were consistently defined as “non-fixable.” Despite the diversity of the definition, there was consensus that residents who caused “turbulence” were problem residents. Conclusion: The ABIM definition of the problem resident captures trainees who many PDs do not consider problem residents. We propose that an alternative definition of the problem resident would be “a resident with a negative sphere of influence beyond their personal struggle.” This combination acknowledges the identified themes of turbulence and the diversity of threshold. Further, the combination of PDs’ unwillingness to terminate trainees and the presence of non-fixable problems implies the need for a “front-door” solution that emphasizes personality issues at the potential expense of academic potential. This “front-door” solution depends on the commitment of all stakeholders including medical schools, the Association of American Medical Colleges, and PDs.

Obtaining grant funding is a fundamental component to achieving a successful research career. A successful grant application needs to meet specific mechanistic expectations of reviewers and funders. This paper provides an overview of the importance of grant funding within medical education, followed by a stepwise discussion of strategies for creating a successful grant application for medical education-based proposals. The last section includes a list of available medical education research grants.

Introduction: This study investigates the impact of the Doximity rankings on the rank list choices made by residency applicants in emergency medicine (EM). Methods: We sent an 11-item survey by email to all students who applied to EM residency programs at four different institutions representing diverse geographical regions. Students were asked questions about their perception of Doximity rankings and how it may have impacted their rank list decisions. Results: Response rate was 58% of 1,372 opened electronic surveys. This study found that a majority of medical students applying to residency in EM were aware of the Doximity rankings prior to submitting rank lists (67%). One-quarter of these applicants changed the number of programs and ranks of those programs when completing their rank list based on the Doximity rankings (26%). Though the absolute number of programs changed on the rank lists was small, the results demonstrate that the EM Doximity rankings impact applicant decision-making in ranking residency programs. Conclusion: While applicants do not find the Doximity rankings to be important compared to other factors in the application process, the Doximity rankings result in a small change in residency applicant ranking behavior. This unvalidated ranking, based principally on reputational data rather than objective outcome criteria, thus has the potential to be detrimental to students, programs, and the public. We feel it important for specialties to develop consensus around measurable training outcomes and provide freely accessible metrics for candidate education.

Introduction The transition to more active learning during residency didactics has made the skill of managing difficult learner behaviors essential: Just one learner exhibiting difficult behavior can derail the educational experience for the room. Many educators feel uncomfortable handling these learners in real time and after the session. Methods We created an interactive session for a mixed group of educators at a medical education boot camp. After learning about a framework for addressing difficult learner behaviors, participants were paired and presented with the case of a withdrawn learner. For each pair, the cause of the behavior was different. With one of the pair role-playing the learner, they were asked to identify the problem and solutions together. Multiple etiologies for the identical behavior reinforced the need to address underlying causes to create an effective plan for behavior change. Strategies to address difficult behaviors in real time were also discussed in large-group format. Results Participants gave the session a mean score of 4.5 out of 5, indicating a high likelihood of changing their teaching practice. Free-response comments remarked on the role-play's educational value and the enjoyability of the session overall. Discussion This session was effective in giving participants a framework for dealing with difficult learner behaviors, as well as hands-on practice with these skills. While this was a short (30-minute), single session, its success with participants with a wide variety of experience levels suggests it would be highly adaptable to other settings and may benefit from future expansion into the clinical setting.

Relatively little is understood about which factors influence students' choice of specialty and when learners ultimately make this decision.The objective is to understand how experiences of medical students relate to the timing of selection of Emergency Medicine (EM) as a specialty. Of specific interest were factors such as how earlier and more positive specialty exposure may impact the decision-making process of medical students.A cross-sectional survey study of EM bound 4th year US medical students (MD and DO) was performed exploring when and why students choose EM as their specialty. An electronic survey was distributed in March 2015 to all medical students who applied to an EM residency at 4 programs representing different geographical regions. Descriptive analyses and multinomial logistic regressions were performed.793/1372 (58%) responded. Over half had EM experience prior to medical school. When students selected EM varied: 13.9% prior to, 50.4% during, and 35.7% after their M3 year. Early exposure, presence of an EM residency program, previous employment in the ED, experience as a pre-hospital provider, and completion of an M3 EM clerkship were associated with earlier selection. Delayed exposure to EM was associated with later selection of EM.Early exposure and prior life experiences were associated with choosing EM earlier in medical school. The third year was identified as the most common time for definitively choosing the specialty.

Introduction Transitioning from the pre-clinical environment to clerkships poses a challenge to students and educators alike. Students along with faculty developed the Clinical Reasoning Elective (CRE) to provide pre-clinical students exposure to patients in the emergency department and the opportunity to build illness scripts and practice clinical skills with longitudinal mentorship in a low-stakes environment before entering clerkships. It is a voluntary program. Each year, the CRE has received overwhelming positive feedback from students. The objective of this study is to determine if the CRE improved students’ clinical skills and reported comfort in their skills. Methods We examined the relationships between students’ self-reported participation in the CRE and their individual scores on a comprehensive clinical assessment (CCA) at the end of the pre-clerkship period. A total of 178 students took the CCA exam in 2016. Of these, 113 participated in the CRE and 65 did not. Seven students who participated in CRE did not complete the exit survey and were omitted from analysis. We performed regression analysis and dichotomous (participants/nonparticipants) comparisons of means with t-tests. Survey of student reactions was collected. Results Participants completed an average of 10 sessions over the course of the program (range=1–20). Involvement in the CRE was associated with significantly increased scores on Abdominal History; Pulmonary Physical Exam; Overall History-Taking; Overall Communication; and Overall Physical Exam (p

Introduction Goal setting is used in education to promote learning and performance. Debriefing after clinical scenario-based simulation is a well-established practice that provides learners a defined structure to review and improve performance. Our objective was to integrate formal learning goal generation, using the SMART framework (Specific, Measurable, Attainable, Realistic, and Time-bound), into standard debriefing processes (i.e., “SMART Goal Enhanced Debriefing”) and subsequently measure the impact on the development of learning goals and execution of educational actions. Methods This was a prospective multicenter randomized controlled study of 80 emergency medicine residents at three academic hospitals comparing the effectiveness of SMART Goal Enhanced Debriefing to a standard debriefing. Residents were block randomized on a rolling basis following a simulation case. SMART Goal Enhanced Debriefing included five minutes of formal instruction on the development of SMART learning goals during the summary/application phase of the debrief. Outcome measures included the number of recalled learning goals, self-reported executed educational actions, and quality of each learning goal and educational action after a two-week follow-up period. Results The mean number of reported learning goals was similar in the standard debriefing group (mean 2.05 goals, SD 1.13, n=37 residents), and in the SMART Goal Enhanced Debriefing group (mean 1.93, SD 0.96, n=43), with no difference in learning goal quality. Residents receiving SMART Goal Enhanced Debriefing completed more educational actions on average (Control group actions completed 0.97 (SD 0.87), SMART debrief group 1.44 (SD 1.03) p=0.03). Conclusion The number and quality of learning goals reported by residents was not improved as a result of SMART Goal Enhanced Debriefing. Residents did, however, execute more educational actions, which is consistent with the overarching intent of any educational intervention.

In just a few years of preparation, emergency medicine (EM) trainees must achieve expertise across the broad spectrum of skills critical to the practice of the specialty. Though education occurs in many contexts, much learning occurs on the job, caring for patients under the guidance of clinical educators. The cognitive apprenticeship framework, originally described in primary and secondary education, has been applied to workplace-based medical training. The framework includes a variety of teaching methods: scaffolding, modeling, articulation, reflection, and exploration, applied in a safe learning environment. Without understanding these methods within a theoretical framework, faculty may not apply the methods optimally. Here we describe a faculty development intervention during which participants articulate, share, and practice their own applications of cognitive-apprenticeship methods to learners in EM. We summarize themes identified by workshop participants, and provide suggestions for tailoring the application of these methods to varying levels of EM learners. The cognitive-apprenticeship framework allows for a common understanding of the methods used in clinical teaching toward independence. Clinical educators should be encouraged to reflect critically on their methods, while being offered the opportunity to share and learn from others.

Introduction Medical student mistreatment is a prevalent and significant challenge for medical schools across the country, associated with negative emotional and professional consequences for students. The Association of American Medical Colleges and Liaison Committee on Medical Education have increasingly emphasized the issue of mistreatment in recent years, and medical schools are tasked with creating a positive learning climate. Methods The authors describe the efforts of an emergency department (ED) to improve its clerkship learning environment, using a multifaceted approach for collecting mistreatment data and relaying them to educators and clerkship leadership. Data are gathered through end-of-rotation evaluations, teaching evaluations, and an online reporting system available to medical students. Mistreatment data are then relayed to the ED during semi-annual meetings between clerkship leadership and medical school assistant deans, and through annual mistreatment reports provided to department chairs. Results Over a two-year period, students submitted a total of 56 narrative comments related to mistreatment or unprofessional behavior during their emergency medicine (EM) clerkship. Of these comments, 12 were submitted in 2015–16 and 44 were submitted in 2016–17. The most frequently observed themes were students feeling ignored or marginalized by faculty (14 comments); students being prevented from speaking or working with patients and/or attending faculty (11 comments); and students being treated in an unprofessional manner by staff (other than faculty, 8 comments). Conclusion This article details an ED’s efforts to improve its EM clerkship learning environment by tracking mistreatment data and intentionally communicating the results to educators and clerkship leadership. Continued mistreatment data collection and faculty development will be necessary for these efforts to have a measurable effect on the learning environment.

Introducation It is essential for faculty to receive feedback on their teaching for the purpose of improvement as well as promotion. It can be challenging to motivate students to provide feedback to preceptors and fill out evaluation forms when not a clerkship requirement. Furthermore, there is concern that making the evaluations a requirement can compromise the quality of the feedback. The objective of this study was to identify an increase in the number of faculty and resident evaluations completed by students rotating through their Emergency Medicine clerkship following the implementation of a tit-for-tat incentive strategy. Method Prior to the implementation of Tit-for-Tat, students rotating through their emergency medicine clerkship were asked to fill out evaluations of residents and faculty members with whom they worked. These were encouraged but voluntary. Beginning in the 2014–2015 academic year, a tit-for-tat strategy was employed whereby students had to complete a resident or faculty evaluation in order to view the student assessment completed by that resident or faculty preceptor. Results Students submitted 1101 evaluations in the control, with a mean of 3.60 evaluations completed per student and 3.77 evaluations received per preceptor. Following the implementation of tit-for-tat, students submitted 2736 evaluations, with a mean of 8.19 evaluations completed per student and 7.52 evaluations received per preceptor. Both the increase in evaluations completed per student and evaluations received per preceptor were statistically significant with p-value

Introduction: Choosing a residency program is a stressful and important decision. Doximity released residency program rankings by specialty in September 2014. This study sought to investigate the impact of those rankings on residency application choices made by fourth year medical students. Methods: A 12-item survey was administered in October 2014 to fourth year medical students at three schools. Students indicated their specialty, awareness of and perceived accuracy of the rankings, and the rankings’ impact on the programs to which they chose to apply. Descriptive statistics were reported for all students and those applying to Emergency Medicine (EM). Results: A total of 461 (75.8%) students responded, with 425 applying in one of the 20 Doximity ranked specialties. Of the 425, 247 (58%) were aware of the rankings and 177 looked at them. On a 1-100 scale (100=very accurate), students reported a mean ranking accuracy rating of 56.7 (SD 20.3). Forty-five percent of students who looked at the rankings modified the number of programs to which they applied. The majority added programs. Of the 47 students applying to EM, 18 looked at the rankings and 33% changed their application list with most adding programs. Conclusion: The Doximity rankings had real effects on students applying to residencies as almost half of students who looked at the rankings modified their program list. Additionally, students found the rankings to be moderately accurate. Graduating students might benefit from emphasis on more objective characterization of programs to assess in light of their own interests and personal/career goals

Introduction: Faculty educational contributions are hard to quantify, but in an era of limited resources it is essential to link funding with effort. The purpose of this study was to determine the feasibility of an educational value unit (EVU) system in an academic emergency department and to examine its effect on faculty behavior, particularly on conference attendance and completion of trainee evaluations. Methods: A taskforce representing education, research, and clinical missions was convened to develop a method of incentivizing productivity for an academic emergency medicine faculty. Domains of educational contributions were defined and assigned a value based on time expended. A 30-hour EVU threshold for achievement was aligned with departmental goals. Targets included educational presentations, completion of trainee evaluations and attendance at didactic conferences. We analyzed comparisons of performance during the year preceding and after implementation. Results: Faculty (N=50) attended significantly more didactic conferences (22.7 hours v. 34.5 hours, p

Introduction: Education research and scholarship are essential for promotion of faculty as well as dissemination of new educational practices. Educational faculty frequently spend the majority of their time on administrative and educational commitments and as a result educators often fall behind on scholarship and research. The objective of this educational advance is to promote scholarly productivity as a template for others to follow. Methods: We formed the Medical Education Research Group (MERG) of education leaders from our emergency medicine residency, fellowship, and clerkship programs, as well as residents with a focus on education. First, we incorporated scholarship into the required activities of our education missions by evaluating the impact of programmatic changes and then submitting the curricula or process as peer-reviewed work. Second, we worked as a team, sharing projects that led to improved motivation, accountability, and work completion. Third, our monthly meetings served as brainstorming sessions for new projects, research skill building, and tracking work completion. Lastly, we incorporated a workstudy graduate student to assist with basic but time-consuming tasks of completing manuscripts. Results: The MERG group has been highly productive, achieving the following scholarship over a three-year period: 102 abstract presentations, 46 journal article publications, 13 MedEd Portal publications, 35 national didactic presentations and five faculty promotions to the next academic level. Conclusion: An intentional focus on scholarship has led to a collaborative group of educators successfully improving their scholarship through team productivity, which ultimately leads to faculty promotions and dissemination of innovations in education.

Introduction: The primary objective of this study was to determine the prevalence of remediation, competency domains for remediation, the length, and success rates of remediation in emergency medicine (EM). Methods: We developed the survey in SurveymonkeyTM with attention to content and response process validity. EM program directors responded how many residents had been placed on remediation in the last three years. Details regarding the remediation were collected including indication, length and success. We reported descriptive data and estimated a multinomial logistic regression model. Results: We obtained 126/158 responses (79.7%). Ninety percent of programs had at least one resident on remediation in the last three years. The prevalence of remediation was 4.4%. Indications for remediation ranged from difficulties with one core competency to all six competencies (mean 1.9). The most common were medical knowledge (MK) (63.1% of residents), patient care (46.6%) and professionalism (31.5%). Mean length of remediation was eight months (range 1-36 months). Successful remediation was 59.9% of remediated residents; 31.3% reported ongoing remediation. In 8.7%, remediation was deemed “unsuccessful.” Training year at time of identification for remediation (post-graduate year [PGY] 1), longer time spent in remediation, and concerns with practice-based learning (PBLI) and professionalism were found to have statistically significant association with unsuccessful remediation. Conclusion: Remediation in EM residencies is common, with the most common areas being MK and patient care. The majority of residents are successfully remediated. PGY level, length of time spent in remediation, and the remediation of the competencies of PBLI and professionalism were associated with unsuccessful remediation.

Introduction: Emergency medicine (EM) milestones are used to assess residents’ progress. While some milestone validity evidence exists, there is a lack of standardized tools available to reliably assess residents. Inherent to this is a concern that we may not be truly measuring what we intend to assess. The purpose of this study was to design a direct observation milestone assessment instrument supported by validity and reliability evidence. In addition, such a tool would further lend validity evidence to the EM milestones by demonstrating their accurate measurement. Methods: This was a multi-center, prospective, observational validity study conducted at eight institutions. The Critical Care Direct Observation Tool (CDOT) was created to assess EM residents during resuscitations. This tool was designed using a modified Delphi method focused on content, response process, and internal structure validity. Paying special attention to content validity, the CDOT was developed by an expert panel, maintaining the use of the EM milestone wording. We built response process and internal consistency by piloting and revising the instrument. Raters were faculty who routinely assess residents on the milestones. A brief training video on utilization of the instrument was completed by all. Raters used the CDOT to assess simulated videos of three residents at different stages of training in a critical care scenario. We measured reliability using Fleiss’ kappa and interclass correlations. Results: Two versions of the CDOT were used: one used the milestone levels as global rating scales with anchors, and the second reflected a current trend of a checklist response system. Although the raters who used the CDOT routinely rate residents in their practice, they did not score the residents’ performances in the videos comparably, which led to poor reliability. The Fleiss’ kappa of each of the items measured on both versions of the CDOT was near zero. Conclusion: The validity and reliability of the current EM milestone assessment tools have yet to be determined. This study is a rigorous attempt to collect validity evidence in the development of a direct observation assessment instrument. However, despite strict attention to validity evidence, inter-rater reliability was low. The potential sources of reducible variance include rater- and instrument-based error. Based on this study, there may be concerns for the reliability of other EM milestone assessment tools that are currently in use.

Introduction Medical decision-making is a cornerstone of clinical care and a key contributor to diagnostic accuracy. Medical decision-making occurs via two primary pathways: System 1, pattern recognition, is fast, intuitive, and heuristically driven and occurs largely unconsciously. System 2, analytic thinking, is slow, deliberate, and under conscious control. Biases are systematic errors that can impact reasoning via either pathway but predominantly affect decisions made by pattern recognition. Debiasing strategies involve the deliberate switching from pattern recognition to analytic thinking triggered by a stimulus. This resource describes a faculty development workshop designed to train emergency medicine educators about common biases and debiasing strategies, to improve teaching of diagnostic reasoning to trainees. Methods This workshop was implemented at the 2017 Society for Academic Emergency Medicine Annual Meeting. The workshop consisted of a brief didactic, followed by small-group case-based learning. A retrospective survey and qualitative evaluation were administered to attendees. Results The participants' self-assessment showed significant improvements (p < .001) in their abilities to recognize how pattern recognition can lead to bias, identify common types of bias in the emergency department, teach trainees about common types of bias, and apply cognitive debiasing strategies to improve diagnostic reasoning. Strengths of the workshop included the interactive case-based format, discussions of bias-mitigation strategies, and take-home resources. Suggestions for improvement included lengthening the discussion time and providing more cases. Discussion Cognitive biases can negatively impact patient care. Faculty development is needed to improve instruction about bias and debiasing strategies for all levels of trainees.