Search

Background: Entrustable professional activities (EPAs) are observable process descriptions of clinical work units. EPAs support learners and tutors in assessment within healthcare settings. For use amongst our pharmacy students as well as pre-registration pharmacists we wanted to develop and validate an EPA for use in a clinical pharmacy setting at LMU University Hospital. Methods: The development of the clinical pharmacy EPA followed a set pathway. A rapid literature review informed the first draft, an interprofessional consensus group consisting of pharmacists, nurses, and medical doctors refined this draft. The refined version was then validated via online survey utilising clinical pharmacists from Germany. Results: We designed, refined and validated an EPA regarding medication reconciliation for assessment of pharmacy students and trainees within the pharmacy department at LMU University Hospital in Munich. Along with the EPA description an associated checklist to support the entrustment decision was created. For validation an online survey with 27 clinical pharmacists from all over Germany was conducted. Quality testing with the EQual rubric showed a good EPA quality. Conclusions: We developed the first clinical pharmacy EPA for use in a German context. Medication reconciliation is a suitable EPA candidate as it describes a clinical activity performed by pharmacists in many clinical settings. The newly developed and validated EPA 'Medication Reconciliation' will be used to assess pharmacy students and trainees. [ABSTRACT FROM AUTHOR]

Despite the many clerkship models of medical education, all can be considered a form of experiential learning. Experiential learning is a complex pedagogical approach involving the development of cognitive skills in an environment with a unique culture with multiple stakeholders, which may impact learner motivation, confidence, and other noncognitive drivers of success. Students may delay the transition to the clerkship year for myriad reasons, and the intricate nature of experiential learning suggested this may impact student performance. This retrospective, observational study investigated the impact of clerkship postponement by measuring subsequent clerkship performance. Pre-clerkship and third-year clerkship performance were analyzed for three cohorts of students (classes of 2018, 2019, and 2020, N = 274) where students had the option to delay the start of their clerkship year. A mixed analysis of variance (ANOVA) and paired t-tests were conducted to compare academic performance over time among students who did and did not delay. Across three cohorts of students, 12% delayed the start of the clerkship year (N = 33). Regardless of prior academic performance, these students experienced a significant reduction in clerkship grades compared to their non-delaying peers. Delaying the start of the clerkship year may have negative durable effects on future academic performance. This information should be kept in mind for student advisement. [ABSTRACT FROM AUTHOR]

Dissection is a unique multisensory educational experience and is essential to learning the anatomical construction of the human and animal bodies. This study aims to introduce a specialized design for the assessment of dissection and to discuss the assessment's attributes. The design was a product of the "assessment drives learning" concept and was developed to motivate students to dissect. Students were awarded "dissection points" based on prior group dissection and identification of structures. Students' perception of the design was examined, and content analysis was performed. The assessment consisted of two parts: the first assigning each student group structures to "pin" on their previously dissected cadavers; the second was a group peer evaluation. The most critical factor for the assessment's success was careful selection of structures assigned to students to pin. The assessment was fit for the purpose, valid, reliable, and had a significant educational impact. Eighty‐three percent of students (n = 116) recommended maintaining the assessment design, as they felt it promoted a deep approach to learning as well as teamwork while reducing stress to a minimum. A strong correlation (Spearman's rho = 0.46, P < 0.0001) was present between the high rating of the design and the number of structures learned, as well as, high rating and lower stress level (Spearman's rho = 0.40, P < 0.0001). There was no apparent influence of grades on student perception of the effectiveness of the assessment. This specific design of evaluation could be used as part of anatomy education in veterinary and medical schools. [ABSTRACT FROM AUTHOR]

Background: The transfer of classic concepts of competency-based medical education into clinical practice has been proven to be difficult in the past, being described as partially fragmented, misleading and inadequate. At the beginning of training, novice doctors commonly feel overwhelmed, overloaded and exposed to extreme time pressure. The discrepancy between expected and actual clinical competence of doctors at the start of their speciality training jeopardizes patient safety. The framework of Entrustable Professional Activities (EPAs) is a promising instrument to effectively integrate competency-based training into clinical practice and may help to close this gap and consequently to improve patient safety. Methods: For anaesthesiology, we developed 5 EPAs for final-year medical students. The EPAs comprised the following seven categories: 1. Title, 2. Specifications, 3. Limitations, 4. Competency domains, 5. Knowledge, abilities and skills, professional attitudes, 6. Assessment and 7. Entrustment. Based on a modified, online-based Delphi study, we further developed and refined these EPAs. Education experts were recruited from the alumni network of the Master of Medical Education (MME) degree course from the University of Heidelberg, Germany. Results: 28 data sets were evaluated in three Delphi rounds. 82% of study participants had previous experience with EPAs. Qualitative and quantitative data formed the basis during the iterative process and resulted in complete descriptions of 5 EPAs for final-year medical students in anaesthesiology. Conclusions: Our study including the associated description of 5 EPAs represent a further step and starting point for EPA-based curricula in medical training in Germany linking undergraduate training, to residency training and continuous medical education. [ABSTRACT FROM AUTHOR]

Background: Although simulation-based assessment (SBA) is being implemented in numerous medical education systems, it is still rarely used for undergraduate medical students in France. Objective structured clinical examinations (OSCEs) will be integrated into the national medical curriculum in 2021. In 2016 and 2017, we created a mannequin SBA to validate medical students' technical and psychometric skills during their emergency medicine and paediatric placements. The aim of our study was to determine medical students' perceptions of SBA. Methods: We followed the grounded theory framework to conduct a qualitative study. A total of 215 students participated in either a paediatric or an emergency medicine simulation-based course with a final assessment. Among the 215 participants, we randomly selected forty students to constitute the focus groups. In the end, 30 students were interviewed. Data were coded and analysed by two independent investigators within the activity theory framework. Results: The analyses found four consensual themes. First, the students perceived that success in the SBA provided them with self-confidence and willingness to participate in their hospital placements (1). They considered SBA to have high face validity (2), and they reported changes in their practice after its implementation (3). Nevertheless, they found that SBA did not help with their final high-stakes assessments (4). They discussed three other themes without reaching consensus: stress, equity, and the structure of SBA. After an analysis with activity theory, we found that students' perceptions of SBA underlined the contradictions between two systems of training: hospital and medical. We hypothesise that a specific role and place for SBA should be defined between these two activity systems. Conclusion: The students perceived that SBA would increase self-confidence in their hospital placements and emphasise the general skills required in their future professional environment. However, they also reported that the assessment method might be biased and stressful. Our results concerning a preimplementation mannequin SBA and OSCE could provide valuable insight for new programme design and aid in improving existing programmes. Indeed, SBA seems to have a role and place between hospital placements and medical schools. [ABSTRACT FROM AUTHOR]

The delivery of medical education has shown a significant shift from the conventional mode of training to the competency-based training. Assessments have been identified as the most significant difference between the two approaches of training. The purpose of the current review was to explore the employment of objective structured clinical examination (OSCE) tool in the delivery of medical education. An extensive search of all materials related to the topic was carried out in the PubMed search engine, and a total of 30 articles were selected based upon the suitability with the current review objectives. It is quite obvious that during assessments, we plan to assess knowledge, skill, and affective domains, which actually gives inference about the overall learning progression. OSCE is an assessment tool that is being employed in medical training owing to its objectivity and structured nature. With the passage of time, OSCEs have been widely used in both undergraduate and postgraduate examinations. Acknowledging the fact that the OSCE can be of immense significance in monitoring the learning and its progression, it becomes quite essential to ensure its quality. In conclusion, the scope of OSCE as an assessment tool in medical education training is immense. It is the need of the hour to use the tool in an objective and structured manner to assess the level of learning in students and even monitor the progression in learning. [ABSTRACT FROM AUTHOR]

Phenomenon: Schools are considering the optimal timing of Step 1 of the United States Medical Licensing Examination (USMLE). Two primary reasons for moving Step 1 after the core clerkships are to promote deeper, more integrated basic science learning in clinical contexts and to better prepare students for the increasingly clinical focus of Step 1. Positioning Step 1 after the core clerkships leverages a major national assessment to drive learning, encouraging students to deepen their basic science knowledge while in the clinical setting. Previous studies demonstrated small increases in Step 1 scores, reductions in failure rates, and similar Step 2 Clinical Knowledge scores when Step 1 was after the clerkships. Some schools that have moved Step 1 reported declines in clinical subject examination (CSE) performance. This may be due to shortened pre-clerkship curricula, the absence of the Step 1 study period for knowledge consolidation, or exposure to fewer National Board of Medical Examiners type questions prior to taking CSEs. This multi-institutional study aimed to determine whether student performance on CSEs was affected by moving Step 1 after the core clerkships. Approach: CSE scores for students from eight schools that moved Step 1 after core clerkships between 2012 and 2016 were analyzed in a pre-post format. Hierarchical linear modeling was used to quantify the effect of the curriculum on CSE performance. Additional analysis determined if clerkship order impacted clinical subject exam performance and whether the curriculum change resulted in more students scoring in the lowest percentiles (as defined as below the national fifth percentile) before and after the curricular change. Findings: After moving Step 1 to after the clerkships, collectively these eight schools demonstrated statistically significant lower performance on four CSEs (Medicine, Neurology, Pediatrics, and Surgery) but not Obstetrics/Gynecology or Psychiatry. Comparing performance within the three years pre and post Step 1 change, differences across all clerkships ranged from 0.3 to −2.0 points, with an average difference of −1.1. CSE performance in clerkships taken early in the sequence was more affected by the curricular change, and differences gradually disappeared with subsequent examinations. Medicine and Neurology showed the largest average differences between curricular-group when taken early in the clinical year. Finally, there was a slightly higher chance of scoring below the national fifth percentile in four of the clinical subject exams (Medicine, Neurology, Pediatrics, and Psychiatry) for the cohort with Step 1 after the clerkships. Insights: Moving Step 1 after core clerkships had a small impact on CSE scores overall, with decreased scores for exams early in the clerkship sequence and an increased number of students below the fifth percentile. Score differences have minor effects on clerkship grades, but overall the size of the effect is unlikely to be educationally meaningful. Schools can use a variety of mitigation strategies to address CSE performance and Step 1 preparation in the clerkship phase. [ABSTRACT FROM AUTHOR]

Background/Aims: The Objective Structured Clinical Examination (OSCE) has an established history of assessing clinical competence for medical and allied healthcare professionals. No research has investigated the use of the OSCE within speech and language therapy undergraduate education. This study aimed to evaluate undergraduate speech and language therapy students' perceptions of the OSCE and to determine if perceptions differed depending on stage of undergraduate education. Methods: An online survey was distributed to second- and final-year students in a 4-year undergraduate speech and language therapy university programme after completing an OSCE. Quantitative survey data were analysed descriptively and statistically using Fisher's exact tests. Thematic analysis was used to analyse narrative survey comments. Results: The response rate was 80%. The students perceived the OSCE to be a fair (95%) and meaningful way (97%) of assessing clinical competencies, which provided them with greater confidence for practice (91%). The OSCE was deemed to be less stressful than a written exam (65%). No significant differences were observed between second- and fourth-year students' perceptions. Five major themes included clarity of expectations, time allocated, consistency between examiners, influence on student learning, and personal impact. Discussion: The survey findings suggest that undergraduate speech and language therapy students across different stages of education and different clinical contexts perceive the OSCE as a fair and meaningful assessment approach. This study provides initial evidence that the OSCE is suitable for assessing clinical competencies specific to the profession of speech and language therapist. [ABSTRACT FROM AUTHOR]

Background: Entrustable professional activities (EPAs) are those activities that a health professional can perform without direct supervision in a defined environment. Bridging the gap between competencies and learning objectives, EPAs have made assessing the performances of health professional more realistic. The main objective of the present study was developing and customizing EPAs for Iranian Internal Medicine Residency Programs. Results: After reviewing the publications, residency curricula and logbooks, and collecting experts' ideas, the initial list of EPAs was developed. Then, in a focus group, the list was refined, the entrustability level of each residency year was determined, and finally, the EPA-competency cross-tab was established, and in the next step, through a one- round Delphi, the results were validated. Twenty-eight EPAs were developed. Some of them were definitely suitable for the higher levels of residency, such that they had to be accomplished under direct supervision until the end of the program. On the other hand, some of EPAs were those that residents, even from the first year, are expected to perform independently or under indirect supervision. Most of the EPAs cover a wide range of competencies. Conclusion: Determining the entrustability level of each residency year in each EPA as well as the competency- EPA matrix has crucial effect on the quality of the graduates. It seems that our findings are applicable in developing countries like Iran. [ABSTRACT FROM AUTHOR]

Issue: Entrustable Professional Activities (EPAs) describe the core tasks health professionals must be competent performing prior to promotion and/or moving into unsupervised practice. When used for learner assessment, they serve as gateways to increased responsibility and autonomy. It follows that identifying and describing EPAs is a high-stakes form of work analysis aiming to describe the core work of a profession. However, hasty creation and adoption of EPAs without rigorous attention to content threatens the quality of judgments subsequently made from using EPA-based assessment tools. There is a clear need for approaches to identify validity evidence for EPAs themselves prior to their deployment in workplace-based assessment. Evidence: For EPAs to realize their potential in health professions education, they must first be constructed to reflect accurately the work of that profession or specialty. If the EPAs fail to do so, they cannot predict a graduate's readiness for or future performance in professional practice. Evaluating the methods used for identification, description, and adoption of EPAs through a construct validity lens helps give leaders and stakeholders of EPA development confidence that the EPAs constructed are, in fact, an accurate representation of the profession's work. Implications: Application of a construct validity lens to EPA development impacts all five commonly followed steps in EPA development: selection of experts; identification of candidate EPAs; iterative revisions; evaluation of proposed EPAs; and formal adoption of EPAs into curricula. It allows curricular developers to avoid pitfalls, bias, and common mistakes. Further, construct validity evidence for EPA development provides assurance that the EPAs adopted are appropriate for use in workplace-based assessment and entrustment decision-making. [ABSTRACT FROM AUTHOR]

Purpose: The entrustable professional activity (EPA) framework is an assessment approach used to define the educational outcomes of a program by outlining discrete work tasks learners are expected to perform independently upon graduation. This study outlines the development and evaluation of an EPA framework for predoctoral dental education at the University of North Carolina Adams School of Dentistry. Methods: The draft EPA framework was created in collaboration with a group of faculty members and included 15 statements that were mapped to relevant Commission on Dental Accreditation standards. The draft EPA framework was distributed to faculty via an electronic survey, requesting participants to evaluate whether the EPAs were well‐defined; observable; measurable; expected of a general dentist; transferable to other practice settings; and required application of relevant knowledge, skills, and attitudes. In addition, participants were asked to identify the percentage of graduates who could perform these tasks independently and whether learners must be able to perform the list of EPAs upon graduation. Results: Sixty‐eight faculty members completed the survey (72% response rate); participants represented all divisions across the school and had extensive dental practice experiences. Overall, participants agreed the EPAs met the defined criteria and were considered important for graduates to be able to demonstrate. Feedback from faculty voiced support for the EPA framework and identified concerns regarding the implementation due to potential faculty calibration and time constraints. Conclusion: Evidence from this study supports additional research to explore how the EPA framework can be further developed in predoctoral and postgraduate dental education programs. [ABSTRACT FROM AUTHOR]

The aim of this review is to highlight recent and potential future enhancements to the United States Licensing Examination (USMLE) program. The USMLE program is co-owned by the National Board of Medical Examiners (NBME) and the Federation of State Medical Boards. The USMLE includes four examinations: Step 1, Step 2 Clinical Knowledge, Step 2 Clinical Skills, and Step 3; every graduate of Liaison Committee on Medical Education-accredited allopathic medical schools and all international medical graduates must pass this examination series to practice medicine in the United States. From 2006 to 2009, the program underwent an indepth review resulting in five accepted recommendations. These recommendations have been the primary driver for many of the recent enhancements, such as an increased emphasis on foundational science and changes in the clinical skills examination, including more advanced communication skills assessment. These recommendations will continue to inform future changes such as access to references (e.g., a map of metabolic pathways) or decision-making tools for use during the examination. The NBME also provides assessment services globally to medical schools, students, residency programs, and residents. In 2015, >550,000 assessments were provided through the subject examination program, NBME self-assessment services, and customized assessment services. [ABSTRACT FROM AUTHOR]

Background: The new UCSF Bridges Curriculum aims to prepare students to succeed in today's health care system while simultaneously improving it. Curriculum redesign requires assessment strategies that ensure that graduates achieve competence in enduring and emerging skills for clinical practice. Aim: To design entrustable professional activities (EPAs) for assessment in a new curriculum and gather evidence of content validity. Setting: University of California, San Francisco, School of Medicine. Participants: Nineteen medical educators participated; 14 completed both rounds of a Delphi survey. Program Description: Authors describe 5 steps for defining EPAs that encompass a curricular vision including refining the vision, defining draft EPAs, developing EPAs and assessment strategies, defining competencies and milestones, and mapping milestones to EPAs. A Q-sort activity and Delphi survey involving local medical educators created consensus and prioritization for milestones for each EPA. Program Evaluation: For 4 EPAs, most milestones had content validity indices (CVIs) of at least 78 %. For 2 EPAs, 2 to 4 milestones did not achieve CVIs of 78 %. Discussion: We demonstrate a stepwise procedure for developing EPAs that capture essential physician work activities defined by a curricular vision. Structured procedures for soliciting faculty feedback and mapping milestones to EPAs provide content validity. [ABSTRACT FROM AUTHOR]

Peer assessment has been shown to be an effective tool to promote professionalism in medical students. Peer assessment may be particularly useful in anatomy dissection laboratory as the required close collaboration and long hours of anatomy laboratory provide students insights into their peers' work habits and interpersonal skills. The objective of this study was to quantitatively and qualitatively analyze the use of a validated peer assessment tool in Gross Anatomy. Students in a first year medical school class evaluated three members of their dissection group using an online survey tool. The mid-course and end-of-course evaluation included open-ended comments, as well as a five-point scale that measured three work habits, two interpersonal attributes and one overall score. All 267 students completed the assignment. The overall score and four of the five other assessed categories showed significant improvement from the mid- to end-of-course evaluations. Quantitative and qualitative data also revealed significant improvement among the students who received the lowest mid-course assessments. Seventy-six percent of the class agreed with the statement: 'Based on the feedback I received, I made a change in how I worked with or taught my peers.' The use of this peer assessment tool used by students in anatomy was associated with improvements in work habits and interpersonal attributes, particularly by the cohort of students who received the lowest mid-course feedback. Peer assessment offers students an opportunity to improve their interpersonal skills and work habits. Anat Sci Educ 7: 144-152. © 2013 American Association of Anatomists. [ABSTRACT FROM AUTHOR]

BACKGROUND: Graduate medical education programs assess trainees' performance to determine readiness for unsupervised practice. Entrustable professional activities (EPAs) are a novel approach for assessing performance of core professional tasks. AIM: To describe a pilot and feasibility evaluation of two EPAs for competency-based assessment in internal medicine (IM) residency. SETTING/PARTICIPANTS: Post-graduate year-1 interns (PGY-1s) and attendings at a large internal medicine (IM) residency program. PROGRAM DESCRIPTION: Two Entrustable professional activities (EPA) assessments (Discharge, Family Meeting) were piloted. PROGRAM FEASIBILITY EVALUATION: Twenty-eight out of 43 (65.1 %) PGY-1 s and 32/43 (74.4 %) attendings completed surveys about the Discharge EPA experience. Most who completed the EPA assessment (10/12, 83.8 %, PGY-1s; 9/11, 83.3 %, attendings) agreed it facilitated useful feedback discussions. For the Family Meeting EPA, 16/26 (61.5 %) PGY-1s completed surveys, and most who participated (9/12 PGY1s, 75 %) reported it improved attention to family meeting education, although only half recommended continuing the EPA assessment. DISCUSSION: From piloting two EPA assessments in a large IM residency, we recognized our reminder systems and time dedicated for completing EPA requirements as inadequate. Collaboration around patient safety and palliative care with relevant clinical services has enhanced implementation and buy-in. We will evaluate how well EPA-based assessment serves the intended purpose of capturing trainees' trustworthiness to conduct activities unsupervised. [ABSTRACT FROM AUTHOR]

Background. Virtual reality (VR) simulators for surgical training might possess the properties needed for basic training in laparoscopy. Evidence for training efficacy of VR has been investigated by research of varying quality over the past decade. Objective. To review randomized controlled trials regarding VR training efficacy compared with traditional or no training, with outcome measured as surgical performance in humans or animals. Data sources. In June 2011 Medline, Embase, the Cochrane Central Register of Controlled Trials, Web of Science and Google Scholar were searched using the following medical subject headings (MeSh) terms: Laparoscopy/standards, Computing methodologies, Programmed instruction, Surgical procedures, Operative, and the following free text terms: Virtual real* OR simulat* AND Laparoscop* OR train* Limits: Controlled trials. Study eligibility criteria. All randomized controlled trials investigating the effect of VR training in laparoscopy, with outcome measured as surgical performance. Methods. A total of 98 studies were screened, 26 selected and 12 included, with a total of 241 participants. Results. Operation time was reduced by 17-50% by VR training, depending on simulator type and training principles. Proficiency-based training appeared superior to training based on fixed time or fixed numbers of repetition. Simulators offering training for complete operative procedures came out as more efficient than simulators offering only basic skills training. Conclusions. Skills in laparoscopic surgery can be increased by proficiency-based procedural VR simulator training. There is substantial evidence (grade IA - IIB) to support the use of VR simulators in laparoscopic training. [ABSTRACT FROM AUTHOR]

Objectives: There are currently no guidelines on the most effective ways of supporting medical students to develop high standards of medical professionalism. The aim of this review is to summarise the evidence currently available on methods used by medical schools to promote medical professionalism. Methods: We performed a systematic search of electronic databases (Medline, PsychInfo, British Education Index, Educational Resources Information Centre, Sociological Abstracts and Topics in Medical Education) from January 1998 to October 2008. Outcomes studied were methods used to support and promote the development of professionalism in medical students. Results: We identified 134 papers and five main themes for supporting the development of professionalism in medical students: curriculum design, student selection, teaching and learning methods, role modelling and assessment methods. However, the level of empirical evidence supporting each of these methods is limited. Conclusions: Identification of these five areas helps medical schools to focus the emphasis of their approaches to developing professionalism and identifies future research areas. This review offers a preliminary guide to future discovery and progress in the area of medical professionalism. [ABSTRACT FROM AUTHOR]

BACKGROUND: It is not known to what extent the dean's letter (medical student performance evaluation [MSPE]) reflects peer-assessed work habits (WH) skills and/or interpersonal attributes (IA) of students. OBJECTIVE: To compare peer ratings of WH and IA of second- and third-year medical students with later MSPE rankings and ratings by internship program directors. DESIGN AND PARTICIPANTS: Participants were 281 medical students from the classes of 2004, 2005, and 2006 at a private medical school in the northeastern United States, who had participated in peer assessment exercises in the second and third years of medical school. For students from the class of 2004, we also compared peer assessment data against later evaluations obtained from internship program directors. RESULTS: Peer-assessed WH were predictive of later MSPE groups in both the second (F = 44.90, P < .001) and third years (F = 29.54, P< .001) of medical school. Interpersonal attributes were not related to MSPE rankings in either year. MSPE rankings for a majority of students were predictable from peer-assessed WH scores. Internship directors' ratings were significantly related to second- and third-year peer-assessed WH scores (r = .32 [P= .15] and r = .43 [P = .004]), respectively, but not to peer-assessed IA. CONCLUSIONS: Peer assessment of WH, as early as the second year of medical school, can predict later MSPE rankings and internship performance. Although peer- assessed IA can be measured reliably, they are unrelated to either outcome. [ABSTRACT FROM AUTHOR]