Search

In competency-based medical education (CBME), which is being embraced globally, the patient-learner-educator encounter occurs in a highly complex context which contributes to a wide range of assessment outcomes. Current and historical barriers to considering context in assessment include the existing post-positivist epistemological stance that values objectivity and validity evidence over the variability introduced by context. This is most evident in standardized testing. While always critical to medical education the impact of context on assessment is becoming more pronounced as many aspects of training diversify. This diversity includes an expanding interest beyond individual trainee competence to include the interdependency and collective nature of clinical competence and the growing awareness that medical education needs to be co-produced among a wider group of stakeholders. In this Eye Opener, we wish to consider: 1) How might we best account for the influence of context in the clinical competence assessment of individuals in medical education? and by doing so, 2) How could we usher in the next era of assessment that improves our ability to meet the dynamic needs of society and all its stakeholders? The purpose of this Eye Opener is thus two-fold. First, we conceptualize - from a variety of viewpoints, how we might address context in assessment of competence at the level of the individual learner. Second, we present recommendations that address how to approach implementation of a more contextualized competence assessment., Competing Interests: The authors have no competing interests to declare., (Copyright: © 2024 The Author(s).)

Competency-based medical education (CBME) has produced large collections of data, which can provide valuable information about trainees and medical education systems. Many organizations continue to struggle with accessing, collecting, governing, analyzing, and visualizing their clinical and/or educational data. This hinders data sharing efforts within and across organizations, which are foundational in supporting system-wide improvements. Challenges to data sharing within medical education include variability in legislation, existing data policies, heterogeneity of data, inadequate data infrastructure, and various intended purposes or uses. In this eye opener, the authors describe four case studies to illustrate some of the aforementioned challenges and characterize the complexity of data sharing within medical education along two dimensions: organizational (single vs. multiple) and data type (clinical and/or educational). With the goal of better supporting data sharing initiatives, the authors introduce an action-oriented blueprint that includes a three-stage process (i.e., preparation, execution, and iteration) to highlight crucial aspects of data sharing. This evidence-informed model incorporates current best practices and aims to support data sharing initiatives within their own organizations and across multiple organizations. Finally, organizations can use this model to conceptually guide and track their progression throughout the data sharing process., Competing Interests: Dr. George is the Executive Director of the Society for Improving Medical Professional Learning (SIMPL). This position is unpaid., (Copyright: © 2024 The Author(s).)

Background: Surgery for spinal disorders represents some of the commonest surgical procedures performed in many countries worldwide, carried out by neurosurgeons and orthopedic surgeons. Residency training is shifting to competency-based medical education, which requires setting standards for graduating residents and their assessments. However, gaps exist in the literature regarding the parameters used for assessment and the mastery levels expected of graduating residents in the performance of common spinal procedures as defined in Entrustable Professional Activities (EPAs). The objectives of the study were to describe the assessment parameters used for residents, identify the standard of performance expected of graduating residents of EPAs of spinal procedures, and identify factors predicting the expected standard of competent performance of graduating residents., Methods: The survey was sent to neurosurgery and orthopedic surgery Faculty requesting their recommendations on parameters of assessment and the expected standard competence performance for EPAs related to spinal procedures using our entrustment scale (A-E)., Results: Based on total responses, the recommended number of assessments and assessors for each EPA was 5 and 2, respectively. Regarding each specialty, there was no significant difference in the recommended number of assessments for each EPA. However, neurosurgery Faculty recommended higher number of assessors(n = 3) than orthopedic surgery Faculty(n = 2) for both posterior spinal decompression EPA(PSD) (p = 0.01) and spinal instrumentation EPA(SI) (p = 0.04). Based on total responses, 83% felt PSD was appropriate to the general practice, 86.8% considered it not too broad, and 62.3% expected entrustment level E as a graduation target. The proportions of these ratings were slightly lower for SI at 58.5%, 71.7% and 56.6%, respectively. Both specialties indicated that the EPAs were not too broad. In contrast, neurosurgery Faculty were more likely to consider these EPAs appropriate for general practice than orthopedic surgery Faculty for both PSD (94.7% vs 53.3%, p = 0.0003) and SI (68.4% vs 33.3%, p = 0.02). Moreover, neurosurgery Faculty had a higher expected standard of performance as a graduation target for both PSD (Level E 76.3% vs 26.7%, p = 0.001) and SI (Level E 65.8% vs 33.3%, p = 0.03) than orthopedic surgery Faculty. Expectations of entrustment level E for PSD was associated with the belief that the current EPA was appropriate for the general practice of their specialty with an odds ratio of 8.35 (p = 0.01, 95%CI 1.53-45.67)., Conclusions: A difference exists in parameters of assessment and expected standard competence performance of spine procedures among spinal surgery specialties. In our opinion, there should be efforts to develop consensus between specialties for the sake of uniform delivery of high-quality care for patients regardless of the specialty of their surgeon. Our results will be particularly valuable to certification bodies in the assessment of spinal milestones. This study has important implications for the design of residency and fellowship education in spinal surgery internationally., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2024 Skulsampaopol et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Background The medical workplace presents challenges for workplace-based learning. Structured debriefing of shared clinical experiences has been proposed as a way to take advantage of workplace-based learning in a setting that facilitates deep learning conversations. Objective To investigate faculty and learner acceptance of private, face-to-face, structured debriefing of performance of entrustable professional activities (EPAs). Methods During the 2020-2021 academic year, faculty at the University of Colorado (CU) and the University of Utah (UU) debriefed fellow performance of jointly selected EPAs in neonatal-perinatal medicine pertinent to shared 1- to 3-week clinical rotations. Private face-to-face debriefing was structured by a comprehensive EPA-specific list of behavioral anchors describing 3 levels of entrustment/accomplishment. Sessions ended with joint decisions as to level of entrustment/accomplishment and goals for improvement. We used thematic analysis of semistructured fellow interviews and faculty focus groups to identify themes illustrated with representative quotations. Results We interviewed 17 fellows and 18 faculty. CU participants debriefed after clinical rotations; UU usually debriefed during rotations. Debriefing sessions for 1 to 2 EPAs lasted 20 to 40 minutes. Themes represented in fellow interviews and faculty focus groups suggested that debriefing facilitated formative feedback along with shared understanding of clinical performance and assessment criteria. The standardized format and private conversations supported assessment of aspects of performance for which review might otherwise have been overlooked or avoided. The conversations also provided valuable opportunities for formative discussion of other matters of importance to fellows. Conclusions Structured debriefing of recently shared clinical experiences fostered formative assessment viewed positively by teachers and learners.

Introduction: Entrustable Professional Activities (EPAs) provide a framework for competency-based assessment in surgery. EPA descriptions include observable behaviors by trainees at progressive levels of autonomy. The American Board of Surgery (ABS) required all General Surgery (GS) residency programs to implement assessment of 18 EPAs at the beginning of academic year 2023-2024. Microassessments provide formative self-reflection by the resident and feedback by faculty upon completion of the EPA. These frequent assessments culminate in a resident performance profile utilized by the trainee for formative growth and the clinical competency committee for summative feedback. Assessor free text comments are an opportunity to provide meaningful, constructive feedback to residents. Our aim was to analyze comments provided by faculty to residents in terms of their alignment with EPA descriptors and provision of actionable feedback., Methods: A total of 540 ​GS EPA assessments for inguinal hernia, gallbladder disease, appendicitis, trauma, and surgical consultation were evaluated from 6/2021-12/2022. We assessed free text EPA comments from faculty compared to EPA behavior descriptions for alignment with the selected EPA level of entrustment. The comments were judged on a binary scale of "Align" vs "Not Align" by two independent evaluators, with a third evaluator to address discordance. Comments were then evaluated for resident behavioral descriptions, suggestions for improvement, and positive or negative feedback., Results: Approximately 77 ​% of EPA microassessments had alignment between level of autonomy and free text feedback. A common example of feedback discordant with level of autonomy was rating a trainee at an intraoperative level 4 (independent practice) with comments such as "required some guidance with retrocecal case and upsizing port." Based on behavior descriptions this would be a level 3 (indirect supervision). Approximately 88 ​% of feedback contained positive comments with minimal negative feedback (e.g., "this did not go well."). Actionable feedback including "work on optimization of retracting hand" or "continue to work clamp/tie technique and square off each knot" was present in 28.3 ​% of feedback., Conclusions: The majority of faculty provide feedback that is aligned with the behavioral anchors of the EPAs assessed, but frequently did not provide actionable feedback to the resident regarding how to advance to the next level of entrustment. EPA entrustment behaviors provide a framework for the development of practice-ready behaviors, and if assessors anchor their feedback in the behaviors for a given entrustment level and project how a resident could proceed to the next level, they can provide a clear trajectory for skill development. Faculty development should focus on improving the frequency of actionable free text feedback, outlining how residents can advance in the future., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Objective: This study aimed to develop and implement a program-wide active learning framework to guide active learning and assessment efforts in an entry-to-practice competency-based Doctor of Pharmacy program., Methods: The development of the framework involved 3 stages: creation of a framework aligned with the program's guiding principles, provision of training and support to faculty and students, and evaluation of the students' and academic staff satisfaction using an online survey over 2 academic years (2022-2023). Data from this survey were analyzed descriptively., Results: An active learning framework that was aligned with the program's guiding principles while allowing flexibility for individual teaching styles was developed. It consisted of 4 stages: preclass preparation, in-class work, prelaboratory preparation, and in-laboratory activities (emphasizing knowledge acquisition and competency development). Academic staff surveys reported higher satisfaction of staff in year 2 than year 3 of the program, with indications of further training on specific modalities. Students' satisfaction improved from year 2 to 3, particularly, in areas related to class objectives, learning environment, and feedback., Conclusion: The transformation of a curriculum that includes the evolution of the teaching and learning strategy is a complex, long-term project that deserves continuing attention. Having frameworks in place helps the management, instructors, and students to understand the global direction, stay focused, and support the implementation of competency-based education and student-centered learning., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 American Association of Colleges of Pharmacy. Published by Elsevier Inc. All rights reserved.)

Background and Objectives: For successful competence-oriented teaching at the medical faculties it is important to identify the factors that influence its implementation in order to benefit from the strengths and balance out weaknesses. The present study examined the success factors and obstacles of the implementation of competence-oriented teaching in the surgical discipline from the point of view of students and lecturers., Methods: After implementation of competence-oriented teaching based on the teaching goals of the NKLM, in clinical examination courses (bedside teaching and block internship, BP) at two hospitals, a qualitative content analysis and quantification of the answers were performed using focus group interviews and questionnaires with students (S) and lecturers (D)., Results: During the summer semester 2022 a total of 31 students and 14 lecturers were interviewed in focus groups and 143 questionnaires (123 S, 20 D) were analyzed. For the students the presence of concrete competences/teaching goals, guidelines for the lesson, transparent goals and ability to demand teaching goals as well as structured lessons and mentoring were the main success factors. Lecturers on the other hand reported the presence of concrete goals, assistance for the lesson preparation and the activity of the students as success factors. The results of the questionnaires showed that the majority (88% S, 75% D) were informed about the teaching goals and considered them to be followed (84%S, 95% D). Obstacles were the factors "time", "mentoring" and "information". Factors that were between negative and positive (indifferent factors) were "uncertainty about competence-orientation" and "uncertainty how to examine the teaching success"., Discussion: Transparent structure and teaching goals as well as a mentoring system are the success factors for the implementation of competence-oriented lessons and should be used as strengths. Indifferent factors represent weaknesses and need to be addressed by training and instruction. Restricted time and personnel resources are the immanent problems that hamper the implementation and require fulminant structural changes., (© 2024. The Author(s).)

Objective: To determine the ability of surgical trainees and faculty to correctly interpret entrustability of a resident learner in a modeled patient care scenario., Design: Prospective study utilizing a web-based survey including 4 previously-recorded short videos of resident learners targeted to specific levels of the American Board of Surgery's (ABS) Entrustment Scale. Respondents were asked to choose the entrustment level that best corresponded to their observations of the learner in the video. Responses were subcategorized by low and high entrustment., Setting: Online, utilizing the Qualtrics survey platform., Participants: Survey targeting US surgical trainees and surgical faculty via email and social media. We received 31 complete responses and 2 responses which completed > 1 video assessment question without demographic information (n = 33). Respondents included 10 trainees (32%) and 21 attending surgeons (68%)., Results: Neither faculty nor trainees readily identified the targeted entrustment level for Question 1 (preoperative care of a patient with acute appendicitis with high entrustment, 36% correct), though evaluations of the remaining questions (2 through 4) demonstrated more accuracy (70, 84, and 75% correct, respectively). Faculty were more readily able than trainees to identify low entrustment (level Limited Participation) in intraoperative inguinal hernia repair (95% vs 60%, p = 0.03). After subcategorization to high and low entrustment, both residents and faculty were able to accurately identify entrustment 95% overall., Conclusions: Both trainees and attending surgeons were able to identify high- and low-performing residents on short video demonstrations using the ABS EPA entrustment scale. This provides additional evidence in support of the need for frequent observations of EPAs to account for the variability in raters' perceptions in addition to complexity of clinical scenarios. Frame-of-reference training via a video-based platform may also be beneficial for both residents and faculty as an ongoing EPA implementation strategy., (Copyright © 2024 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.)

Background: Evidence-based practice (EBP) is a major concept threaded throughout nursing education, yet competencies are not clearly identified in The Essentials., Purpose: Nurse leaders'EBP competency expectations for professional practice were explored to inform competency-based education for students and practicing nurses. A secondary aim explored potential effects of misinformation on EBP., Methods: Descriptive qualitative inquiry was performed with a focus group of 6 clinical nurse leaders., Results: EBP expectations were identified, discriminating between novice entry level and advanced-level nurses. Participants emphasized asking questions, linking evidence to practice, and acknowledging that evidence changes over time. All advanced-level nurses were expected to apply, lead, and teach EBP. Post pandemic, nurses need to reclaim evidence-based practices, critically appraise evidence, and educate patients and families to address misinformation., Conclusions: Information learned will inform competency-based EBP education for students and nurses in academic and clinical settings., Competing Interests: The authors declare no conflict of interest., (Copyright © 2024 Wolters Kluwer Health, Inc. All rights reserved.)

Aim: Placebo and nocebo effects are based on expectations that are formed by how doctors communicate and can influence the efficacy of medical treatment. Given the implications for doctor-patient communication and the learning objectives listed in NKLM 2.0, we herein present a novel teaching and learning concept to impart competency-based knowledge about placebo and nocebo effects., Method: The teaching and learning concept was piloted with N=324 third-semester medical students. It combines a self-guided, small-group component to gather communication strategies and apply them in a video-recorded conversation, followed by a classroom-based session to reflect on and discuss the videos and to learn basic scientific and theoretical knowledge. The evaluation involved written feedback from the students and lecturers (structure/process) and an analysis of the videos (students' learning success). To supplement this, the overall course evaluation was included since this new teaching concept was not specifically evaluated by the students., Results: Course structure and process were rated positively. The active involvement of the students in the subject matter and the balance between theoretical, scientific and practical content was emphasized positively. Analysis of the learning success showed that the students were able to effectively transfer the knowledge gained about placebo and nocebo effects to conversational situations., Conclusion: The topic of placebo/nocebo is optimally suited to teach communication skills with its many links to knowledge, translational approaches and added value for medical practice. When doing this, video-recorded conversations appear to be an effective tool to achieve learning objectives. This teaching and learning strategy offers possibilities for expanding communication curricula., Competing Interests: The authors declare that they have no competing interests., (Copyright © 2024 Öhlmann et al.)

Introduction: Entrustable Professional Activities (EPAs) can potentially support self-regulated learning in the clinical environment. However, critics of EPAs express doubts as they see potential harms, like checkbox behaviour. This study explores how GP-trainees use EPAs in the clinical environment through the lens of self-regulated learning theory and addresses the question of whether EPAs help or hinder trainees' learning in a clinical environment., Methods: Using constructivist grounded theory methodology, a purposive and theoretical sample of GP-trainees across different years of training were interviewed. Two PICTOR interviews were added to refine and confirm constructed theory. Data collection and analysis followed principles of constant comparative analysis., Results and Discussion: Trainees experience both hindering and helping influences of EPAs and self-regulate their learning by balancing these influences throughout GP-placements. Three consecutive stages were constructed each with different use of EPAs: adaptation, taking control, and checking the boxes. EPAs were most helpful in the 'taking control' stage. EPAs hindered self-regulated learning most during the final stage of training as trainees had other learning goals and experienced assessment of EPAs as bureaucratic and demotivating. Regularly discussing EPAs with supervisors helped to focus on specific learning goals, create opportunities for learning, and generate task-oriented feedback., Conclusion: EPAs can both help and hinder self-regulated learning. How trainees balance both influences changes over time. Therefore, placements need to be at least long enough to enable trainees to gain and maintain control of learning. Supervisors and teachers should assist trainees in balancing the hindering and helping influences of EPAs., Competing Interests: The authors have no competing interests to declare., (Copyright: © 2024 The Author(s).)

Purpose: This study aimed to develop a competency-based global health education (GHE) program for medical students and analyze its effectiveness., Methods: The study had a pretest-posttest control group design. The program was developed based on the eight global health competency domains for medical students and implemented for 18 hours over 6 weeks beginning in September 2023. The intervention and control groups comprised 34 students and 41 students, respectively. The analytical methods used were t-test, chi-square test, and analysis of covariance., Results: Experience with global health activities and pretest scores were controlled as covariates to exclude the effects of participants' general characteristics and pretest scores. The intervention group had outscored the control group on interest in a global health career and the necessity of GHE and also showed significantly higher posttest scores on global competence, global citizenship, and global health competence. Students were generally satisfied with the GHE program., Conclusion: A global health competency-based GHE program effectively increases medical students' interest in global health careers, their understanding of the need for GHE, and their global competence, global citizenship, and global health competence. This study is expected to promote GHE program development and research.

Abstract: Competency-based education, pivotal in nursing programs, emphasizes learning methods over knowledge accumulation, integrating ongoing assessments for performance and outcomes. The American Association College of Nursing introduced competency-based education, urging educators to explore diverse assessment methods. This article explores the implementation of mock oral boards as an assessment method to synchronize performance standards with competencies in nursing education, specifically in preparing nurse practitioner students for clinical rotations., Competing Interests: Competing interests: The authors report no conflicts of interest., (Copyright © 2024 American Association of Nurse Practitioners.)

Purpose: How to best support self-regulated learning (SRL) skills development and track trainees' progress along their competency-based medical education learning trajectory is unclear. Learning plans (LPs) may be the answer; however, information on their use in undergraduate medical education (UME) is limited. This study summarizes the literature regarding LP use in UME, explores the student's role in LP development and implementation, and identifies additional research areas., Method: MEDLINE, Embase, PsycInfo, Education Source, and Web of Science databases were searched for articles published from database inception to March 6, 2024, and relevant reference lists were manually searched. The review included studies of undergraduate medical students, studies of LP use, and studies of the UME stage in any geographic setting. Data were analyzed using quantitative and qualitative content analyses., Results: The database search found 7,871 titles and abstracts with an additional 25 found from the manual search for a total of 7,896 articles, of which 39 met inclusion criteria. Many LPs lacked a guiding framework. LPs were associated with self-reported improved SRL skill development, learning structure, and learning outcomes. Barriers to their use for students and faculty were time to create and implement LPs, lack of training on LP development and implementation, and lack of engagement. Facilitators included SRL skill development, LP cocreation, and guidance by a trained mentor. Identified research gaps include objective outcome measures, longitudinal impact beyond UME, standardized framework for LP development and quality assessment, and training on SRL skills and LPs., Conclusions: This review demonstrates variability of LP use in UME. LPs appear to have potential to support medical student education and facilitate translation of SRL skills into residency training. Successful use requires training and an experienced mentor. However, more research is required to determine whether benefits of LPs outweigh the resources required for their use., (Copyright © 2024 the Association of American Medical Colleges.)

Objective: To outline an approach to help students achieve Entrustable Professional Activities (EPAs) entrustment during a sequence of Advanced Pharmacy Practice Experiences (APPEs) by implementing longitudinal monitoring and individualized intervention and remediation strategies., Methods: Using the recommended EPAs within the core APPEs (acute care, ambulatory care, community, institutional), students were expected to achieve entrustment on all EPAs by graduation. A longitudinal monitoring approach, using an "EPA report card," was implemented to continuously identify students at risk of not meeting the EPA requirement of "Level 3" entrustment (perform with reactive supervision). Individualized interventions, including proactive outreach and in-sequence remediation, were incorporated into the APPE core and elective sequence to help ensure all students were entrusted by the end of APPEs without requiring further end-of-year remediation to graduate., Results: For the graduating classes of 2023 and 2024, 12% (8 of 69) and 16% (12 of 75) students, respectively, were identified as at risk of not meeting EPA entrustment. Proactive outreach, in-sequence remediation, or a combination of both strategies, were used to enhance learning and EPA performance. As a result, all students achieved "Level 3" entrustment on the deficient EPA(s) by the end of the APPE sequence. No student required further end-of-year remediation to graduate., Conclusion: Utilizing a multifaceted strategy provided timely, real-world practice opportunities to improve the students' achievement of EPAs across the APPE curriculum and decreased the need for end-of-year remediation and potential graduation delays., Competing Interests: Declaration of Competing Interest None declared., (Copyright © 2024 American Association of Colleges of Pharmacy. Published by Elsevier Inc. All rights reserved.)

Background: The Masterplan Medicine 2020 adopted in 2017 entails many changes to the medical studies curriculum. The new structure affects the content of the coursework and its main focus. A major goal of this masterplan is to prepare young physicians by teaching the skills that are essential for the future profession. The National Competence-Based Learning Objectives Catalog for Medicine (NKLM) provides the basis for the teaching content., Methods: The Working Group Teaching of the German Society of Ophthalmology (Arbeitsgemeinschaft Lehre der DOG) actively supports this transformation. In cross-site collaboration, teaching materials for various teaching formats have been compiled by relying on the NKLM (e.g., recordings of operations, slides for small group instruction, image galleries, case studies). An online library named the DOG-EyeTeacher was then created., Results: The aim of the DOG-EyeTeacher is to relieve the training clinics and to establish basic standards in teaching materials, thereby enabling the necessary focus on medical education. The provision of these teaching materials should deepen the interest in ophthalmology among future doctors., Conclusion: The DOG-EyeTeacher is our response to the challenges associated with the planned restructuring of the medical curriculum. Since October 2023, any DOG member involved in teaching can create an account free of charge to use our materials., (© 2024. The Author(s).)

Background: As competency-based medical education (CBME) curricula are introduced in residency programs across Canada, systematic evaluation efforts are needed to ensure fidelity of implementation. This study evaluated early outcomes of CBME implementation in one Canadian Physical Medicine and Rehabilitation program that was an early adopter of CBME, with an aim to inform continuous quality improvement initiatives and CBME implementation nationwide., Methods: Using Rapid Evaluation methodology, informed by the CBME Core Components Framework, the intended outcomes of CBME were compared to actual outcomes., Results: Results suggested that a culture of feedback and coaching already existed in this program prior to CBME implementation, yet faculty felt that CBME added a framework to support feedback. The small program size was valuable in fostering strong relationships and individualized learning. However, participants expressed concerns about CBME fostering a reductionist approach to the development of competence. Challenges existed with direct observation, clear expectations for off-service training experiences, and tracking trainee progress. There was trepidation surrounding national curricular change, yet the institution-wide approach to CBME implementation created shared experiences and a community of practice., Conclusions: Program evaluation can help understand gaps between planned versus enacted implementation of CBME, and foster adaptations to improve the fidelity of implementation., Competing Interests: The authors have no conflicts of interest to declare., (© 2024 Trier, Askari, Hanmore, Thompson, McGuire, Braund, Koch Hall, McEwen, Dalgarno, Dagnone; licensee Synergies Partners.)

Reflection helps us learn from experiences, build good doctor-patient relationships and a professional identity. It also holds an important place in the competency-based curriculum as a tool for assessment, especially for competencies that cannot be assessed by conventional means. To embed reflection in the curriculum, we need to explicitly teach how to reflect, make it a habit by integrating it into the various curricular activities, assess reflections formatively, and provide an environment that allows guided reflections, taking care of ethical and emotional aspects. In the Indian scenario, reflection is taught in faculty development programs and as a part of short-term implementation projects. A more robust and nuanced effort is required to make reflection an inseparable component of the curriculum that will empower the graduates to be competent in the true sense.

Background: The defining attributes of intentional learning match the needed characteristics of students in competency-based education (CBE). The Learning Orientation Questionnaire measures these characteristics and can be used to facilitate improvement in these attitudes and skills, which results in higher order thinking and lifelong learning., Method: A longitudinal study was performed with nursing students ( N = 53) to determine if intentional learning scores continued to improve over time and were associated with student performance., Results: These students had significantly higher intentional learning scores at the end of the program than at the end of the second semester ( p < .001). Intentional learning scores were not associated with student performance at the end of the program ( p = .473)., Conclusion: As nursing programs transition to CBE, intentional learning theory can be used to support students. Nursing programs are advancing these characteristics but will need to do so earlier as they implement CBE. [ J Nurs Educ . 2024;63(8):552-555.] .

Purpose: The authors describe use of the workplace-based assessment (WBA) coactivity scale according to entrustable professional activities (EPAs) and assessor type to examine how diverse assessors rate medical students using WBAs., Method: A WBA data collection system was launched at Oregon Health and Science University to visualize learner competency in various clinical settings to foster EPA assessment. WBA data from January 14 to June 18, 2021, for medical students (all years) were analyzed. The outcome variable was level of supervisor involvement in each EPA, and the independent variable was assessor type., Results: A total of 7,809 WBAs were included. Most fourth-, third-, and second-year students were assessed by residents or fellows (755 [49.5%], 1,686 [48.5%], and 918 [49.9%], respectively) and first-year students by attending physicians (803 [83.0%]; P < .001). Attendings were least likely to use the highest rating of 4 (1 was available just in case; 2,148 [56.7%] vs 2,368 [67.7%] for residents; P < .001). Learners more commonly sought WBAs from attendings for EPA 2 (prioritize differential diagnosis), EPA 5 (document clinical encounter), EPA 6 (provide oral presentation), EPA 7 (form clinical questions and retrieve evidence-based medicine), and EPA 12 (perform general procedures of a physician). Residents and fellows were more likely to assess students on EPA 3 (recommend and interpret diagnostic and screening tests), EPA 4 (enter and discuss orders and prescriptions), EPA 8 (give and receive patient handover for transitions in care), EPA 9 (collaborate as member of interprofessional team), EPA 10 (recognize and manage patient in need of urgent care), and EPA 11 (obtain informed consent)., Conclusions: Learners preferentially sought resident versus attending supervisors for different EPA assessments. Future research should investigate why learners seek different assessors more frequently for various EPAs and if assessor type variability in WBA levels holds true across institutions., (Copyright © 2024 Written work prepared by employees of the Federal Government as part of their official duties is, under the U.S. Copyright Act, a “work of the United States Government” for which copyright protection under Title 17 of the United States Code is not available. As such, copyright does not extend to the contributions of employees of the Federal Government.)

Aim: To investigate the perspectives of clinical nurse educators regarding the challenges and essential elements of teaching competence in blended learning environments during nursing internships to inform the development of a competency-based teaching model., Background: Competency-based teaching and blended learning play important roles in enhancing the learning experience of nursing internship trainees. Internship trainees refer to nursing students undergoing supervised practical training in ‎clinical settings.‎ However, clinical nurse educators frequently encounter challenges in acquiring the necessary competence for successful implementation of blended learning strategies., Design: A descriptive‎ qualitative study., Methods: This study used semi-structured interviews with 11 certified nurse educators (CNEs) from diverse clinical disciplines in a tertiary hospital in China. Purposive sampling ensured diversity across key characteristics. Ethical approval was obtained and interviews were digitally recorded, transcribed and analyzed thematically. Theoretical saturation guided data collection, with precise measures taken to ensure confidentiality and anonymity. Thematic analysis, employing a constant comparison technique, systematically identified various themes related to blended teaching competence. This approach provided valuable insights into CNEs' perspectives and practices. The analysis involved theoretical sampling, line-by-line coding and comparative evaluation with supporting text materials., Results: The in-depth analysis of teaching competence among clinical nurse educators in blended learning settings during nurse internships revealed five key themes: professionalism, teaching literacy, subject expertise, information literacy and interpersonal communication., Conclusion: These themes recognized clinical nurse educators' perspectives towards establishing a competency-based nursing teaching model for a blended learning environment for nurse internships. Moreover, these perspectives are also crucial in enhancing teaching literacy through effective instructional methods, engagement strategies and the promotion of critical thinking skills. Identifying these themes contributes to efforts to improve teaching effectiveness and enhance learning outcomes for internship trainees in a blended learning context., Competing Interests: Declaration of Competing Interest The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper., (Copyright © 2024 Elsevier Ltd. All rights reserved.)

Abstract: Over the past decade, entrustable professional activities (EPAs) have become an important element in the competency-based medical education movement. In this Commentary, the authors explore informed consent as an EPA within resident surgical training. In doing so, they foreground the concept of culture and reexamine the nature of trust and entrustment decisions from within a cultural framework. The authors identify role modeling and professional identity formation as core elements in the training process and suggest that faculty are sometimes better off using these tools than uncritically adopting a formal EPA framework for what is, in essence, a professionally oriented and values-based moral enterprise. They conclude that EPAs work best when they are developed at a local level, stressing the unique culture of specialty and program as well as the care that must be taken when attempting to transfer notions of entrustment from the undergraduate medical education level to graduate medical education settings., (Copyright © 2024 the Association of American Medical Colleges.)

Objective: Feedback is a critically important tool in medical education. This pilot program applies and evaluates a competency-based approach to develop residents' skills in providing feedback to medical students., Methods: In 2018-2019, a competency-based resident feedback skills program incorporating videorecording of skills, multi-source feedback using assessment tools with validity evidence, and sequential deliberate practice was piloted in a single-center, prospective study at the University of Rochester. Study participants included eight second-year psychiatry residents and 23 third-year clerkship students. After an introduction to foundational feedback concepts in didactic sessions, residents were videorecorded providing feedback to medical students. Recordings were reviewed with a faculty member for feedback. Skills were assessed by students who had received resident feedback, residents, and faculty utilizing a tool with validity evidence. Observations were repeated a total of three times., Results: Mean feedback scores increased from 2.70 at the first feedback observation, to 2.77 at the second feedback observation, to 2.89 at the third feedback observation (maximum 3.00 points). The differences between the first and third sessions (0.19) and second and third sessions (0.12) were statistically significant (p values were < .001 and .007, with SE of 0.4 and 0.4, respectively)., Conclusions: The observed competency-based feedback skills training program for residents using sequential, multi-source review and feedback was feasible and effective. Direct observation is a key component of high-quality feedback, and videorecording is an efficient methodology for observations, enabling both direct observation by the assessor and opportunity for enhanced self-assessment by residents viewing themselves in the feedback encounter., (© 2024. The Author(s), under exclusive licence to Academic Psychiatry, LLC.)

Background More research is required to understand the effects of implementing structured goal-setting on trainee engagement in competency-based clinical learning environments. Objective To explore how residents experienced a rotation-specific goal-setting intervention on geriatric medicine rotations at 2 hospitals. Methods All rotating residents were expected to complete the intervention, consisting of a SMART-based (Specific, Measurable, Achievable, Relevant, and Time-Bound) goal-setting form and feedback sessions with teaching faculty. From November 2019 to June 2021, we recruited a convenience sample of rotating residents. Study participants completed pre- and postrotation 35-item Dutch Residency Educational Climate Test (D-RECT) questionnaires to compare scores from their rotation before the geriatric rotation and a postrotation semistructured interview, which we transcribed and analyzed using principles of constant comparison and reflexive thematic analysis. Results We interviewed 12 of 58 (20.7%) residents participating in the goal-setting intervention, 11 of whom completed both D-RECT questionnaires. Participants' D-RECT scores favored the geriatric medicine rotation versus the immediately preceding clinical rotation (M=4.29±0.37; M=3.84±0.44, P =.002). Analyses of interview transcripts yielded 3 themes on how participants perceived the intervention influenced their learning experience: (1) structured forms and processes mediate, inform, and constrain goal selection; (2) interactions with faculty, patients, and system factors influenced goal enactment; and (3) unstructured assessments led to uncertainty around goal achievement. Challenges included time restrictions and unpredictable clinical opportunities. Conclusions Goal-setting appeared to help many residents direct their learning efforts and engage in collaborative processes with teaching faculty. We identified challenges limiting residents' engagement with the goal-setting intervention, which may inform the practical implementation of goal-setting in other competency-based curricula.

Background: Entrustable Professional Activities (EPAs) have emerged as a valuable tool in medical education, enabling the assessment of trainee competence in a real-world context. Despite its growing popularity in other medical specialties, the use of EPAs in pediatric surgery is still relatively new., Methods: This article provides an overview of the development and application of EPAs in pediatric surgery. The key concepts and principles of EPAs, including the historical development and current implementation in other medical specialties, will also be reviewed. Definition of pediatric surgery EPAs, advantages, and challenges of implementing EPAs in pediatric surgery, and the evidence supporting the use of EPAs in pediatric surgical training will also be examined., Results: The use of EPAs in pediatric surgery has shown promise in providing a comprehensive and standardized approach to assessing trainee competence. By focusing on the essential tasks and responsibilities of a pediatric surgeon, EPAs can provide a framework for measuring trainee progress and ensuring that they possess the necessary skills to perform their duties independently. Challenges in implementing EPAs in pediatric surgery include the need for consensus on the definition and scope of EPAs, as well as the establishment of appropriate assessment and evaluation tools., Conclusion: The use of EPAs in pediatric surgery education and training has the potential to enhance the training and ultimately the quality of care delivered to pediatric surgical patients. The development of appropriate assessment and evaluation tools and frameworks will be crucial in implementing EPAs effectively in this field., Type of Study: Review., Competing Interests: Conflict of interest This work is from the Pediatric Surgery Board of the American Board of Surgery., (Published by Elsevier Inc.)

Introduction: Methods and validated tools for evaluating the performance of competency-based implementation research (IR) training programmes in low-middle-income countries (LMICs) are lacking. In this study, we developed tools for assessing the performance of IR training programmes based on a framework of IR core competencies in LMICs., Methods: We developed self-assessment and objective-assessment tools drawing on the IR competency framework. We used exploratory factor analyses and a one-parameter logistic model to establish construct validity and internal consistency of the tools drawing on a survey conducted in 2020 with 166 trainees before and after an index IR course across five universities and LMICs under the Special Program for Research and Training in Tropical Diseases postgraduate IR training scheme. We conducted key informant interviews (KII) with 20 trainees and five trainers to reflect on the usefulness of the tools and framework for guiding IR training in LMICs., Results: Two 16-item tools for self-assessment of IR knowledge and self-efficacy and a 40-item objective assessment tool were developed. The factor loadings of items in the self-assessment tools were 0.65-0.87 with Cronbach's alpha (α) of 0.97, and 0.77-0.91 with α of 0.98 for the IR knowledge and self-efficacy tools, respectively. The distribution of item difficulty in the objective-assessment tool was consistent before and after the index IR course. Pearson correlation coefficient (r) between the self-assessed and objectively assessed IR knowledge before the index IR course was low, r=0.27 (p value: <0.01), with slight improvements after the index IR course, r=0.43 (p value: <0.01). All KII respondents reported the assessment tools and framework were valid for assessing IR competencies., Conclusion: The IR competency framework and tools developed for assessing IR competencies and performance of IR training programmes in LMICs are reliable and valid. Self-assessment methods alone may not suffice to yield a valid assessment of performance in these settings., Competing Interests: Competing interests: None declared., (© Author(s) (or their employer(s)) 2024. Re-use permitted under CC BY-NC. No commercial re-use. See rights and permissions. Published by BMJ.)

Background: Simulation-based learning experiences allow undergraduate nursing students to develop competence and confidence through deliberate practice with immediate feedback on the learner's performance through debriefing. With the transition to competency-based nursing education, nursing faculty need more guidance in implementing competency-based evaluations in the simulation setting., Purpose: This Delphi study aims to inform the future development of a competency-based tool - SimComp - based on the American Association of Colleges of Nursing (AACN) Essentials., Methods: A Delphi framework was used to recruit expert nursing faculty to complete the surveys via an online platform. Data analysis occurred through open-ended questions and quantitative methods to ensure that the responses from expert panelists were used to form the results., Results: After four rounds of this Delphi study, a consensus was achieved on 111 appropriate items for assessing competence in the simulation-based learning environment., Conclusion: While further research is warranted, this study provides insight for nursing institutions considering implementing or increasing the use of simulation within their program for competency-based evaluations., Competing Interests: Declaration of competing interest The authors report there are no competing interests to declare., (Copyright © 2024 Elsevier Inc. All rights reserved.)

Objectives: The primary objective of the study was to assess the factors that influenced the increased failure rate among first-year Indian medical students who appeared for the Maharashtra University of Health Science (MUHS) summative university examination, having experienced the competency-based medical education (CBME) curriculum for the first time amid the coronavirus disease (COVID-19) pandemic., Methods: A retrospective cross-sectional online questionnaire-based study was undertaken between July 2021 and November 2021, in which first-year Indian medical students who were enrolled in the Bachelor of Medicine, Bachelor of Surgery (MBBS) program in the year 2019 and appeared for the MUHS summative university examination in February 2021 were invited to participate. Analysis was done using JASP (v0.16.0.0), and the odds ratio for failure was calculated at a significance level of P < 0.05., Results: Responses were obtained from 360 individuals, of whom 74.5% had passed and 25.5% had failed (n = 360). The odds of failure in first-year MBBS summative university examination was higher in students with irregular Internet access, irregular device access, an unsupportive peer environment in college, a National Entrance cum Eligibility Test score below 500, an unsupportive family environment during the lockdown, severe stress, severe depression, testing positive for COVID-19 before the exam, death in the family during the exam, and failing in terms and prelims and students of male gender ( P < 0.01)., Conclusion: The total failure rate of 27% in the MUHS examination was mainly attributed to interplay between the student's mental health, lack of devices or Internet, and the changed assessment part of the CBME curriculum. Surprisingly, lecture frequencies, teaching patterns, and study resources did not influence the failure rate. These results can be used to formulate interventions that will help to improve academic performance and mental health students and thus help them adapt to the new curriculum., (Copyright © 2024 Copyright: © 2024 Journal of Postgraduate Medicine.)

Central venous catheter (CVC) placement is a challenging procedure with known iatrogenic risks. However, there are no residency program requirements to demonstrate baseline CVC procedural competency. Competency-based procedural education has been shown to decrease CVC-associated morbidity, but there has been limited literature about institution-wide efforts to ensure initial trainee competency for CVC placement. This study describes the implementation of a competency-based CVC curriculum for first-year interns across an institution before supervised clinical care. An institution-wide, simulation-based mastery training curriculum was designed to assess initial competency in CVC placement in first-year residents during 2021 and 2022. A checklist was internally developed with a multidisciplinary team. Using the Mastery-Angoff technique, minimum passing standards were derived to define competency levels considered appropriate for intern participation in supervised clinical care. Interns were trained through the competency-based program with faculty assessing intern performance using the CVC checklist to verify procedural competency. Over 2 academic cycles, 229 interns from 20 specialties/subspecialties participated. Overall, 83% of interns met performance standards on their first posttest attempt, 14% on the second attempt, and 3% on the third attempt. Interns from both cycles demonstrated significant improvement from baseline to posttest scores (P < .001). Overall, 10.5% of interns performed dangerous actions during assessment (malpositioning, retained guidewire, or carotid dilation). All interns ultimately achieved the passing standard to demonstrate initial competency in the simulation assessment. All participating interns demonstrated simulation-based competency allowing them to place CVCs under supervised clinical care. Dangerous actions, however, were not uncommon. Simulation-based teaching and learning frameworks were a feasible method to promote patient safety through an institutional-wide verification of preliminary procedural competency., Competing Interests: The authors have no funding and conflicts of interest to disclose., (Copyright © 2024 the Author(s). Published by Wolters Kluwer Health, Inc.)

Background The integration of entrustable professional activities (EPAs) within objective structured clinical examinations (OSCEs) has yielded a valuable avenue for delivering timely feedback to residents. However, concerns about feedback quality persist. Objective This study aimed to assess the quality and content alignment of verbal feedback provided by examiners during an entrustment-based OSCE. Methods We conducted a progress test OSCE for internal medicine residents in 2022, assessing 7 EPAs. The immediate 2-minute feedback provided by examiners was recorded and analyzed using the Quality of Assessment of Learning (QuAL) score. We also analyzed the degree of alignment with EPA learning objectives: competency milestones and task-specific abilities. In a randomized crossover experiment, we compared the impact of 2 scoring methods used to assess residents' clinical performance (3-point entrustability scales vs task-specific checklists) on feedback quality and alignment. Results Twenty-one examiners provided feedback to 67 residents. The feedback demonstrated high quality (mean QuAL score 4.3 of 5) and significant alignment with the learning objectives of the EPAs. On average, examiners addressed in their feedback 2.5 milestones (61%) and 1.2 task-specific abilities (46%). The scoring methods used had no significant impact on QuAL scores (95% CI -0.3, 0.1, P =.28), alignment with competency milestones (95% CI -0.4, 0.1, P =.13), or alignment with task-specific abilities (95% CI -0.3, 0.1, P =.29). Conclusions In our entrustment-based OSCE, examiners consistently offered valuable feedback aligned with intended learning outcomes. Notably, we explored high-quality feedback and alignment as separate dimensions, finding no significant impact from our 2 scoring methods on either aspect.

Background: Across medical specialties, including nuclear cardiology, competency based medical education (CBME) changes the emphasis of learning from a time or experiential emphasis to a proficiency focused approached. Plotted on a learning-curve graph the emphasis on learning has shifted from the duration/ volume-based x-axis to the performance-based y-axis., Current Status: It has proven difficult to establish y-axis-based standards within nuclear cardiology to assess learning. As such there is a paucity of data to verify current experiential training targets and only recently is data emerging that seeks to find CBME targets by which proficiency (y-axis units) can be evaluated. Initial reports from such CBME-oriented studies indicate that in current nuclear cardiology practice, the number of studies required to achieve competency is dependent upon the chosen measure of competency that is assessed (summed stress score versus % LV ischemia), the case mix, and the modality being learnt (PET versus SPECT). Recent findings have also suggested that prior levels of experiential training may be an underestimation of the number of supervised studies learners need to interpret before they achieve competency., Summary: Nuclear cardiology training has adopted the concept of CBME and is progressing toward a more modern approach to trainee assessment. This brief review provides the background, current requirements and insights into new developments in nuclear cardiology training., Competing Interests: Declaration of Competing Interest Dr Small has received honoraria and research funding from Pfizer. Dr Chow receives research support from TD Bank, Siemens Healthineers, and Artrya. He has an equity interest in Artrya., (Copyright © 2024. Published by Elsevier Inc.)

Objective: This study aimed to define competency-based education (CBE) for pharmacy education and describe how strengths and barriers of CBE can support or hinder implementation., Findings: Sixty-five studies were included from a variety of health professions in order to define competency based pharmacy education (CBPE) and identify barriers and benefits from the learner, faculty, institution, and society perspectives. From the 7 identified thematic categories, a CBPE definition was developed: "Competency-based pharmacy education is an outcomes-based curricular model of an organized framework of competencies (knowledge, skills, attitudes) for pharmacists to meet health care and societal needs. This learner-centered curricular model aligns authentic teaching and learning strategies and assessment (emphasizing workplace assessment and quality feedback) while deemphasizing time.", Summary: This article provides a definition of CBE for its application within pharmacy education. The strengths and barriers for CBE were elucidated from other health professions' education literature. Identified implementation strengths and barriers aid in the discussions on what will support or hinder the implementation of CBE in pharmacy education., Competing Interests: Declaration of Competing Interest None declared., (Copyright © 2024 American Association of Colleges of Pharmacy. Published by Elsevier Inc. All rights reserved.)

Background: Structured competency-based training is one of the most frequently articulated wishes of residents., Methods: A survey of 19 residents was conducted regarding their satisfaction with the resident education at a level 1 trauma center. In this article the development of a revised competency-based education concept was carried out., Results: The survey reflected uncertainty as to whether the current structures could meet the requirements of the residency regulations. The improved competency-based education concept consists of clinical mentoring, competency-based catalogs of learning objectives, regular theoretical and practical workshops as well as regular and structured staff evaluations., Conclusion: The education concept presented reflects the attempt to establish a contemporary surgical training program which will be evaluated as it progresses., (© 2024. The Author(s).)

Objectives: We aimed to define and map subcompetencies required for pediatric cardiac critical care (PCCC) fellowship education and training under the auspices of the Pediatric Cardiac Intensive Care Society (PCICS). We used the 2022 frameworks for PCCC fellowship learning objectives by Tabbutt et al and for entrustable professional activities (EPAs) by Werho et al and integrated new subcompetencies to the EPAs. This complementary update serves to provide a foundation for standardized trainee assessment tools for PCCC., Design: A volunteer panel of ten PCICS members who are fellowship education program directors in cardiac critical care used a modified Delphi method to develop the update and additions to the EPA-based curriculum. In this process, the experts rated information independently, and repetitively after feedback, before reaching consensus. The agreed new EPAs were later reviewed and unanimously accepted by all PCICS program directors in PCCC in the United States and Canada and were endorsed by the PCICS in 2023., Procedure and Main Results: The procedure for defining new subcompetencies to the established EPAs comprised six consecutive steps: 1) literature search; 2) selection of key subcompetencies and curricular components; 3) written questionnaire; 4) consensus meeting and critical evaluation; 5) approval by curriculum developers; and 6) PCICS presentation and endorsement. Overall, 110 subcompetencies from six core-competency domains were mapped to nine EPAs with defined levels of entrustment and examples of simple and complex cases. To facilitate clarity and develop a future assessment tool, three EPAs were subcategorized with subcompetencies mapped to the appropriate subcategory. The latter covering common procedures in the cardiac ICU., Conclusions: This represents the 2023 update to the PCCC fellowship education and training EPAs with the defining and mapping of 110 subcompetencies to the nine established 2022 EPAs. This goal of this update is to serve as the next step in the integration of EPAs into a standardized competency-based assessment framework for trainees in PCCC., Competing Interests: The authors have disclosed that they do not have any potential conflicts of interest., (Copyright © 2024 by the Society of Critical Care Medicine and the World Federation of Pediatric Intensive and Critical Care Societies.)

Background In medical education, artificial intelligence techniques such as natural language processing (NLP) are starting to be used to capture and analyze emotions through written text. Objective To explore the application of NLP techniques to understand resident and faculty emotions related to entrustable professional activity (EPA) assessments. Methods Open-ended text data from a survey on emotions toward EPA assessments were analyzed. Respondents were residents and faculty from pediatrics (Peds), general surgery (GS), and emergency medicine (EM), recruited for a larger emotions study in 2023. Participants wrote about their emotions related to receiving/completing EPA assessments. We analyzed the frequency of words rated as positive via a validated sentiment lexicon used in NLP studies. Specifically, we were interested if the count of positive words varied as a function of group membership (faculty, resident), specialty (Peds, GS, EM), gender (man, woman, nonbinary), or visible minority status (yes, no, omit). Results A total of 66 text responses (30 faculty, 36 residents) contained text data useful for sentiment analysis. We analyzed the difference in the count of words categorized as positive across group, specialty, gender, and being a visible minority. Specialty was the only category revealing significant differences via a bootstrapped Poisson regression model with GS responses containing fewer positive words than EM responses. Conclusions By analyzing text data to understand emotions of residents and faculty through an NLP approach, we identified differences in EPA assessment-related emotions of residents versus faculty, and differences across specialties.

Background: Entrustable professional activities (EPAs) are gaining attention as an approach for adequate implementation of a competency-based evaluation framework in nursing education. This study sought to develop an Online Web-assessment Interface for Entrustment Decision (OWIED) to facilitate the entrustment decision in EPA implementation., Method: A participatory qualitative action research design consisting of two phases was used for this study. The exploration phase was conducted in close collaboration with stakeholders. Following the exploration phase, the primary researcher and a team of subject-matter experts in academic and information technology developed the OWIED system according to the exploration phase results., Results: The necessary features that met the expectations of the stakeholders were identified and assisted in developing the OWIED system., Conclusion: OWIED may provide a valid tool to track and validate nursing student acquisition of core competencies and assist in making entrustment decisions as students fulfill their training requirements in their academic program. [ J Nurs Educ . 2024;63(6):356-365.] .

Abstract: The importance of the clinician educator (CE) role in delivery of competency-based medical education is well recognized. There is, however, no formal mechanism to identify when faculty have the knowledge, skills, and attitudes to be successful CEs. In 2020, the Accreditation Council for Graduate Medical Education, Accreditation Council for Continuing Medical Education, Association of American Medical Colleges, and American Association of Colleges of Osteopathic Medicine convened a workgroup of 18 individuals representing multiple medical specialties and diverse institutions in the United States, including nonphysician educators, a medical student, and a resident, to develop a set of competencies, subcompetencies, and milestones for CEs.A 5-step process was used to create the Clinician Educator Milestones (CEMs). In step 1, the workgroup developed an initial CEM draft. Through brainstorming, 141 potential education-related CE tasks were identified. Descriptive statements for each competency and developmental trajectories for each subcompetency were developed and confirmed by consensus. The workgroup then created a supplemental guide, assessment tools, and additional resources. In step 2, a diverse group of CEs were surveyed in 2021 and provided feedback on the CEMs. In step 3, this feedback was used by the workgroup to refine the CEMs. In step 4, the second draft of the CEMs was submitted for public comment, and the CEMs were finalized. In step 5, final CEMs were released for public use in 2022.The CEMs consist of 1 foundational domain that focuses on commitment to lifelong learning, 4 additional domains of competence for CEs in the learning environment, and 20 subcompetencies. These milestones have many potential uses for CEs, including self-assessment, constructing learning and improvement plans, and designing systematic faculty development efforts. The CEMs will continue to evolve as they are applied in practice and as the role of CEs continues to grow and develop., (Copyright © 2024 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the Association of American Medical Colleges.)

Objective: Entrustable professional activities (EPAs) are a crucial component of contemporary postgraduate medical education with many surgery residency programs having implemented EPAs as a competency assessment framework to assess and provide feedback on the performance of their residents. Despite broad implementation of EPAs, there is a paucity of evidence regarding the impact of EPAs on the learners and learning environments. A first step in improving understanding of the use and impact of EPAs is by mapping the rising number of EPA-related publications from the field of surgery. The primary objective of this scoping review is to examine the nature, extent, and range of articles on the development, implementation, and assessment of EPAs. The second objective is to identify the experiences and factors that influence EPA implementation and use in practice in surgical specialties., Design: Scoping review. Four electronic databases (Medline, Embase, Education Source, and ERIC) were searched on January 20, 2022, and then again on July 19, 2023. A quasi-statistical content analysis was employed to quantify and draw meaning from the information related to the development, implementation, assessment, validity, reliability, and experiences with EPAs in the workplace., Participants: A total of 42 empirical and nonempirical articles were included., Results: Four thematic categories describe the topic areas in included articles related to: 1) the development and refinement of EPAs, including the multiple steps taken to develop and refine unique EPAs for surgery residency programs; 2) the methods for implementing EPAs; 3) outcomes of EPA use in practice; 4) barriers, facilitators, and areas for improvement for the implementation and use of EPAs in surgical education., Conclusions: This scoping review highlights the key trends and gaps from the rapidly increasing number of publications on EPAs in surgery residency, from development to their use in the workplace. Existing EPA studies lack a theoretical and/or conceptual basis; future development and implementation studies should adopt implementation science frameworks to better structure and operationalize EPAs within surgery residency programs., (Copyright © 2024 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.)

Background As medical education programs transition to competency-based medical education (CBME), experiences transitioning in the context of small subspecialty programs remain unknown, yet they are needed for effective implementation and continual improvements. Objective To examine faculty and resident experiences transitioning to CBME in a small subspeciality program. Methods Using a qualitative descriptive approach and constructivist lens, faculty and residents in McMaster University's geriatric psychiatry subspecialty program were interviewed about their transition experiences between November 2021 and February 2022, after the program's soft launch of CBME in 2020. Interviews were transcribed and data were analyzed using thematic analysis. Reflexive memo writing and investigator and data triangulation strategies were employed to ensure rigor and trustworthiness of the data. Results Ten of the 17 faculty members (59%) and 3 residents (100%) participated. Six themes were developed: (1) Both faculty and residents see themselves as somewhat knowledgeable about CBME, but sources of knowledge vary; (2) More frequent feedback is beneficial; (3) Aspects of CBME that are challenging for residents are beneficial for faculty; (4) Competence committees are perceived positively despite most participants' limited firsthand experience with them; (5) Small program size is both a barrier and facilitator to providing and receiving feedback; and (6) Suggestions for improvement are centered on helping manage faculty and resident workload imposed by CBME. Conclusions Incongruent expectations surrounding entrustable professional activity management were highlighted as an area requiring support. Collegial relationships among faculty and residents made it difficult for faculty to provide constructive feedback but improved residents' perceptions of the feedback.

Introduction: Entrustable professional activities (EPAs) are units of concrete daily clinical tasks that trainee physicians should be able to handle with increasing autonomy during their postgraduate training. EPAs are gaining international recognition as an essential component of competency-based medical training programmes. The process of developing EPAs for a nationwide training programme is complex and requires an in-depth understanding of EPAs as a concept and good knowledge of appropriate development processes. This article provides a detailed description of the methodology and results of a multi-step approach for developing a list of candidate EPAs for Switzerland's postgraduate training programme in general internal medicine (GIM)., Methods: We took a multi-step approach including a systematic review of international literature, four national focus groups, a national consensus process using a RAND appropriateness method, and a quality check of the selected candidate EPAs using EQual criteria., Results: These steps generated a final list of 247 candidate EPAs in general internal medicine that were submitted for the national consensus process. After two rounds of rating, experts agreed on the appropriateness for general internal medicine postgraduate training of 225 candidate EPAs. Twenty-two were deemed inappropriate, and disagreement persisted only for two EPAs., Discussion: This multi-step programme is one of the few describing in detail the process of developing a list of EPAs and providing evidence of validity at each step. The clinical breadth of our candidate EPAs, together with the detailed description of our methodology, could serve as a useful starting point from which medical education specialists or clinicians could develop or revise applicable lists of EPAs, particularly for postgraduate training programmes in either general internal medicine or family medicine.

Background: The current paradigm of competency-based medical education and learner-centredness requires learners to take an active role in their training. However, deliberate and planned continual assessment and performance improvement is hindered by the fragmented nature of many medical training programs. Attempts to bridge this continuity gap between supervision and feedback through learner handover have been controversial. Learning plans are an alternate educational tool that helps trainees identify their learning needs and facilitate longitudinal assessment by providing supervisors with a roadmap of their goals. Informed by self-regulated learning theory, learning plans may be the answer to track trainees' progress along their learning trajectory. The purpose of this study is to summarise the literature regarding learning plan use specifically in undergraduate medical education and explore the student's role in all stages of learning plan development and implementation., Methods: Following Arksey and O'Malley's framework, a scoping review will be conducted to explore the use of learning plans in undergraduate medical education. Literature searches will be conducted using multiple databases by a librarian with expertise in scoping reviews. Through an iterative process, inclusion and exclusion criteria will be developed and a data extraction form refined. Data will be analysed using quantitative and qualitative content analyses., Discussion: By summarising the literature on learning plan use in undergraduate medical education, this study aims to better understand how to support self-regulated learning in undergraduate medical education. The results from this project will inform future scholarly work in competency-based medical education at the undergraduate level and have implications for improving feedback and supporting learners at all levels of competence., Scoping Review Registration: Open Science Framework osf.io/wvzbx., (© 2024. The Author(s).)

Objectives: The purpose of this educational intervention was to introduce, iteratively adapt, and implement a digital formative assessment tool in a surgical speciality. The study also evaluated the intervention's impact on perioperative teaching, learning, feedback, and surgical competency., Design: A participatory action research model with a mixed methods approach., Setting: This study was performed over 10 months in an institutional hospital in South Africa with a general surgery department., Participants: Twelve supervising surgical trainers/faculty and 12 surgical trainees/residents consented to participate in the intervention., Results: The first 4 months of the intervention focused on relationship building, a multi-stakeholder contextual needs assessment and training sessions to support a shared mindset and shift in the teaching and learning culture. The final adapted perioperative competency-building tool comprised a 23-item assessment with four open-text answers (Table 1). Over the following 6-month period, 48 workplace-based competency-building perioperative evaluations were completed. Most trainees took less than 5 minutes to self-assess (67%) before most trainers (67%) took less than 5 minutes to give oral feedback to the trainee after the perioperative supervised learning encounter. On average, the digital tool took 6 minutes to complete during the bidirectional perioperative teaching and learning encounter with no negative impact on the operational flow. All trainers and trainees reported the training and implementation of the digital tool to be beneficial to teaching, learning, feedback, and the development of surgical competency. Analysis of the completed tools revealed several trainees showing evidence of progression in surgical competency for index procedures within the speciality. The focus groups and interviews also showed a change in the teaching and learning culture: more positively framed, frequent, structured, and specific feedback, improved accountability, and trainee-trainer perioperative readiness for teaching. Highlighted changes included the usefulness of trainee self-assessment before perioperative trainer feedback and the tool's value in improving competency to Kirkpatrick Level 4., Conclusion: Implementing an adapted digital Workplace-Based Assessment (WBA) tool using a participatory action research model has proven successful in enhancing the effectiveness of supervised perioperative teaching and learning encounters. This approach has improved teaching and feedback practices, facilitated the development of surgical competency, and ultimately impacted the overall culture to Kirkpatrick level 4. Importantly, it has positively influenced the trainee-trainer relationship dynamic. Based on these positive outcomes, we recommend using this effective method and our relationship-centred framework for implementing formative competency-building tools in future studies. By doing so, larger-scale and successful implementation of Competency-Based Medical Education (CBME) could be achieved in various contexts. This approach can potentially enhance teaching and learning encounters, promote competency development, and improve the overall educational experience for surgical trainees and trainers., (Copyright © 2024 The Author(s). Published by Elsevier Inc. All rights reserved.)

A Transition to Foundations (TTF) curriculum that includes didactic and simulation components prepares first-year pediatric residents for increased roles and responsibilities in the Foundations of Discipline stage of Competency Based Medical Education, including junior night float rotations. Simulations of acute presentations improve resident comfort before overnight on-call experiences., Competing Interests: There is no conflict of interest or funding for this project., (© 2024 Mazze, Mak, Pavalagantharajah, Hunter; licensee Synergies Partners.)

Purpose: The purpose of the quality improvement (QI) project was to provide a learner and faculty preceptor high quality virtual clinical practicum (VCP) for Wound, Ostomy, Continence (WOC) Nurse learners during the COVID-19 pandemic and disseminate findings., Participants and Setting: Project participants were registered nurses post-bachelor's degree or higher with a minimum of 1-year clinical experience who had completed and passed the didactic portion of a Wound Ostomy Continence Nursing Education Program (WOCNEP). Learners completing the WOCNEP's VCP and the faculty preceptors were the subjects for this QI report. The setting was a virtual platform allowing live time visibility and interactions between learners and faculty preceptors including the ability to share documents and procedural videos. An initial group of 62 learners were asked open-ended questions after completion of the VCP; the most frequently recurring themes were converted into 5-point Likert scale questions as the evaluation tool completed by an additional 234 learners. In total, 296 learners completing the VCP evaluated this novel 100% simulation virtual practicum., Approach: This QI project evaluated a 100% simulation-based practicum at a WOCENP based in the United States. A competency based VCP used the Competency Outcomes and Performance Assessment (COPA) model. Learners were taught competencies via a preparatory virtual lab and then had to prepare documents and videos or pictures with step-by-step instructions prior to attending a Live Competency Assessment Lab with faculty preceptors and a small group of peer learners., Outcomes: Appraisal of the VCP was based on course evaluations anonymously completed by each of the 296 learners. Faculty preceptors were queried regarding their VCP evaluation and certification exam pass rates were tallied. Findings indicate positive outcomes of the VCP competency-based practicum from student and faculty preceptor perspectives along with higher certification pass rates; specifically, wound care pass rates increased by 16%, ostomy care increased by 18% and continence care pass rates increased by 13%., Implications for Practice: Our reported experiences strongly suggest a VCP offers an attractive option for fulfilling practicum requirements while reducing barriers of the in-person split option practicum., Competing Interests: The authors have no conflicts of interest to disclose., (Copyright © 2024 by the Wound, Ostomy and Continence Nurses Society.)

Purpose: Learner development and promotion rely heavily on narrative assessment comments, but narrative assessment quality is rarely evaluated in medical education. Educators have developed tools such as the Quality of Assessment for Learning (QuAL) tool to evaluate the quality of narrative assessment comments; however, scoring the comments generated in medical education assessment programs is time intensive. The authors developed a natural language processing (NLP) model for applying the QuAL score to narrative supervisor comments., Method: Samples of 2,500 Entrustable Professional Activities assessments were randomly extracted and deidentified from the McMaster (1,250 comments) and Saskatchewan (1,250 comments) emergency medicine (EM) residency training programs during the 2019-2020 academic year. Comments were rated using the QuAL score by 25 EM faculty members and 25 EM residents. The results were used to develop and test an NLP model to predict the overall QuAL score and QuAL subscores., Results: All 50 raters completed the rating exercise. Approximately 50% of the comments had perfect agreement on the QuAL score, with the remaining resolved by the study authors. Creating a meaningful suggestion for improvement was the key differentiator between high- and moderate-quality feedback. The overall QuAL model predicted the exact human-rated score or 1 point above or below it in 87% of instances. Overall model performance was excellent, especially regarding the subtasks on suggestions for improvement and the link between resident performance and improvement suggestions, which achieved 85% and 82% balanced accuracies, respectively., Conclusions: This model could save considerable time for programs that want to rate the quality of supervisor comments, with the potential to automatically score a large volume of comments. This model could be used to provide faculty with real-time feedback or as a tool to quantify and track the quality of assessment comments at faculty, rotation, program, or institution levels., (Copyright © 2024 the Association of American Medical Colleges.)

Background: As medical institutions shift towards Competency Based Education, more effort is being directed towards understanding how healthcare teams' function competently. While many have studied the competencies required to be a successful clerk, few have examined this question within the context of team function and integration. Our primary objective is to identify how medical clerks successfully integrate and contribute to clinical teaching teams., Methods: We performed a scoping review of the literature using the Ovid MEDLINE database. Data was extracted and thematically analysed in accordance with Arksey and O'Malley's (2005) approach to descriptive analysis., Results: Out of 1368 papers returned by our search, 12 studies were included in this review. Seven main themes were identified amongst the included studies: (1) Communication (2) Taking Responsibility and Appropriate Autonomy (3) Humility and Knowing When to Ask for Help (4) Identity as a Team Member, (5) Self-Efficacy (6) Rapport and Relationship Building (7) Patient Advocacy., Conclusion: Analysis of these themes revealed four major findings: (i) The importance of documentation skills and communication towards team contribution (ii) The important connection between professional identity development and self-efficacy (iii) The impact of rapport on the reciprocity of trust between team members (iv) The role of clerks as patient advocates is poorly understood. This review also illustrates that there is a relative dearth of literature in this area. Future studies are needed to develop clear guidance on how clerks should perform these competencies in the context of team function and integration., Competing Interests: The authors have no conflicts of interest to declare., (© 2024 Lively, Gasim, Liu, Lingard; licensee Synergies Partners.)

Objective: The purpose of this qualitative study was to examine responses related to entrustment and feedback comments from an assessment tool., Design: Qualitative analyses using semi-structured interviews and analysis of narrative comments., Setting: Main hospital OR suite at a large academic medical center., Participants: faculty, and residents who work in the OR suite., Results: Seven of the 14 theoretical domains from the Theoretical Domains Framework were identified as influencing faculty decision on entrustment: knowledge, skills, intention, memory/attention/decision processes, environmental context, and resources, beliefs of capabilities, and reinforcement. The majority (651/1116 (58.4%)) of faculty comments were critical/modest praise and relevant, consistent across all 6 EPAs. The written in feedback comments for all 1,116 Web App EPA assessments yielded a total of 1,599 sub-competency specific responses. These responses were mapped to core competencies, and at least once to 13 of the 23 ACGME subcompetencies., Conclusions: Domains identified as influencing faculty decision on entrustment were knowledge, skills, intention, memory/attention/decision processes, environmental context, and resources, beliefs of capabilities, and reinforcement. Most narrative feedback comments were critical/modest praise and relevant, consistent across each of the EPAs., (Copyright © 2024 Association of Program Directors in Surgery. Published by Elsevier Inc. All rights reserved.)

Background: Self-reflection is a valuable method that nurse educators can use to develop clinical judgment skills among prelicensure nursing students. Little research exists on improving clinical judgment in second-degree nursing students in the clinical setting., Purpose: To determine the implications of increasing clinical judgment skills in prelicensure nursing students using a shared structured reflection teaching innovation within a required baccalaureate clinical course., Methods: This educational innovation used qualitative descriptive methods to evaluate its effectiveness in the clinical setting among students in the final semester of an accelerated prelicensure nursing program., Results: Students reported increased accountability for their learning, a sense of intentionality with their nursing practice, and a deeper sense of community with their peers., Conclusions: Shared reflective practices in the clinical setting show promise for increasing clinical judgment and supporting a competency-based curriculum., Competing Interests: The authors declare no conflicts of interest., (Copyright © 2023 Wolters Kluwer Health, Inc. All rights reserved.)

Problem: Competency-based medical education is increasingly regarded as a preferred framework for physician training, but implementation is limited. U.S. residency programs remain largely time based, with variable assessments and limited opportunities for individualization. Gaps in graduates' readiness for unsupervised care have been noted across specialties. Logistical barriers and regulatory requirements constrain movement toward competency-based, time-variable (CBTV) graduate medical education (GME), despite its theoretical benefits., Approach: The authors describe a vision for CBTV-GME and an implementation model that can be applied across specialties. Termed "Promotion in Place" (PIP), the model relies on enhanced assessment, clear criteria for advancement, and flexibility to adjust individuals' responsibilities and time in training based on demonstrated competence. PIP allows a resident's graduation to be advanced or delayed accordingly. Residents deemed competent for early graduation can transition to attending physician status within their training institution and benefit from a period of "sheltered independence" until the standard graduation date. Residents who need extended time to achieve competency have graduation delayed to incorporate additional targeted education., Outcomes: A proposal to pilot the PIP model of CBTV-GME received funding through the American Medical Association's "Reimagining Residency" initiative in 2019. Ten of 46 residency programs in a multihospital system expressed interest and pursued initial planning. Seven programs withdrew for reasons including program director transitions, uncertainty about resident reactions, and the COVID-19 pandemic. Three programs petitioned their specialty boards for exemptions from time-based training. One program was granted the needed exemption and launched a PIP pilot, now in year 4, demonstrating the feasibility of implementing this model. Implementation tools and templates are described., Next Steps: Larger-scale implementation with longer-term assessment is needed to evaluate the impact and generalizability of this CBTV-GME model., (Copyright © 2024 The Author(s). Published by Wolters Kluwer Health, Inc. on behalf of the Association of American Medical Colleges.)