Search

Quality improvement knowledge is a requirement of fellowship training. Our goal was to evaluate the efficacy of a 3-year quality improvement and patient safety (QI/PS) curriculum that gives fellows both didactic knowledge and first-hand experience with improvement science, and meets Clinical Learning Environment Review (CLER) requirements. Knowledge assessment is obtained through pre- and post-surveys. A secondary measure of success is academic products resulting from fellows' QI/PS work, and future participation in QI/PS efforts. Since 2019, 51 pre-tests and 36 post-tests were completed, showing improvement across all competencies. Fellows have produced one published manuscript, two poster presentations, and two oral presentations describing their improvement work. Additionally, mentoring faculty members have gone on to lead other QI work throughout the division. This longitudinal QI/PS curriculum provides both knowledge and experience in QI/PS work. It also creates opportunities for academic publications and presentations, builds faculty expertise, and most importantly, works to improve multiple aspects of patient care. This curriculum can serve as a model for other cardiology fellowships working to meet CLER requirements. [ABSTRACT FROM AUTHOR]

Bedside teaching (BST) is a core element of medical education. In light of a reported decrease in BST, evidence on how to use BST time most efficiently should be developed. Given that little research into the tangible quality characteristics of good BST has been reported, we investigated the influence of various teacher and structural characteristics on the perceived quality of BST. We filmed and coded 36 BSTs involving 24 lecturers and 259 students. Structural characteristics of interest were: number of students and patients, overall duration, and the proportion of clinical examination. Lecturer questionnaires provided insight into teaching experience and intrinsic motivation, and student evaluations assessed the quality of BSTs in three dimensions. Correlations are reported using the Pearson r and a linear mixed model (LMM). The intrinsic motivation of lecturers was significantly positively correlated with perceived quality, but their experience was only weakly so correlated. In the LMM, a significant association was observed for the quality dimension of clinical teaching with the number of patients and the proportion of time spent on clinical examination. Based on our findings, we recommend including multiple patients in BSTs, and providing substantial opportunities for clinical examination. Regarding lecturers, motivation matters more than experience. [ABSTRACT FROM AUTHOR]

Powerful medical education (PME) involves the use of new technologies informed by the science of expertise that are embedded in laboratories and organizations that value evidence-based education and support innovation. This contrasts with traditional medical education that relies on a dated apprenticeship model that yields uneven results. PME involves an amalgam of features, conditions and assumptions, and contextual variables that comprise an approach to developing clinical competence grounded in education impact metrics including efficiency and cost-effectiveness. This article is a narrative review based on SANRA criteria and informed by realist review principles. The review addresses the PME model with an emphasis on mastery learning and deliberate practice principles drawn from the new science of expertise. Pub Med, Scopus, and Web of Science search terms include medical education, the science of expertise, mastery learning, translational outcomes, cost effectiveness, and return on investment. Literature coverage is comprehensive with selective citations. PME is described as an integrated set of twelve features embedded in a group of seven conditions and assumptions and four context variables. PME is illustrated via case examples that demonstrate improved ventilator patient management learning outcomes compared to traditional clinical education and mastery learning of breaking bad news communication skills. Evidence also shows that PME of physicians and other health care providers can have translational, downstream effects on patient care practices, patient outcomes, and return on investment. Several translational health care quality improvements that derive from PME include reduced infections; better communication among physicians, patients, and families; exceptional birth outcomes; more effective patient education; and return on investment. The article concludes with challenges to hospitals, health systems, and medical education organizations that are responsible for producing physicians who are expected to deliver safe, effective, and cost-conscious health care. [ABSTRACT FROM AUTHOR]

Clinical supervisors are known to assess trainee performance idiosyncratically, causing concern about the validity of their ratings. The literature on this issue relies heavily on retrospective collection of decisions, resulting in the risk of inaccurate information regarding what actually drives raters' perceptions. Capturing in-the-moment information about supervisors' impressions could yield better insight into how to intervene. The purpose of this study, therefore, was to gather "real-time" judgments to explore what drives preceptors' judgments of student performance. We performed a prospective study in which physicians were asked to adjust a rating scale in real-time while watching two video-recordings of trainee clinical performances. Scores were captured in 1-s increments, examined for frequency, direction, and magnitude of adjustments, and compared to assessors' final entrustability judgment as measured by the modified Ottawa Clinic Assessment Tool. The standard deviation in raters' judgment was examined as a function of time to determine how long it takes impressions to begin to vary. 20 participants viewed 2 clinical vignettes. Considerable variability in ratings was observed with different behaviours triggering scale adjustments for different raters. That idiosyncrasy occurred very quickly, with the standard deviation in raters' judgments rapidly increasing within 30 s of case onset. Particular moments appeared to generally be influential, but their degree of influence still varied. Correlations between the final assessment and (a) score assigned upon first adjustment of the scale, (b) upon last adjustment, and (c) the mean score, were r = 0.13, 0.32, and 0.57 for one video and r = 0.30, 0.50, and 0.52 for the other, indicating the degree to which overall impressions reflected accumulation of raters' idiosyncratic moment-by-moment observations. Our results demonstrated that variability in raters' impressions begins very early in a case presentation and is associated with different behaviours having different influence on different raters. More generally, this study outlines a novel methodology that offers a new path for gaining insight into factors influencing assessor judgments. [ABSTRACT FROM AUTHOR]

There is increasing interest in how student engagement can be enhanced in medical schools: not just engagement with learning but with broader academic practices such as curriculum development, research, organisational leadership, and community involvement. To foster evidence-based practice, it is important to understand how institutions from diverse sociocultural contexts achieve excellence in student engagement. We analysed 11 successful applications for an international award in student engagement and interviewed nine key informants from five medical schools across four continents, characterising how and why student engagement was fostered at these institutions. Document analysis revealed considerable consensus on the core practices of student engagement, as well as innovative and creative practices often in response to local strengths and challenges. The interviews uncovered the importance of an authentic partnership culture between students and faculty which sustained mutually beneficial enhancements across multiple domains. Faculty promoted, welcomed, and acted on student inputs, and students reported greater willingness to participate if they could see the benefits. These combined to create self-perpetuating virtuous cycles of academic endeavour. Successful strategies included having participatory values actively reinforced by senior leadership, engagement activities that are driven by both students and staff, and focusing on strategies with reciprocal benefits for all stakeholders. [ABSTRACT FROM AUTHOR]

Competency‐based medical education (CBME) is an outcomes‐focused approach to educating medical professionals that will be central to future efforts to improve resident training in otolaryngology. The transition to CBME for otolaryngology in the United States will require the development of specialty‐specific assessments and benchmarks, the financial and administrative support for implementation, the professional development of faculty and learners, and the cooperation of all major stakeholders in graduate medical education. In this article, we describe the need for evidence‐based innovation in surgical training, the history of CBME in the United States, and the progress towards defining "entrustable professional activities" as the building blocks of assessments for CBME. We explore what such a paradigm shift in surgical education could mean for academic otolaryngologists by examining innovative educational practices in other surgical specialties and discussing foreseeable challenges in implementation for the American healthcare system. [ABSTRACT FROM AUTHOR]

Despite the many clerkship models of medical education, all can be considered a form of experiential learning. Experiential learning is a complex pedagogical approach involving the development of cognitive skills in an environment with a unique culture with multiple stakeholders, which may impact learner motivation, confidence, and other noncognitive drivers of success. Students may delay the transition to the clerkship year for myriad reasons, and the intricate nature of experiential learning suggested this may impact student performance. This retrospective, observational study investigated the impact of clerkship postponement by measuring subsequent clerkship performance. Pre-clerkship and third-year clerkship performance were analyzed for three cohorts of students (classes of 2018, 2019, and 2020, N = 274) where students had the option to delay the start of their clerkship year. A mixed analysis of variance (ANOVA) and paired t-tests were conducted to compare academic performance over time among students who did and did not delay. Across three cohorts of students, 12% delayed the start of the clerkship year (N = 33). Regardless of prior academic performance, these students experienced a significant reduction in clerkship grades compared to their non-delaying peers. Delaying the start of the clerkship year may have negative durable effects on future academic performance. This information should be kept in mind for student advisement. [ABSTRACT FROM AUTHOR]

Background: Given the widespread use of Multiple Mini Interviews (MMIs), their impact on the selection of candidates and the considerable resources invested in preparing and administering them, it is essential to ensure their quality. Given the variety of station formats used and the degree to which that factor resides in the control of training programmes that we know so little about, format's effect on MMI quality is a considerable oversight. This study assessed the effect of two popular station formats (interview vs. role‐play) on the psychometric properties of MMIs. Methods: We analysed candidate data from the first 8 years of the Integrated French MMIs (IF‐MMI) (2010–2017, n = 11 761 applicants), an MMI organised yearly by three francophone universities and administered at four testing sites located in two Canadian provinces. There were 84 role‐play and 96 interview stations administered, totalling 180 stations. Mixed design analyses of variance (ANOVAs) were used to test the effect of station format on candidates' scores and stations' discrimination. Cronbach's alpha coefficients for interview and role‐play stations were also compared. Predictive validity of both station formats was estimated with a mixed multiple linear regression model testing the relation between interview and role‐play scores with average clerkship performance for those who gained entry to medical school (n = 462). Results: Role‐play stations (M = 20.67, standard deviation [SD] = 3.38) had a slightly lower mean score than interview stations (M = 21.36, SD = 3.08), p < 0.01, Cohen's d = 0.2. The correlation between role‐play and interview stations scores was r = 0.5 (p < 0.01). Discrimination coefficients, Cronbach's alpha and predictive validity statistics did not vary by station format. Conclusion: Interview and role‐play stations have comparable psychometric properties, suggesting format to be interchangeable. Programmes should select station format based on match to the personal qualities for which they are trying to select. Renaud et al. found that interview and role‐play stations in Multiple Mini Interviews have comparable psychometric properties, suggesting station format to be interchangeable. [ABSTRACT FROM AUTHOR]

Objective: Entrustable Professional Activities (EPAs) are increasingly being used in competency-based medical education approaches. A general lack of time in clinical settings, however, prevents supervisors from providing their trainees with adequate feedback. With a willingness for more administrative tasks being low in both trainees and educators, the authors developed a radical user-friendly mobile application based on the EPA concept called "Surg-prEPAred". Design: Surg-prEPAred is designed to collect micro-assessment data for building competency profiles for surgical residents according to their curriculum. The goal of Surg-prEPAred is to facilitate the performance and documentation of workplace-based assessments. Through aggregated data the app generates a personalized competency profile for every trainee. During a pilot run of 4 months, followed by ongoing usage of the application with a total duration of 9 months (August 2019 to April 2020), 32 residents and 33 consultants made daily use of the application as a rating tool. Every rating included knowledge, skills and professional attitudes of the trainees. Before the initiation of the App and after the 9-month trial period trainees and supervisors where both sent questionnaires to evaluate the user friendliness and effectiveness of the App. Results: Five hundred ten App based assessments were generated. Out of 40 pre-defined EPAs, 36 were assessed. 15 trainees and 16 supervisors returned the questionnaires and stated the surg-prEPAred App as very valuable, effective and feasible to evaluate trainees in a clinical setting providing residents with an individual competence portfolio to receive precision medical education. Conclusions: The authors expectation is that the Surg-prEPAred App will contribute to an improvement of quality of medical education and thus to the quality of patient care and safety. In the future the goal is to have the App become an integral part of the official Swiss surgical curriculum accepted by the Swiss professional surgical society. [ABSTRACT FROM AUTHOR]

As competency-based curricula get increasing attention in postgraduate medical education, Entrustable Professional Activities (EPAs) are gaining in popularity. The aim of this survey was to determine the use of EPAs in anesthesiology training programs across Europe and North America. A survey was developed and distributed to anesthesiology residency training program directors in Switzerland, Germany, Austria, Netherlands, USA and Canada. A convergent design mixed-methods approach was used to analyze both quantitative and qualitative data. The survey response rate was 38% (108 of 284). Seven percent of respondents used EPAs for making entrustment decisions. Fifty-three percent of institutions have not implemented any specific system to make such decisions. The majority of respondents agree that EPAs should become an integral part of the training of residents in anesthesiology as they are universal and easy to use. Although recommended by several national societies, EPAs are used in few anesthesiology training programs. Over half of responding programs have no specific system for making entrustment decisions. Although several countries are adopting or planning to adopt EPAs and national societies are recommending the use of EPAs as a framework in their competency-based programs, few are yet using these to make "competence" decisions. [ABSTRACT FROM AUTHOR]

Background: Medical schools have undergone a period of continual curricular change in recent years, particularly with regard to pre-clinical education. While these changes have many benefits for students, the impact on faculty is less clear. Methods: In this study, faculty motivation to teach in the pre-clinical medical curriculum was examined using self-determination theory (SDT) as a framework. Basic science and clinical faculty were surveyed on factors impacting their motivation to teach using validated scales of motivation as well as open-ended questions which were coded using self-determination theory (SDT) as a guiding framework. Results: Faculty reported that teaching activities often meet their basic psychological needs of competence, autonomy, and relatedness. Professors were more likely than associate professors to report that teaching met their need for autonomy. Faculty were more motivated by intrinsic as compared to external factors, although basic science faculty were more likely than clinical faculty to be motivated by external factors. Motivating and de-motivating factors fell into the themes Resources, Recognition and Rewards, Student Factors, Self-Efficacy, Curriculum, Contribution, and Enjoyment. The majority of factors tied to the faculty's need for relatedness. Based on these findings, a conceptual model for understanding medical school faculty motivation to teach was developed. Conclusions: Assessing faculty motivation to teach provided valuable insights into how faculty relate to their teaching roles and what factors influence them to continue in those roles. This information may be useful in guiding future faculty development and research efforts. [ABSTRACT FROM AUTHOR]

This study examines the way in which student characteristics and pre-admissions measures are statistically associated with the likelihood a student will require remediation for academic and professionalism offenses. We anchor our inquiry within Irby and Hamstra's (2016) conceptual framework of constructs of professionalism. Data from five graduating cohorts (2014–2018) from McMaster University (Hamilton, Canada) (N = 1,021) were retroactively collected and analyzed using traditional and multinominal logistic regression analyses. The relationship among student characteristics, pre-admissions variables, and referral for potential remediation both by occurrence (yes/no) as well as type (academic/professional/no referral) were examined separately. Findings indicate that gender (OR = 0.519, 95% CI 0.326–0.827, p < 0.01) and undergraduate grade point average (GPA) (OR = 0.245, 95% CI 0.070–0.855, p < 0.05) were significantly associated with instances of referral for potential professionalism and academic remediation, respectively. Women were less likely than men to require remediation for professionalism (OR = 0.332, 95% CI 0.174–0.602, p < 0.001). Undergraduate GPAs (OR = 0.826, 95% CI 0.021–0.539, p < 0.01) were significantly associated with remediation for academic reasons. Lower undergraduate GPAs were associated with a higher likelihood of remediation. These findings point to the admissions variables that are associated with instances that prompt referral for potential remediation. Where associations are not significant, we consider the application of different conceptualizations of professionalism across periods of admissions and training. We encourage those involved in applicant selection and student remediation to emphasize the importance of the interactions that occur between personal and contextual factors to influence learner behaviour and professional identity formation. [ABSTRACT FROM AUTHOR]

Background: The transfer of classic concepts of competency-based medical education into clinical practice has been proven to be difficult in the past, being described as partially fragmented, misleading and inadequate. At the beginning of training, novice doctors commonly feel overwhelmed, overloaded and exposed to extreme time pressure. The discrepancy between expected and actual clinical competence of doctors at the start of their speciality training jeopardizes patient safety. The framework of Entrustable Professional Activities (EPAs) is a promising instrument to effectively integrate competency-based training into clinical practice and may help to close this gap and consequently to improve patient safety. Methods: For anaesthesiology, we developed 5 EPAs for final-year medical students. The EPAs comprised the following seven categories: 1. Title, 2. Specifications, 3. Limitations, 4. Competency domains, 5. Knowledge, abilities and skills, professional attitudes, 6. Assessment and 7. Entrustment. Based on a modified, online-based Delphi study, we further developed and refined these EPAs. Education experts were recruited from the alumni network of the Master of Medical Education (MME) degree course from the University of Heidelberg, Germany. Results: 28 data sets were evaluated in three Delphi rounds. 82% of study participants had previous experience with EPAs. Qualitative and quantitative data formed the basis during the iterative process and resulted in complete descriptions of 5 EPAs for final-year medical students in anaesthesiology. Conclusions: Our study including the associated description of 5 EPAs represent a further step and starting point for EPA-based curricula in medical training in Germany linking undergraduate training, to residency training and continuous medical education. [ABSTRACT FROM AUTHOR]

Background: Incentives for preparation and participation in case-based (CBL) and team-based learning (TBL) differ by virtue of differences in assessment, allowing us to evaluate the role these incentives play in preparation and participation in these activities as well as overall course performance. Methods: Weekly TBL and CBL participation and performance as well as performance on the course final examination were recorded. Student participation was quantified and correlated with: (1) CBL preparation, participation, teamwork and completion of learning objectives scores, and (2) TBL individual readiness assurance test (iRAT) scores. Results: Student final examination scores (n = 95) were more strongly correlated with TBL than CBL performance. No significant correlation was found between iRAT and CBL scores. Student participation was measured in 3 CBL groups (8 students/group) and 4 TBL teams (6 students/team). TBL participation was more strongly correlated with final examination scores than CBL participation. TBL participation was also correlated with iRAT scores. CBL scores for preparation, participation, teamwork and completion of learning objectives did not significantly correlate with iRAT scores or TBL participation. Conclusion: These results suggest that the assessment incentives and methods used in TBL result in student performance that better predicts performance on summative examinations. [ABSTRACT FROM AUTHOR]

The delivery of medical education has shown a significant shift from the conventional mode of training to the competency-based training. Assessments have been identified as the most significant difference between the two approaches of training. The purpose of the current review was to explore the employment of objective structured clinical examination (OSCE) tool in the delivery of medical education. An extensive search of all materials related to the topic was carried out in the PubMed search engine, and a total of 30 articles were selected based upon the suitability with the current review objectives. It is quite obvious that during assessments, we plan to assess knowledge, skill, and affective domains, which actually gives inference about the overall learning progression. OSCE is an assessment tool that is being employed in medical training owing to its objectivity and structured nature. With the passage of time, OSCEs have been widely used in both undergraduate and postgraduate examinations. Acknowledging the fact that the OSCE can be of immense significance in monitoring the learning and its progression, it becomes quite essential to ensure its quality. In conclusion, the scope of OSCE as an assessment tool in medical education training is immense. It is the need of the hour to use the tool in an objective and structured manner to assess the level of learning in students and even monitor the progression in learning. [ABSTRACT FROM AUTHOR]

Programmatic assessment as a concept is still novel for many in clinical education, and there may be a disconnect between the academics who publish about programmatic assessment and the front-line clinical educators who must put theory into practice. In this paper, we clearly define programmatic assessment and present high-level guidelines about its implementation in competency-based medical education (CBME) programs. The guidelines are informed by literature and by lessons learned from established programmatic assessment approaches. We articulate five steps to consider when implementing programmatic assessment in CBME contexts: articulate the purpose of the program of assessment, determine what must be assessed, choose tools fit for purpose, consider the stakes of assessments, and define processes for interpreting assessment data. In the process, we seek to offer a helpful guide or template for front-line clinical educators. We dispel some myths about programmatic assessment to help training programs as they look to design–or redesign–programs of assessment. In particular, we highlight the notion that programmatic assessment is not 'one size fits all'; rather, it is a system of assessment that results when shared common principles are considered and applied by individual programs as they plan and design their own bespoke model of programmatic assessment for CBME in their unique context. [ABSTRACT FROM AUTHOR]

Medical education is situated within health care and educational organizations that frequently lag in their use of data to learn, develop, and improve performance. How might we leverage competency-based medical education (CBME) assessment data at the individual, program, and system levels, with the goal of redefining CBME from an initiative that supports the development of physicians to one that also fosters the development of the faculty, administrators, and programs within our organizations? In this paper we review the Deliberately Developmental Organization (DDO) framework proposed by Robert Kegan and Lisa Lahey, a theoretical framework that explains how organizations can foster the development of their people. We then describe the DDO's conceptual alignment with CBME and outline how CBME assessment data could be used to spur the transformation of health care and educational organizations into digitally integrated DDOs. A DDO-oriented use of CBME assessment data will require intentional investment into both the digitalization of assessment data and the development of the people within our organizations. By reframing CBME in this light, we hope that educational and health care leaders will see their investments in CBME as an opportunity to spur the evolution of a developmental culture. [ABSTRACT FROM AUTHOR]

Tensions have always existed between innovation and standardization in family medicine, due to the need for rapid responses to changing health issues while ensuring proficiency. For innovation in residency training to be successful, standardization of milestones and frameworks as well as outcomes of residency education are needed and must be clear and rely on measurable effectiveness standards. Standardization without innovation can cause educational stasis, failure to adapt to change, and/or lack of evidence-guided education. Here, we examine possible options for creating the right balance, review what the evidence shows, and make recommendations for the future, including (1) adoption and study of clear, actionable entrustable professional activities (EPAs) as educational standards for residency graduates; (2) core faculty be required to engage in faculty development that includes competency-based medical education using the EPA framework, advanced curriculum development, program evaluation, objective learner assessments aligned with individualized learning plans, and increased opportunities for program directors to gain additional training in the educational sciences; (3) 30% of protected time for core faculty to design, administer, and assess the educational program; (4) required participation in educational collaboratives that rigorously study innovation; (5) required scholarly work that supports program development both clinically and educationally. Taken together, these recommendations represent a vital interplay between cutting-edge innovation and thoughtful standardization using collaboration to graduate residents ready to provide optimal care in their communities, both now and into the future. All stakeholders in the discipline must undertake strategic and deliberate planning designed to adjust direct and indirect costs of residency training to support these recommendations. [ABSTRACT FROM AUTHOR]

Background: Entrustable professional activities (EPAs) are those activities that a health professional can perform without direct supervision in a defined environment. Bridging the gap between competencies and learning objectives, EPAs have made assessing the performances of health professional more realistic. The main objective of the present study was developing and customizing EPAs for Iranian Internal Medicine Residency Programs. Results: After reviewing the publications, residency curricula and logbooks, and collecting experts' ideas, the initial list of EPAs was developed. Then, in a focus group, the list was refined, the entrustability level of each residency year was determined, and finally, the EPA-competency cross-tab was established, and in the next step, through a one- round Delphi, the results were validated. Twenty-eight EPAs were developed. Some of them were definitely suitable for the higher levels of residency, such that they had to be accomplished under direct supervision until the end of the program. On the other hand, some of EPAs were those that residents, even from the first year, are expected to perform independently or under indirect supervision. Most of the EPAs cover a wide range of competencies. Conclusion: Determining the entrustability level of each residency year in each EPA as well as the competency- EPA matrix has crucial effect on the quality of the graduates. It seems that our findings are applicable in developing countries like Iran. [ABSTRACT FROM AUTHOR]

Issue: Entrustable Professional Activities (EPAs) describe the core tasks health professionals must be competent performing prior to promotion and/or moving into unsupervised practice. When used for learner assessment, they serve as gateways to increased responsibility and autonomy. It follows that identifying and describing EPAs is a high-stakes form of work analysis aiming to describe the core work of a profession. However, hasty creation and adoption of EPAs without rigorous attention to content threatens the quality of judgments subsequently made from using EPA-based assessment tools. There is a clear need for approaches to identify validity evidence for EPAs themselves prior to their deployment in workplace-based assessment. Evidence: For EPAs to realize their potential in health professions education, they must first be constructed to reflect accurately the work of that profession or specialty. If the EPAs fail to do so, they cannot predict a graduate's readiness for or future performance in professional practice. Evaluating the methods used for identification, description, and adoption of EPAs through a construct validity lens helps give leaders and stakeholders of EPA development confidence that the EPAs constructed are, in fact, an accurate representation of the profession's work. Implications: Application of a construct validity lens to EPA development impacts all five commonly followed steps in EPA development: selection of experts; identification of candidate EPAs; iterative revisions; evaluation of proposed EPAs; and formal adoption of EPAs into curricula. It allows curricular developers to avoid pitfalls, bias, and common mistakes. Further, construct validity evidence for EPA development provides assurance that the EPAs adopted are appropriate for use in workplace-based assessment and entrustment decision-making. [ABSTRACT FROM AUTHOR]

Background: Fostering professional behaviour has become increasingly important in medical education and non-traditional approaches to assessment of professionalism may offer a more holistic representation of students' professional behaviour development. Emerging evidence suggests peer assessment may offer potential as an alternative method of professionalism assessment. We introduced peer assessment of professionalism in pre-clerkship phases of undergraduate medical education curriculum at our institution and evaluated suitability of adopting a professional behaviour scale for longitudinal tracking of student development, and student comfort and acceptance of peer assessment. Methods: Peer assessment was introduced using a validated professional behaviours scale. Students conducted repeated, longitudinal assessments of their peers from small-group, clinical skills learning activities. An electronic assessment system was used to collect peer assessments, collate and provide reports to students. Student opinions of peer assessment were initially surveyed before introducing the process, confirmatory analyses were conducted of the adopted scale, and students were surveyed to explore satisfaction with the peer assessment process. Results: Students across all phases of the curriculum were initially supportive of anonymous peer assessment using small-group learning sessions. Peer scores showed improvement over time, however the magnitude of increase was limited by ceiling effects attributed to the adopted scale. Students agreed that the professional behaviours scale was easy to use and understand, however a majority disagreed that peer assessment improved their understanding of professionalism or was a useful learning experience. Conclusions: Peer assessment of professional behaviours does expose students to the process of assessing one's peers, however the value of such processes at early stages of medical education may not be fully recognized nor appreciated by students. Electronic means for administering peer assessment is feasible for collecting and reporting peer feedback. Improvement in peer assessed scores was observed over time, however student opinions of the educational value were mixed and indeterminate. [ABSTRACT FROM AUTHOR]

Copyright of GMS Journal for Medical Education is the property of German Medical Science Publishing House gGmbH and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Progress testing aligns well with competency-based medical education (CBME) frameworks, which stress the importance of continuous improvement. Entrustment is a useful assessment concept in CBME models. The purpose of this study was to explore the use of an entrustability rating scale within the context of an objective structured clinical examination (OSCE) Progress Test. A 9-case OSCE Progress Test was administered to Internal Medicine residents (PGYs 1–4). Residents were assessed using a checklist (CL), global rating scale (GRS), training level rating scale (TLRS), and entrustability scale (ENT). Reliability was calculated using Cronbach's alpha. Differences in performance by training year were explored using ANOVA and effect sizes were calculated using partial eta-squared. Examiners completed a post-examination survey. Ninety one residents and forty two examiners participated in the OSCE. Inter-station reliability was high for all instruments. There was an overall effect of training level for all instruments (p < 0.001). Effect sizes were large. 88% of examiners completed the survey. Most (62%) indicated feeling comfortable in making entrustment decisions during the OSCE. An entrustability scale can be used in an OSCE Progress Test to generate highly reliable ratings that discriminate between learners at different levels of training. [ABSTRACT FROM AUTHOR]

Background: Accreditation systems are based on a number of principles and purposes that vary across jurisdictions. Decision making about accreditation governance suffers from a paucity of evidence. This paper evaluates the pros and cons of continuous quality improvement (CQI) within educational institutions that have traditionally been accredited based on episodic evaluation by external reviewers. Methods: A naturalistic utility-focused evaluation was performed. Seven criteria, each relevant to government oversight, were used to evaluate the pros and cons of the use of CQI in three medical school accreditation systems across the continuum of medical education. The authors, all involved in the governance of accreditation, iteratively discussed CQI in their medical education contexts in light of the seven criteria until consensus was reached about general patterns. Results: Because institutional CQI makes use of early warning systems, it may enhance the reflective function of accreditation. In the three medical accreditation systems examined, external accreditors lacked the ability to respond quickly to local events or societal developments. There is a potential role for CQI in safeguarding the public interest. Moreover, the central governance structure of accreditation may benefit from decentralized CQI. However, CQI has weaknesses with respect to impartiality, independence, and public accountability, as well as with the ability to balance expectations with capacity. Conclusion: CQI, as evaluated with the seven criteria of oversight, has pros and cons. Its use still depends on the balance between the expected positive effects—especially increased reflection and faster response to important issues—versus the potential impediments. A toxic culture that affects impartiality and independence, as well as the need to invest in bureaucratic systems may make in impractical for some institutions to undertake CQI. [ABSTRACT FROM AUTHOR]

Background: Program directors (PDs) in emergency medicine (EM) receive an abundance of applications for very few residency training spots. It is unclear which selection strategies will yield the most successful residents. Many authors have attempted to determine which items in an applicant's file predict future performance in EM. Objectives: The purpose of this scoping review is to examine the breadth of evidence related to the predictive value of selection factors for performance in EM residency. Methods: The authors systematically searched four databases and websites for peer‐reviewed and gray literature related to EM admissions published between 1992 and February 2019. Two reviewers screened titles and abstracts for articles that met the inclusion criteria, according to the scoping review study protocol. The authors included studies if they specifically examined selection factors and whether those factors predicted performance in EM residency training in the United States. Results: After screening 23,243 records, the authors selected 60 for full review. From these, the authors selected 15 published manuscripts, one unpublished manuscript, and 11 abstracts for inclusion in the review. These studies examined the United States Medical Licensing Examination (USMLE), Standardized Letters of Evaluation, Medical Student Performance Evaluation, medical school attended, clerkship grades, membership in honor societies, and other less common factors and their association with future EM residency training performance. Conclusions: The USMLE was the most common factor studied. It unreliably predicts clinical performance, but more reliably predicts performance on licensing examinations. All other factors were less commonly studied and, similar to the USMLE, yielded mixed results. [ABSTRACT FROM AUTHOR]

Phenomenon: Despite the emergence of the integrated care (IC) model, IC is variably taught and is challenged by current siloed competency domains. This study aimed to define IC competencies spanning multiple competency domains. Approach: Iterative facilitated discussions were conducted at a half-day education retreat with 25 key informants including clinician educators and education scientists. Seven one-on-one semistructured interviews were subsequently conducted with different interprofessional providers in IC settings within a Canadian context. Data collection grounded in patient cases with a physical illness and concurrent mental illness (medical psychiatry) were used to elicit identification of complex patient needs and the key medical psychiatry knowledge and skills required to address these needs. A thematic analysis of transcripts was performed using constant comparison to iteratively identify themes. Findings: Participants described 4 broad competency domains necessary for expertise in IC: (a) extensive integrated knowledge of biopsychosocial aspects of disease, systems of care, and social determinants of care; (b) skills to establish a longitudinal alliance with the patient and functional relationships with colleagues; (c) constructing a comprehensive understanding of individual patients' complex needs and how these can be met within their health and social systems; and (d) the ability to effectively meet the patient's needs using IC models. These 4 domains were linked by an overarching philosophy of care encompassing key enabling attitudes such as proactively pursuing depth to understand patient and system complexity while maintaining a patient-centered approach. Insights: The study addresses how development of IC expertise can be fostered by integration of individual IC competency domains. The findings align with previous research suggesting that competencies from existing frameworks are being enacted jointly in expert capabilities to meet the complex needs of patients, in this case with comorbid physical and mental health concerns. [ABSTRACT FROM AUTHOR]

Educating the next generation of physicians is a key means of communicating and disseminating impactful immunologic scientific knowledge, and its practical application to human disease. We present our perspective, using as our model a first-year medical school course entitled Host Defense. As the name suggests, immunology is the overarching principle that links the multiple subjects in the course. We address a range of immunologically relevant topics, including innate and adaptive immunity, vaccines, inflammation, allergy, tumor immunotherapy, transplantation, and autoimmunity. These topics are integrated with the fields of infectious diseases, pathology, clinical laboratory testing, and public health, to illustrate how the basic science discoveries in immunology are relevant to clinical practice. The course objectives are not only to deliver "first principles" and molecular mechanisms, but also to connect these principles with the clinical world of diagnosis and therapy. We detail the different methodologies used to achieve these objectives and to reach today's medical students. This provides a framework for course structure and execution designed to engage both the novice and the more "immunologically experienced" learner. The framework includes classical didactic components and personalized instructor access, aligned with current approaches to self-directed learning and using digital media. We also address some of the challenges of assembling a course like Host Defense in the context of an academic medical center with multiple scientific, educational, and clinical missions. This perspective is not meant be proscriptive, but rather to outline our experiences on the strategies tried, while describing their advantages and drawbacks in teaching immunology. [ABSTRACT FROM AUTHOR]

Context: Medicine is practised in complex systems. Physicians engage in clinical and operational problems that are dynamic and lack full transparency. As a consequence, the behaviour of medical systems and diseases is often unpredictable. Medical science has equipped physicians with powerful tools to favourably impact health, but a reductionist approach alone is insufficient to optimally address the complex challenges posed by illness and public health. Concepts from complexity science, such as continuous quality improvement and teamwork, strive to fill the gap between biomedical knowledge and the realities of practice. However, the superficial treatment of these systems‐thinking concepts in medical education has distorted their implementation and undermined their impact. 'Systems thinking' has been conflated with 'systematic thinking'; concepts which are adaptive in nature are being taught as standardised, reductionist tools. Methods: Using concepts from complexity science, the history of science and psychology, this problem is outlined and a theoretical model of professional development is proposed. Results: This model proposes that complex problem solving and adaptive behaviour, not technical expertise, are distinguishing features of professionalism. Discussion: The impact of this model on our understanding of physician autonomy, professionalism, teamwork and continuous quality improvement is discussed. This model has significant implications for the structure and content of medical education. Strategies for enhancing medical training, including interventions in recruitment, the curriculum and evaluation, are reviewed. Such adjustments would prepare trainees to more effectively utilise biomedical knowledge and tools in the complex high‐stakes reality of medical practice. Woodruff uses complexity science and psychology to argue that complex problem solving and adaptive behavior, not technical knowledge, are the distinguishing features of the medical professional. [ABSTRACT FROM AUTHOR]

Copyright of Gefaesschirurgie is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Background: Competency‐based medical education (CBME) is becoming widely implemented in medical education. Trainees' perceptions of CBME are important factors in the implementation and acceptance of CBME. Online discussion groups allow unique insight into trainees' perceptions of CBME during residency training. Methods: We analysed 867 posts from 20 discussion threads in Premed 101 (Canadian) and 2756 posts from 50 threads in Student Doctor Network (SDN) (American) using NVivo 11. Inductive content analysis was used to develop a data‐driven coding scheme that evolved throughout the analysis. Measures were taken to ensure the trustworthiness of findings, including co‐coding of a subsample of 600 posts, peer debriefing, consensus‐based analytical decision making and the maintenance of an audit trial. Results: Medical residents and students participating in the discussion forums emphasised select themes regarding the implementation of CBME in residency training. Concerns about CBME in Canada primarily involved its implications for the length of residency and post‐residency opportunities. Posts on the American forum had a prominent focus on differing areas, such as the subjectivity in the assessment of core competencies and the role of CBME in termination of a resident's position. Conclusions: Online discussion groups have the potential to provide unique insight into perceptions of CBME. The presented concerns may have implications for refining the model of CBME and illustrate the importance of providing clarification for trainees regarding length of training and evaluation structures from those involved in designing of CBME programmes. To facilitate the further development of CBME practices, the authors analyze student discussion forums, highlighting their potential to serve as useful continuous quality improvement tools. [ABSTRACT FROM AUTHOR]

Background: Faculty and students debate the fairness and accuracy of medical student clerkship grades. Group decision-making is a potential strategy to improve grading.Objective: To explore how one school's grading committee members integrate assessment data to inform grade decisions and to identify the committees' benefits and challenges.Design: This qualitative study used semi-structured interviews with grading committee chairs and members conducted between November 2017 and March 2018.Participants: Participants included the eight core clerkship directors, who chaired their grading committees. We randomly selected other committee members to invite, for a maximum of three interviews per clerkship.Approach: Interviews were recorded, transcribed, and analyzed using inductive content analysis.Key Results: We interviewed 17 committee members. Within and across specialties, committee members had distinct approaches to prioritizing and synthesizing assessment data. Participants expressed concerns about the quality of assessments, necessitating careful scrutiny of language, assessor identity, and other contextual factors. Committee members were concerned about how unconscious bias might impact assessors, but they felt minimally impacted at the committee level. When committee members knew students personally, they felt tension about how to use the information appropriately. Participants described high agreement within their committees; debate was more common when site directors reviewed students' files from other sites prior to meeting. Participants reported multiple committee benefits including faculty development and fulfillment, as well as improved grading consistency, fairness, and transparency. Groupthink and a passive approach to bias emerged as the two main threats to optimal group decision-making.Conclusions: Grading committee members view their practices as advantageous over individual grading, but they feel limited in their ability to address grading fairness and accuracy. Recommendations and support may help committees broaden their scope to address these aspirations. [ABSTRACT FROM AUTHOR]

Educational assessment for the health professions has seen a major attempt to introduce competency based frameworks. As high level policy developments, the changes were intended to improve outcomes by supporting learning and skills development. However, we argue that previous experiences with major innovations in assessment offer an important road map for developing and refining assessment innovations, including careful piloting and analyses of their measurement qualities and impacts. Based on the literature, numerous assessment workshops, personal interactions with potential users, and our 40 years of experience in implementing assessment change, we lament the lack of a coordinated approach to clarify and improve measurement qualities and functionality of competency based assessment (CBA). To address this worrisome situation, we offer two roadmaps to guide CBA's further development. Initially, reframe and address CBA as a measurement development opportunity. Secondly, using a roadmap adapted from the management literature on sustainable innovation, the medical assessment community needs to initiate an integrated plan to implement CBA as a sustainable innovation within existing educational programs and self-regulatory enterprises. Further examples of down-stream opportunities to refocus CBA at the implementation level within faculties and within the regulatory framework of the profession are offered. In closing, we challenge the broader assessment community in medicine to step forward and own the challenge and opportunities to reframe CBA as an innovation to improve the quality of the clinical educational experience. The goal is to optimize assessment in health education and ultimately improve the public's health. [ABSTRACT FROM AUTHOR]

Theory: Networking has positive effects on career development; however, personal characteristics of group members such as gender or diversity may foster or hinder member connectedness. Social network analysis explores interrelationships between people in groups by measuring the strength of connection between all possible pairs in a given network. Social network analysis has rarely been used to examine network connections among members in an academic medical society. This study seeks to ascertain the strength of connection between program directors in the Association of Program Directors in Internal Medicine (APDIM) and its Education Innovations Project subgroup and to examine possible associations between connectedness and characteristics of program directors and programs. Hypotheses: We hypothesize that connectedness will be measurable within a large academic medical society and will vary significantly for program directors with certain measurable characteristics (e.g., age, gender, rank, location, burnout levels, desire to resign). Method: APDIM program directors described levels of connectedness to one another on the 2012 APDIM survey. Using social network analysis, we ascertained program director connectedness by measuring out-degree centrality, in-degree centrality, and eigenvector centrality, all common measures of connectedness. Results: Higher centrality was associated with completion of the APDIM survey, being in a university-based program, Educational Innovations Project participation, and higher academic rank. Centrality did not vary by gender; international medical graduate status; previous chief resident status; program region; or levels of reported program director burnout, callousness, or desire to resign. Conclusions: In this social network analysis of program directors within a large academic medical society, we found that connectedness was related to higher academic rank and certain program characteristics but not to other program director characteristics like gender or international medical graduate status. Further research is needed to optimize our understanding of connection in organizations such as these and to determine which strategies promote valuable connections. [ABSTRACT FROM AUTHOR]

Profound anatomical knowledge is the basis for modern demands in medicine and surgery, but many countries worldwide including Australia and New Zealand have discontinued offering dissection courses to medical and dental students during the past decades. This educational project done in Australia aimed at enhancing basic and advanced anatomy teaching by engaging a sub-group of second-year undergraduate students of a compulsory prosection- and model-based anatomy course ( n = 54/170) in an optional multimodal course, which should easily articulate with a vertical curriculum. With topographical cadaver dissections as core, peer student-teams prepared and peer-assessed anatomy lectures based on clinical topics, which were rated highly by the peers and teachers. Anatomical knowledge was tested by quizzes and a multiple-choice examination. Individual dissection skills were self- and teacher-assessed. A final course grade was assigned based on these assessments. The grades in the system-based compulsory course achieved by the attendees of the paralleling dissection course were compared with their peers attending other optional courses. After beginning of the semester, the students in the dissection course performed similar, significantly ( P < 0.005) improved during the semester (78.5% vs. 69.9%, 70.1% vs. 64.1%), but in the integrated (including anatomy, biochemistry, physiology) final examination at the end of the year only tended to higher scores. As assessed through interviews and a voluntary questionnaire, all students of the optional dissection course liked these activities, which enhanced their learning experience. Thus, this concept elegantly integrates anatomical dissection with modern teaching demands and is feasible for implementation in modernized curricula. Anat Sci Educ 11: 32-43. © 2017 American Association of Anatomists. [ABSTRACT FROM AUTHOR]

Background Over the last two decades, competency-based frameworks have been internationally adopted as the primary educational approach in medicine. Yet competency-based medical education ( CBME) remains contested in the academic literature. We look broadly at the nature of this debate to explore how it may shape scholars' understanding of CBME, and its implications for medical education research and practice. In doing so, we deconstruct unarticulated discourses and assumptions embedded in the CBME literature. Methods We assembled an archive of literature focused on CBME. The archive dates from 1996, the publication year of the first Can MEDS Physician Competency Framework. We then conducted a Foucauldian critical discourse analysis ( CDA) to delineate the dominant discourses underpinning the literature. CDA examines the intersections of language, social practices, knowledge and power relations to highlight how entrenched ways of thinking influence what can or cannot be said about a topic. Findings Detractors of CBME have advanced an array of conceptual critiques. Proponents have often responded with a recurring discursive strategy that minimises these critiques and deflects attention from the underlying concept of the competency-based approach. As part of this process, conceptual concerns are reframed as two practical problems: implementation and interpretation. Yet the assertion that these are the construct's primary concerns was often unsupported by empirical evidence. These practices contribute to a discourse of infallibility of CBME. Discussion In uncovering the discourse of infallibility, we explore how it can silence critical voices and hinder a rigorous examination of the competency-based approach. These discursive practices strengthen CBME by constructing it as infallible in the literature. We propose re-approaching the dialogue surrounding CBME as a starting point for empirical investigation, driven by the aim to broaden scholars' understanding of its design, development and implementation in medical education. [ABSTRACT FROM AUTHOR]

Although medical education has enjoyed many successes over the last century, there is a recognition that health care is too often unsafe and of poor quality. Errors in diagnosis and treatment, communication breakdowns, poor care coordination, inappropriate use of tests and procedures, and dysfunctional collaboration harm patients and families around the world. These issues reflect on our current model of medical education and raise the question: Are physicians being adequately prepared for twenty-first century practice? Multiple reports have concluded the answer is “no.” Concurrent with this concern is an increasing interest in competency-based medical education (CBME) as an approach to help reform medical education. The principles of CBME are grounded in providing better and safer care. As interest in CBME has increased, so have criticisms of the movement. This article summarizes and addresses objections and challenges related to CBME. These can provide valuable feedback to improve CBME implementation and avoid pitfalls. We strongly believe medical education reform should not be reduced to an “either/or” approach, but should blend theories and approaches to suit the needs and resources of the populations served. The incorporation of milestones and entrustable professional activities within existing competency frameworks speaks to the dynamic evolution of CBME, which should not be viewed as a fixed doctrine, but rather as a set of evolving concepts, principles, tools, and approaches that can enable important reforms in medical education that, in turn, enable the best outcomes for patients. [ABSTRACT FROM PUBLISHER]

Competency-based medical education (CBME) is both an educational philosophy and an approach to educational design. CBME has already had a broad impact on medical schools, residency programs, and continuing professional development in health professions around the world. As the CBME movement evolves and CBME programs are implemented, a wide range of emerging research questions will warrant scholarly examination. In this paper, we describe a proposed CBME research agenda developed by the International CBME Collaborators. The resulting framework includes questions about the meaning of key concepts of CBME and their implications for learners, faculty members, and institutional structures. Other research questions relate to the learning process, the meaning of entrustment decisions, fundamental measurement issues, and the nature and definition of standards. The exploration of these questions will help to solidify the theoretical foundation of CBME, but many issues related to implementation also need to be addressed. These pertain to, among other things, nurturing independent learning, assembling and using assessment results to make decisions about competence, structuring feedback, supporting remediation, and how best to evaluate the longer-term outcomes of CBME. High-quality research on these questions will require rigorous outcome measures with strong validity evidence. The complexity of CBME necessitates theoretical and methodological diversity. It also requires multi-institutional studies that examine effects at multiple levels, from the learner to the team, the institution, and the health care system. Such a framework of research questions can guide and facilitate scholarly discourse on the theoretical and practical body of knowledge related to competency-based health professions education. [ABSTRACT FROM PUBLISHER]

A medical student perspective on the role of core competencies in undergraduate medical education in light of medical education reform associated with recent Flexner II. [ABSTRACT FROM AUTHOR]

The article talks about transformations in medical education to make it competency-based by applying learning theory and talks of the model of a structured Education Scholarship Fellowship (ESF) a 2-year postgraduate training program for preparing future education leaders.

Objective: Graduate medical education is a critical time in the training of a rheumatologist, and purposeful evaluation of abilities during this time is essential for long-term success as an independent practitioner. The internal medicine subspecialties collectively developed a uniform set of reporting milestones by which trainees can be assessed and receive formative feedback, providing clarity of accomplishment as well as areas for improvement in training. Furthermore, the reporting milestones provide a schema for assessment and evaluation of fellows by supervisors. The internal medicine subspecialties were also tasked with considering entrustable professional activities (EPAs), which define the abilities of a subspecialty physician who has attained sufficient mastery of the field to be accountable to stakeholders and participate in independent practice. Although EPAs have been established for a few specialties, they had not yet been described for rheumatology. EPAs have value as descriptors of the comprehensive abilities, knowledge, and skills of a practicing rheumatologist. The rheumatology EPAs have a role in defining a specialist in rheumatology upon completion of training, and also represent the ways our specialty defines our abilities that are enduring throughout practice.Methods: We describe the collaborative process of the development of both the subspecialty reporting milestones and the rheumatology EPAs. The reporting milestones evolved through discussions and collaborations among representatives from the Association of Specialty Professors, the Alliance for Academic Internal Medicine, the American Board of Internal Medicine, and the Accreditation Council for Graduate Medical Education. The EPAs were a product of deliberations by the Next Accreditation System (NAS) working group of the American College of Rheumatology (ACR) Committee on Rheumatology Training and Workforce Issues.Results: Twenty-three subspecialty reporting milestones and 14 rheumatology EPAs were advanced and refined over the course of 3 subspecialty reporting milestone development summits and 3 ACR NAS working group meetings, respectively.Conclusion: The subspecialty reporting milestones and rheumatology EPAs presented here stipulate reasonable and measurable expectations for rheumatologists-in-training. Together, these tools aim to promote enrichment and greater accountability in the training of fellows. Additionally, the EPAs define, for all stakeholders, the expertise of a rheumatologist in practice. [ABSTRACT FROM AUTHOR]

Introduction: For the effective and safe management of complex care needs for patients in community settings, high quality family medicine (FM) training programmes are needed. In less primary care oriented countries, training standards statements for FM postgraduate training are less commonly found. The aim of this study was to review international training standards statements in FM postgraduate training and to catalogue these statements to be used as a best practice standard guide for FM training programs in Germany. Materials and Methods: A structured three-tiered search was performed: a systematic literature search in MEDLINE®; a search of international indicator databases; and a search in grey literature, consisting of a survey of international experts and a search in “Google (Scholar)”. From all identified documents, training standards statements were extracted, translated and summarized into categories referring to the same quality aspect. Results: The search strategy revealed 25 relevant documents (MEDLINE® n = 15, databases n = 2, experts n = 7, “Google” n = 1), containing 337 training standards statements. These were summarized into 80 statements. They covered structure quality (n = 35); process quality (n = 43); and two training standards statements referred to outcome quality (n = 2). Conclusion: A broad range of internationally sourced training standards statements for FM postgraduate training could be identified from countries with well-established primary care systems. Only few statements internationally referred to outcome quality, expressing the difficulty in assessing outcome. The resulting inventory of training standards statements for FM postgraduate training can serve as a resource for institutions seeking to formalise and systematise FM training at regional or national levels. [ABSTRACT FROM AUTHOR]

Background Proficiency in medical nutrition requires an understanding of food-related biochemistry and the application of this knowledge in the context of culinary, cultural, psychosocial and interprofessional components. Context Our aim was to develop a teaching format where medical students could learn the biochemistry of nutrition in the context of patient narratives, interactive cooking and dialogues with nutrition professionals. Innovation We designed and implemented a day-long culinary laboratory intervention (lab), which is taught to first-year medical students at the University of Rochester with the help of dietetic interns from Cornell University. Here, we present the details of the intervention, the resources used and the preliminary outcomes on student attitudes. Methods and results A questionnaire with quantitative rating scales and open-ended questions was used to probe student attitudes regarding the educational approach used in the lab. Our preliminary findings suggest that the lab was well received and that the dietetic interns were viewed as effective teachers in this context. Implications A culinary lab is a feasible educational environment for integrating the breadth of topics within the discipline of nutrition. The experiential, food-based format appears to stimulate questions central to current nutritional controversies, particularly challenges related to translating biochemical mechanism into practical nutrition interventions. Close involvement with basic science faculty members, clinical faculty members and allied health professions are essential for this type of endeavour. [ABSTRACT FROM AUTHOR]

Introduction:This study presents a web-based method and its interface ensuring alignment of all parts of a curriculum map including competencies, objectives, teaching and assessment methods, workload and patient availability. Needs, acceptance and effectiveness are shown through a nine-year study. Methods:After a comprehensive needs assessment, the curriculum map and a web-based interface “Learning Opportunities, Objectives and Outcome Platform” (LOOOP) were developed according to Harden’s conceptual framework of 10-steps for curriculum mapping. The outcome was measured by surveys and results of interdisciplinary MCQ-assessments. The usage rates and functionalities were analysed. Results:The implementation of LOOOP was significantly associated with improved perception of the curriculum structure by teachers and students, quality of defined objectives and their alignment with teaching and assessment, usage by students to prepare examinations and their scores in interdisciplinary MCQ-assessment. Additionally, LOOOP improved the curriculum coordination by faculty, and assisted departments for identifying patient availability for clinical training. Conclusion:LOOOP is well accepted among students and teachers, has positive effect on curriculum development, facilitates effective utilisation of educational resources and improves student’s outcomes. Currently, LOOOP is used in five undergraduate medical curricula including 85,000 mapped learning opportunities (lectures, seminars), 5000 registered users (students, teachers) and 380,000 yearly page-visits. [ABSTRACT FROM AUTHOR]

Background/purpose: There is a growing desire for health professions educators to generate high-quality education research; yet, few of them encounter the training to do so. In response, health professions faculties have increasingly been devoting resources to provide members with the skills necessary for education research. The form and impact of these efforts have not been reviewed, though such a synthesis could be useful for practice. The objectives of this systematic review were to (1) identify interventions aimed at building capacity for education research among health professions clinical educators and (2) review the outcomes of these interventions. Methodology: We developed a systematic review protocol based on our pilot scoping search. This protocol underwent peer review and was prospectively registered with the Best Evidence Medical Education Collaboration. Based on this protocol, we conducted a comprehensive search of health professions’ databases and related grey literature. Systematic methods were applied: two independent reviewers completed title screening and full text review for inclusion, data extraction, and methodological quality assessment. Studies were included if they reported outcomes for interventions designed to increase capacity for health professions clinical educators to conduct education research. We conducted a qualitative synthesis of the evidence which included detailed reporting of intervention characteristics and outcomes. Results: Our search returned 14, 149 results, 241 of which were retained after title and abstract screening, and 30 of which met inclusion criteria after full text review. Seven groups of interventions were identified, the most frequent being teaching scholars programs (n = 10), health professions education fellowships (n = 3) or master’s programs (n = 4). The most commonly measured outcome was change related to enhanced scholarly outputs (grants, papers, abstracts, and presentations) post-intervention. Unfortunately, most of the included studies lacked detailed description of the intervention and were of low to moderate quality with post-test only design. Discussion/conclusions: This review demonstrates that various interventions can have a positive impact on the ability of health professions clinical educators to conduct education research. We note several key elements of the interventions including: (1) protected time, (2) mentorship and/or collaboration, (3) departmental and institutional commitment and leadership, and (4) financial support. Through our analysis we describe the complexities around evaluating clinical educators’ health professions research activities and the interventions used to promote education research. While improved study quality would allow more detailed understanding and evaluation of these key features, we are able to provide recommendations for potential strategies for improving participation in and quality of health professions education research based on this analysis. [ABSTRACT FROM PUBLISHER]

Background: Medical students' motivation is an important driving factor for academic performance, and therefore medical teachers and educators are often highly interested in this topic. This study evaluated the impact of an academic affair program upon preclinical year medical students' motivation to study. Design and methods: An intervention study was conducted using a pretest-posttest study design. A total of 296 preclinical year medical students who had just passed their first year and were about to attend their second year at the Faculty of Medicine, Chulalongkorn University, Bangkok, Thailand, participated in the study. The intervention comprised of dialogues for personality development, pictorial expression in groups, as well as small group lectures delivered by senior students giving information on how to prepare for the forthcoming classes. Students' academic motivation was measured before and after the intervention program, applying the transculturally translated Academic Motivation Scale (AMS). Cronbach' s alpha of Thai version AMS was 0.8992. The average scores in seven scales of AMS were compared between the pre- and posttest results, using the Wilcoxon signed-rank test. The differences were confirmed by using the multivariate analysis of variance. Results: Students' academic motivation increased after participation in the three-day academic program. There was also a significant increase in introjected extrinsic motivation, which can enhance the students' self-esteem and feeling of self-worth (P,0.001). Moreover, intrinsic motivation toward accomplishment increased significantly (P,0.001). This is related to the enjoyment of passing academic milestones, and a step ahead of autonomous motivation. Amotivation level declined significantly (P,0.001). The change of academic motivational constructs before and after the intervention was altogether significant (P=0.036, multivariate analysis of variance). Conclusion: After experiencing a three-day intervention, the new students' motivation advanced along the continuum of self-determination toward autonomous motivation. Therefore, it is considered to be worthwhile conducting an academic intervention to catalyze the evolution of preclinical year medical students' academic motivation. Moreover, educators and faculties should evaluate the impact of interventions in evidence-based approaches to secure both controlled and autonomous types of motivation. [ABSTRACT FROM AUTHOR]

Context Competency-based medical education (CBME) has emerged as a core strategy to educate and assess the next generation of physicians. Advantages of CBME include: a focus on outcomes and learner achievement; requirements for multifaceted assessment that embraces formative and summative approaches; support of a flexible, time-independent trajectory through the curriculum; and increased accountability to stakeholders with a shared set of expectations and a common language for education, assessment and regulation. Objectives Despite the advantages of CBME, numerous concerns and challenges to the implementation of CBME frameworks have been described, including: increased administrative requirements; the need for faculty development; the lack of models for flexible curricula, and inconsistencies in terms and definitions. Additionally, there are concerns about reductionist approaches to assessment in CBME, lack of good assessments for some competencies, and whether CBME frameworks include domains of current importance. This study will outline these issues and discuss the responses of the medical education community. Methods The concerns and challenges expressed are primarily categorised as: (i) those related to practical, administrative and logistical challenges in implementing CBME frameworks, and (ii) those with more conceptual or theoretical bases. The responses of the education community to these issues are then summarised. Conclusions The education community has begun to address the challenges involved in implementing CBME. Models and guidance exist to inform implementation strategies across the continuum of education, and focus on the more efficient use of resources and technology, and the use of milestones and entrustable professional activities-based frameworks. Inconsistencies in CBME definitions and frameworks remain a significant obstacle. Evolution in assessment approaches from in vitro task-based methods to in vivo integrated approaches is responsive to many of the theoretical and conceptual concerns about CBME, but much work remains to be done to bring rigour and quality to work-based assessment. [ABSTRACT FROM AUTHOR]

Background: The new UCSF Bridges Curriculum aims to prepare students to succeed in today's health care system while simultaneously improving it. Curriculum redesign requires assessment strategies that ensure that graduates achieve competence in enduring and emerging skills for clinical practice. Aim: To design entrustable professional activities (EPAs) for assessment in a new curriculum and gather evidence of content validity. Setting: University of California, San Francisco, School of Medicine. Participants: Nineteen medical educators participated; 14 completed both rounds of a Delphi survey. Program Description: Authors describe 5 steps for defining EPAs that encompass a curricular vision including refining the vision, defining draft EPAs, developing EPAs and assessment strategies, defining competencies and milestones, and mapping milestones to EPAs. A Q-sort activity and Delphi survey involving local medical educators created consensus and prioritization for milestones for each EPA. Program Evaluation: For 4 EPAs, most milestones had content validity indices (CVIs) of at least 78 %. For 2 EPAs, 2 to 4 milestones did not achieve CVIs of 78 %. Discussion: We demonstrate a stepwise procedure for developing EPAs that capture essential physician work activities defined by a curricular vision. Structured procedures for soliciting faculty feedback and mapping milestones to EPAs provide content validity. [ABSTRACT FROM AUTHOR]

BACKGROUND: Since the 2011 Accreditation Council of Graduate Medical Education (ACGME) work hour rules for residents were implemented, 24-30 h call for interns has been replaced by shift work, including night-float. The impact of these changes on undergraduate medical education experiences in internal medicine has not been described. OBJECTIVE: We aimed to determine the current status of medical students' overnight experiences in Internal Medicine clerkships and sub-internships, and to assess internal medicine educators' perceptions of the importance of overnight work during internal medicine rotations. DESIGN AND PARTICIPANTS: In May 2014, the Clerkship Directors in Internal Medicine (CDIM) conducted its annual survey. Twenty-eight questions about student participation in overnight work and perceptions of the importance of overnight work (rated on 1-5 Likert scale, 1 = very unimportant and 5 = very important) were included. Descriptive statistics were used to summarize responses. Free text results were analyzed qualitatively. KEY RESULTS: The response rate was 78 %. A minority of respondents reported students having any overnight experience during the clerkship (38.7 %) or the sub-internship (40.7 %). Only 5 % of respondents reported having students assigned to night-float rotations outside of clerkships or sub-internships. Respondents agreed that overnight experiences were more important during the sub-internship than the clerkship, 4.0 ± 1.1 vs. 3.2 ± 1.2, p < 0.001. Admitting new patients, following their course and responding to emergencies were rated as important overnight tasks for both clerkship and sub-internship students. CONCLUSIONS: Overnight experiences offer students additional educational opportunities. Clerkship directors felt that the overnight experience for the sub-intern in particular was an important chance to practice providing emergency cross coverage and other intern roles. In the era of ACGME duty hours, there is a need to further examine whether there is a role for increased overnight hospital experiences for medical students. [ABSTRACT FROM AUTHOR]