Search

Purpose: The purpose of this study is to report on the design, implementation, use and evaluation of TELLme, an online platform with annotated multiple-choice questions (MCQs) for formative assessment of knowledge acquisition covering an entire undergraduate medical curriculum., Materials and Methods: We used the Educational Design Research (EDR) framework to develop TELLme as an online platform with 24/7 access for students in a co-creation process between educators, faculty and students. EDR cycle 1 focused on prototyping, while EDR cycle 2 focused on upscaling, usage analysis and evaluation. Database entries were analysed for TELLme usage. Online surveys evaluated platform usability and support for student learning., Results: At the end of EDR cycle 2, TELLme contained 6,713 fully annotated MCQs aligned with the cognitive learning objectives of the curriculum. Up to 600 students per day used TELLme to self-assess their knowledge, answering 3,168,622 MCQs in two semesters. Surveys indicated good usability of TELLme, 75% of students indicated that TELLme helped them to identify knowledge gaps, and 72% agreed that TELLme supported their learning., Conclusions: Medical students use TELLme extensively to formatively assess their learning in a self-directed manner across the entire curriculum. TELLme aligns with the existing summative and formative system of assessment of the study programme.

Purpose: The concept of Entrustable Professional Activities (EPA) is increasingly used to operationalize learning in the clinical workplace, yet little is known about the emotions of learners feeling the responsibility when carrying out professional tasks., Methods: We explored the emotional experiences of medical students in their final clerkship year when performing clinical tasks. We used an online reflective diary. Text entries were analysed using inductive-deductive content analysis with reference to the EPA framework and the control-value theory of achievement emotions., Results: Students described a wide range of emotions related to carrying out various clinical tasks. They reported positive-activating emotions, ranging from enjoyment to relaxation, and negative-deactivating emotions, ranging from anxiety to boredom. Emotions varied across individual students and were related to the characteristics of a task, an increasing level of autonomy, the students' perceived ability to perform a task and the level of supervision provided., Discussion: Emotions are widely present and impact on the workplace learning of medical students which is related to key elements of the EPA framework. Supervisors play a key role in eliciting positive-activating emotions and the motivation to learn by providing a level of supervision and guidance appropriate to the students' perceived ability to perform the task.

Background: The study objective was to develop and validate a questionnaire to capture facilitation activities in PBL by the tutor and the group with reference to a theoretical model of teaching quality., Methods: We developed 19 items assigned to six factors to evaluate collaborative learning processes in relation to facilitation by the tutor and the student PBL group. We analysed construct and criterion validity in 419 undergraduate medical students in 152 online PBL groups., Results: Construct validity was confirmed based on factor dimensionality in line with the theoretical assumptions as well as satisfactory internal reliabilities and intraclass correlation coefficients. Criterion validity was supported by the correlation of a) tutor facilitation activities with the success of group self-facilitation and b) facilitation activities with learning gain and satisfaction in the PBL sessions., Discussion: The questionnaire provides a more comprehensive understanding of collaborative learning processes in PBL and the interplay between facilitation activities by the tutor and the group.

In 2005, Olle ten Cate introduced the concept of Entrustable Professional Activities (EPAs) in the assessment of medical trainees in competency-based postgraduate training (ten Cate, 2005). Over the past two decades, EPAs have found their way into mainstream competency-based education and training for almost all health care professions, from medicine to pharmacy, nursing, dentistry, veterinary dietetics, and the physician assistant field (ten Cate, 2020). Although the terms 'entrustable' and later, 'entrustability', were defined as neologisms at the time, the concept of trust was not unfamiliar to clinicians who are continually required to manage risks in the inherently complex health care business and education (Damodaran et al. 2017). Patient trust in the doctor, the health care system and medical profession, and supervisor trust in the trainee are examples of interpersonal, social, and organizational levels of trust. Therefore, the language of trust and entrustability has offered a more authentic and practical vocabulary than that of competency (Damodaran et al. 2017).

Purpose: Planning committees play a key role in blueprinting major curriculum reform. In this qualitative study, we apply Bourdieu's sociological concept of field to the perceptions of committee members to identify the social mechanisms operating in major curriculum reform., Method: A planning committee with 18 members developed a blueprint for major curriculum reform at the Charité Berlin in its transition from a discipline-based programme to a fully integrated undergraduate medical programme. Interviews with 13 members about their experiences were subjected to inductive-deductive content analysis., Results: Viewed through a Bourdieuan lens, the curriculum committee represents a social field of intense competition and conflicts. Groups of committee members struggled for and with different forms of economic, cultural and social capital to maintain and increase their power and social position in the medical programme. In our case, the major reform was accompanied by loss of power within the teaching department group, while the student group gained power., Conclusion: Bourdieu's concept of field reveals that a major curriculum reform is substantially shaped by power struggles over various forms of capital and social positions related to the future curriculum. The findings may serve as a complementary guide for those navigating the complexity of major curriculum reform.

Background: Curriculum mapping plays an increasing role in the design and implementation of competency-based medical education. We present an exemplary mapping of an institutional undergraduate medical curriculum to a national competency-based outcome framework to compare approaches to mapping procedures in their capacity to depict the relative coverage., Methods: The mapping process was performed by a small working group that continuously reconciled its findings. In step 1, we mapped the course objectives of our programme (Charité Berlin, Germany) to the National Competency-Based Catalogue of Learning Outcomes Medicine (NKLM). In step 2, we employed three primarily quantitative approaches (single, multiple, and subordinate match) and one primarily qualitative approach (content comparison) to derive the degree of NKLM coverage., Results: In step 1, we mapped a total of 4400 programme objectives to 2105 NKLM objectives. In step 2, the quantitative approaches provided a general overview of the pattern of coverage, while the qualitative approach required more effort but provided a better representation of the scope and depth of coverage., Discussion: The mapping approach chosen markedly impacts on the results how of well an institutional curriculum covers a national standard. This study highlights the need for more rigour in the methodology and reporting of curriculum mapping.

Introduction: Student participation has shown positive effects on the curriculum development process for a single health profession. This qualitative study explores faculty members' and students' perceptions and experiences regarding student participation in interprofessional course development. Methods: Interprofessional courses were developed and implemented by interprofessional teams of faculty members and students. Two focus group discussions were carried out: one with faculty members and one with students. Results: Students contributed to both the process and the results of interprofessional course development in a complementary manner. Student participation was facilitated via motivation for and through work on interprofessional education, a balance between clarity on tasks and students' autonomy, and a low-hierarchy team atmosphere. Students developed professionally, and faculty members saw them as future ambassadors for interprofessional collaboration. Conclusions: This study provides multiple qualitative evidence for a positive, complementary role of student participation in interprofessional course development. A number of factors were identified that should be nurtured to facilitate this effect. Our findings may stimulate and guide other schools to actively involve students in the development of interprofessional education.

Introduction: Beyond participation in evaluation of teaching, there is sparse research available on more active roles of medical students in curriculum development. We report on a model of student engagement where medical students function as module co-directors, and how this is experienced by faculty and student module directors. Methods: Student engage in co-development of their curriculum with a high level of autonomy in organizing their activities. We conducted a mixed-methods, convergent design study based on surveys with faculty and student module co-directors and a student co-director focus group. Quantitative data were analyzed descriptively. Qualitative analysis was performed inductively. Results: Quantitatively, the majority of both faculty and student module directors report that the curriculum benefits from the students' work (95 and 94%). Both groups see each other as equal partners (80 and 87%). Qualitatively, this is related to students' competencies such as "bringing in broad and unique knowledge of the curriculum", "giving the students' perspective a voice," and "contributing ideas for improvement". Key strategies and challenges of the student co-module directors are illuminated. Conclusions: Student module co-directors represent a well-accepted practice model for curriculum development. This report may stimulate other faculties to engage their students more actively in medical education.

Student engagement refers to a broad range of activities where students participate in management, education, research, and community activities within their institutions. It is a mutually beneficial collaborative approach between students and their institutions. This article provides practical advice for the implementation or further development of student engagement at medical, dental, and veterinary schools. The tips provided are based on the experiences of a group of universities recently recognized for best practice in student engagement, and are supported by evidence from the literature. The tips cover overarching themes which include the creation of an institutional culture and formal framework for student engagement, and maximize communication routes between students with peers and faculty. Tips are for specific areas of active student engagement, covering curriculum design and development, peer teaching, governance processes, research activities, peer support programs, and interaction with the local community.

Aim: Undergraduate medical education is currently in a fundamental transition towards competency-based programs around the globe. A major curriculum reform implies a dual challenge: the change of the curriculum and the delivering organization. Both are closely interwoven. In this article, we provide practical insights into our approach of managing such a fundamental reform of the large undergraduate medical program at the Charité - Universitätsmedizin Berlin., Methods: Members of the project management team summarized the key features of the process with reference to the literature., Results: Starting point was a traditional, discipline-based curriculum that was reformed into a fully integrated, competency-based program. This change process went through three phases: initiation, curriculum development and implementation, and sustainability. We describe from a change management perspective, their main characteristics, and the approaches that were employed to manage them successfully., Conclusions: Our report is intended to provide practical insights and guidance for those institutions which are yet considering or have already started to undergo a major reform of their undergraduate programs towards competency medical education.

The concept of entrustable professional activities (EPAs) reframes the approach to assessment in competency-based medical education. Key to this concept is the linking of assessment to decision making about entrusting learners with clinical responsibilities. Based on recent literature and the authors' experiences with implementing EPAs, this article provides practical recommendations for how to implement EPAs for assessment and entrustment decisions in the workplace. Tips for supervising clinicians include talking to learners about trust, using EPA descriptions to guide learning and teaching, providing learners with greater ad hoc responsibilities, using EPAs to identify/create opportunities for assessment and feedback, including case-based discussions and acknowledging gut feelings about learner readiness for more autonomy. Tips for curriculum leaders entail enabling the trust development, applying trust decisions at all levels of the supervision scale, employing all available information sources for entrustment, empowering learner ownership of the assessment process and using technology for learner tracking and program evaluation.

This Guide was written to support educators interested in building a competency-based workplace curriculum. It aims to provide an up-to-date overview of the literature on Entrustable Professional Activities (EPAs), supplemented with suggestions for practical application to curriculum construction, assessment and educational technology. The Guide first introduces concepts and definitions related to EPAs and then guidance for their identification, elaboration and validation, while clarifying common misunderstandings about EPAs. A matrix-mapping approach of combining EPAs with competencies is discussed, and related to existing concepts such as competency milestones. A specific section is devoted to entrustment decision-making as an inextricable part of working with EPAs. In using EPAs, assessment in the workplace is translated to entrustment decision-making for designated levels of permitted autonomy, ranging from acting under full supervision to providing supervision to a junior learner. A final section is devoted to the use of technology, including mobile devices and electronic portfolios to support feedback to trainees about their progress and to support entrustment decision-making by programme directors or clinical teams.