Search

Introduction: Medical students report poor academic well-being in a context of high study demands. Study Demands-Resources theories have outlined mediating processes involving high study demands and low resources to mitigate academic well-being, which is subsequently associated with diminished overall well-being (i.e. life satisfaction). Furthermore, academic well-being and life satisfaction are also affected by interactions between study demands and resources (referred to as moderating processes). However, these mediating and moderating processes clarifying medical students' well-being still need to be investigated. Therefore, this study investigated the mediating role of academic well-being in the associations of study demands and resources with life satisfaction and the moderating role of study demands and resources in relation to academic well-being and life satisfaction among undergraduate medical students., Methods: In this cross-sectional survey study, 372 undergraduates from Dutch medical schools participated. The survey included the Study Demands-Resources Scale (workload, growth opportunities and peer support) as well as questionnaires on academic well-being (Utrecht Burnout Scale for students and Utrecht Work Engagement Scale-Student Form) and overall well-being (single item on life satisfaction). Based on Study Demands-Resources theories, (moderated) mediation analyses were performed., Results: Mediating processes were found as growth opportunities were indirectly associated with higher life satisfaction through lower academic burnout and higher academic engagement. Furthermore, workload was indirectly associated with lower life satisfaction through higher academic burnout. This association was moderated as it became weaker with more perceived peer support., Discussion: A high workload and limited growth opportunities are associated with suboptimal academic well-being and life satisfaction. Perceiving support from peer students slightly buffers the unfavourable effect of workload on academic burnout and subsequently life satisfaction. To promote academic well-being and life satisfaction in medical students, universities can consider to reduce the workload, to create a supportive learning environment and to offer development opportunities., (© 2024 The Author(s). Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Background: Active engagement with feedback is crucial for feedback to be effective and improve students' learning and achievement. Medical students are provided feedback on their development in the progress test (PT), which has been implemented in various medical curricula, although its format, integration and feedback differ across institutions. Existing research on engagement with feedback in the context of PT is not sufficient to make a definitive judgement on what works and which barriers exist. Therefore, we conducted an interview study to explore students' feedback use in medical progress testing., Methods: All Dutch medical students participate in a national, curriculum-independent PT four times a year. This mandatory test, composed of multiple-choice questions, provides students with written feedback on their scores. Furthermore, an answer key is available to review their answers. Semi-structured interviews were conducted with 21 preclinical and clinical medical students who participated in the PT. Template analysis was performed on the qualitative data using a priori themes based on previous research on feedback use., Results: Template analysis revealed that students faced challenges in crucial internal psychological processes that impact feedback use, including 'awareness', 'cognizance', 'agency' and 'volition'. Factors such as stakes, available time, feedback timing and feedback presentation contributed to these difficulties, ultimately hindering feedback use. Notably, feedback engagement was higher during clinical rotations, and students were interested in the feedback when seeking insights into their performance level and career perspectives., Conclusion: Our study enhanced the understanding of students' feedback utilisation in medical progress testing by identifying key processes and factors that impact feedback use. By recognising and addressing barriers in feedback use, we can improve both student and teacher feedback literacy, thereby transforming the PT into a more valuable learning tool., (© 2024 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Background: To deliver high-quality collaborative care, residents need to be trained across the boundaries of their medical specialty (intraprofessional learning). The current literature does not provide insights into the underlying processes that influence intraprofessional learning. The aim of this study was to gain insight into the processes that occur during intraprofessional workplace learning in residency training, by exploring everyday intraprofessional interactions experienced by residents, with the ultimate objective of improving collaborative practice., Method: We conducted a focused ethnography using field observations and in-depth interviews with residents at an academic children's hospital in the Netherlands. In 2022, nine residents from four different medical specialties were shadowed and/or interviewed. In total, >120 hours of observation and 10 interviews were conducted. Data collection and analysis were conducted iteratively and discussed in a research team with diverse perspectives, as well as with a sounding board group of stakeholders., Results: Residents were involved in numerous intraprofessional interactions as part of their daily work. We identified three themes that shed light on the underlying processes that occur during intraprofessional workplace learning: (1) residents' agency, (2) ingroups and outgroups and (3) communication about intraprofessional collaboration., Conclusions: Collaborative practice offers many intraprofessional learning opportunities but does not automatically result in learning from, with and about other specialties to improve intraprofessional collaborative care. Overarching the identified themes, we emphasise the pivotal role of the resident-supervisor dyad in facilitating residents' engagement in the learning opportunities of complex intraprofessional care. Furthermore, we propose that promoting deliberate practice and shared responsibility in collaborative care are crucial to better prepare residents for their roles and responsibilities in delivering high-quality collaborative patient care., (© 2023 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Objective This study examined reciprocity in medical residents’ relationships with supervisors, fellow residents, nurses and patients, and associations between reciprocity and burnout. Furthermore, we considered if a discrepancy between the perceived and preferred levels of reciprocity influenced the level of burnout complaints. Methods In 2003, self-report questionnaires were sent to the homes of all 292 medical residents at the University Medical Centre Groningen (UMCG), Groningen, the Netherlands. Reciprocity was measured with a single-item reciprocity scale based on the Hatfield Global Measure of Equity Scale. The Utrecht Burn-Out Scale (UBOS/MBI-HHS) was used to measure burnout. Results A total of 158 residents participated in the study. Those who reported under-benefiting in the relationship with supervisors perceived significantly more emotional exhaustion and depersonalisation than those who perceived a reciprocal relationship. Residents who indicated that they over-benefited in the relationship with nurses reported more emotional exhaustion than residents who perceived a reciprocal relationship and less personal accomplishment than residents who perceived a reciprocal relationship or under-benefit. No differences on the burnout subscales were found between residents who perceived their relationships with patients and fellow residents to be reciprocal and those who considered they under- or over-benefited. The greater the discrepancy between perceived and preferred reciprocity in the relationship with the supervisor, the more emotional exhaustion residents reported. Conclusions Perceptions of reciprocity in relationships with supervisors and nurses had particular influence on the level of burnout complaints among residents. The discrepancy between the impacts of perceived and preferred reciprocity on burnout was negligible and the only significant relationship to emerge concerned that with emotional exhaustion. [ABSTRACT FROM AUTHOR]

Context Sexual harassment of medical students has been the focus of many international studies. Prevalence rates from 18% to over 60% have been reported. However, a Dutch study at Nijmegen Medical School found the prevalence rate to be lower (13.3% in the total group; 20% among female students only). Objectives We aimed to identify whether Nijmegen constitutes a positive sample of Dutch medical schools or whether incidents of sexual harassment are less prevalent in the Netherlands than elsewhere, and to establish if and how these experiences impact the professional lives of students. Methods Students received a semi-structured questionnaire containing questions about their experiences of sexual harassment during clerkships. The questions referred to students’ reactions to any incidents, the possible consequences for their wellbeing or professional functioning and the way cases of sexual harassment were handled. Results The prevalence of sexual harassment was significantly higher in Utrecht than in Nijmegen. In both studies rates were relatively low compared with international data. Nevertheless, 1 in 3–5 Dutch female medical students had experienced unwelcome sexual attention from patients, colleagues or supervisors. Three of 10 students who had experienced such an incident stated that it had a negative impact on their functioning afterwards. Conclusions Prevalence rates of sexual harassment in medical schools in the Netherlands are low compared with international rates. However, the number of women students who experience sexual harassment is still 1 in 3–5. The occurrence of and ways to deal with these incidents should be important topics in the training of medical students and supervisors. [ABSTRACT FROM AUTHOR]

Context In 2003 the Dutch Central College of Medical Specialties presented guidelines for the modernisation of all medical specialty training programmes in the Netherlands. These guidelines are based to a large extent on the CanMEDS (Canadian Medical Education Directives for Specialists) 2000 model, which defines 7 roles for medical specialists. This model was adjusted to the Dutch situation. The roles were converted to 7 fields of competency: Medical Performance; Communication; Collaboration; Knowledge and Science; Community Performance; Management, and Professionalism. Objective As changes in postgraduate training will probably be most effective if future trainees recognise their value, we set out to determine how senior medical students rated these fields of competency in terms of their importance. Methods We carried out a study at University Medical Centre (UMC) Utrecht, the Netherlands, in which 80 Year 6 medical students answered a questionnaire in which they rated the importance of each of 28 key competencies within the 7 competency fields. Results Although all key competencies were regarded as important (averages ≥ 3.8), Professionalism and Communication scored highest on the student ratings. Management was assessed as least important. Conclusions It is interesting that medical students acknowledged the importance of competencies other than those involving medical expertise and performance. It confirms the opinion that educating doctors is currently viewed as much more than providing theoretical and clinical knowledge and skills. The CanMEDS framework is appreciated by Dutch medical students. The fact that all competencies are seen as important adds to their face validity and therefore to their usefulness as a basis for postgraduate training. [ABSTRACT FROM AUTHOR]

Background In the Netherlands the medical education system is in the process of being transformed to establish a more demand-oriented health care system. This transformation may entail the occupational restructuring of the medical profession. Meanwhile, on the supply side, the career intentions of future doctors are also changing. Objectives We aimed to categorise medical students' prevailing career intentions and to examine to what extent newly proposed medical occupations that may be part of the transformation process correspond with these career intentions. Methods We carried out expert interviews and a feedback round to gain input for a survey among students. From the demand perspective, 11 experts proposed non-traditional medical occupations and evaluated these on the basis of job characteristics relevant to a doctor's career choice. Subsequently, students from 5 universities filled out a questionnaire to rate these job characteristics by their importance and the proposed occupations' attractiveness. Results Four different clusters of career intentions were categorised as patient-oriented expert, career-oriented specialist, lifestyle-oriented generalist, and balance-seeking realist. These clusters differ in terms of the ways in which students feel attracted to the proposed occupations. The career-oriented specialists feel least attracted and the lifestyle-oriented generalists most attracted to the occupations. Discussion The experts' call for shorter postgraduate programmes to educate patient-oriented doctors partly matches students' career intentions. Most students share the intention of obtaining a direct care position that provides ample task variation, which may explain the appeal of the occupations ‘emergency doctor’ and ‘basic specialist’. The limited interest in specific patient groups suggests a need for more exposure to the occupations linked to these groups. [ABSTRACT FROM AUTHOR]

Objectives: Sense of Community (SoC) refers to the cognitive or emotional connections established between physically separated learners; it is essential for study success. The recent COVID-19 pandemic highlighted the need for practical guidelines to facilitate building a SoC in online medical preclerkship education in the Netherlands. Therefore, this qualitative study aims to (a) examine perceptions of SoC from both students' and teachers' perspectives in an online elective course during the COVID-19 pandemic in order to (b) provide a conceptual framework with practical guidelines to medical educators on how to build SoC in online education., Methods: The study had an exploratory qualitative design. Semi-structured focus groups with student (n = 15) and teacher (n = 5) volunteers were conducted. Participants discussed their experienced SoC using the storyline method. In addition, course developers (n = 2) were interviewed and lecturers (n = 5) wrote an experience story. Audio- and video-recordings were transcribed verbatim and both the ensuing transcripts and experience stories were analysed using an inductive thematic analysis., Results: All students experienced an increase of SoC during the eight-week course. Five themes were identified: 'social contacts made possible by a physical campus', 'group dynamics', 'teacher influence', 'education format' and 'teachers' Sense of Community'. The authors formulated challenges and practical guidelines on how to build SoC based on these themes., Conclusions: This exploratory qualitative study provides a conceptual framework with practical guidelines for medical educators on how to build SoC in online medical preclerkship education. These guidelines provide a valuable starting point to build SoC in online education for medical educators and students alike., (© 2021 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Introduction: The underrepresentation of women among senior faculty members in medical education is a longstanding problem. The purpose of this international qualitative investigation was to explore women and men's experiences of attaining full professorship and to investigate why women remain underrepresented among the senior faculty ranks., Methods: Conducted within a social constructionist orientation, our qualitative study employed narrative analysis. Two female and two male participants working in medical education were recruited from five nations: Australia, Canada, the Netherlands, United Kingdom and United States. All participants held an MD or PhD. During telephone interviews, participants narrated the story of their careers. The five faculty members on the research team were also interviewed. Their narratives were included in analysis, rendering their experiences equal to those of the participants., Results: A total of 24 full professors working in medical education were interviewed (n = 15 females and n = 9 males). While some aspects were present across all narratives (ie personal events, career milestones and facilitating and/or impeding factors), participants' experience of those aspects differed by gender. Men did not narrate fatherhood as a role navigated professionally, but women narrated motherhood as intimately connected to their professional roles. Both men and women narrated career success in terms of hard work and overcoming obstacles; however, male participants described promotion as inevitable, whereas women narrated promotion as a tenuous navigation of social structures towards uncertain outcomes. Female and male participants encountered facilitators and inhibitors throughout their careers but described acting on those experiences differently within the cultural contexts they faced., Discussion: Our data suggest that female and male participants had different experiences of the work involved in achieving full professor status. Understanding these gendered experiences and their impact on career progression is an important advancement for better understanding what leads to the underrepresentation of women among senior faculty members in medical education., (© 2020 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Context: Intraprofessional collaboration (intraPC) between primary care (PC) doctors and medical specialists (MSs) is becoming increasingly important. Patient safety issues are often related to intraPC. In order to equip doctors well for their task of providing good quality and continuity of care, intraPC needs explicit attention, starting in postgraduate training. Worldwide, PC residents undertake a hospital placement during their postgraduate training, where they work in proximity with MS residents. This placement offers the opportunity to learn intraPC. It is yet unknown whether and how residents learn intraPC and what barriers to and opportunities for exist in learning intraPC during hospital placements., Methods: We performed an ethnographic non-participatory observational study in three emergency departments and three geriatric departments of five hospitals in the Netherlands. This was followed by 42 in-depth interviews with the observed residents and supervisors. The observations were used to feed the questions for the in-depth interviews. We analysed the interviews iteratively following the data collection using template analysis., Results: Hospital wards are rich in opportunities for learning intraPC. These opportunities, however, are seldom exploited for various reasons: intraPC receives limited attention when formulating placement goals, so purposeful learning of intraPC hardly takes place; residents lack awareness of the learning of intraPC; MS residents are not accustomed to searching for expertise from PC residents; PC residents adapt to the MS role and they contribute very little of their PC knowledge, and power dynamics in the hospital department negatively influence the learning of intraPC. Therefore, improvements in mindset, professional identity and power dynamics are crucial to facilitate and promote intraPC., Conclusions: Intraprofessional collaboration is not learned spontaneously during hospital placements. To benefit from the abundant opportunities to learn intraPC, adjustments to the set-up of these placements are necessary. Learning intraPC is promoted when there is a collaborative culture, hierarchy is limited, and there is dedicated time for intraPC and support from the supervisor., (© 2020 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Objectives: Since their introduction, workplace-based assessments (WBAs) have proliferated throughout postgraduate medical education. Previous reviews have identified mixed findings regarding WBAs' effectiveness, but have not considered the importance of user-tool-context interactions. The present review was conducted to address this gap by generating a thematic overview of factors important to the acceptability, effectiveness and utility of WBAs in postgraduate medical education., Method: This review utilised a hermeneutic cycle for analysis of the literature. Four databases were searched to identify articles pertaining to WBAs in postgraduate medical education from the United Kingdom, Canada, Australia, New Zealand, the Netherlands and Scandinavian countries. Over the course of three rounds, 30 published articles were thematically analysed in an iterative fashion to deeply engage with the literature in order to answer three scoping questions concerning acceptability, effectiveness and assessment training. As each round was coded, themes were refined and questions added until saturation was reached., Results: Stakeholders value WBAs for permitting assessment of trainees' performance in an authentic context. Negative perceptions of WBAs stem from misuse due to low assessment literacy, disagreement with definitions and frameworks, and inadequate summative use of WBAs. Effectiveness is influenced by user (eg, engagement and assessment literacy) and tool attributes (eg, definitions and scales), but most fundamentally by user-tool-context interactions, particularly trainee-assessor relationships. Assessors' assessment literacy must be combined with cultural and administrative factors in organisations and the broader medical discipline., Conclusions: The pivotal determinants of WBAs' effectiveness and utility are the user-tool-context interactions. From the identified themes, we present 12 lessons learned regarding users, tools and contexts to maximise WBA utility, including the separation of formative and summative WBA assessors, use of maximally useful scales, and instituting measures to reduce competitive demands., (© 2020 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Objectives: We expect physicians to be lifelong learners. Participation in clinical practice is an important potential source of that learning. To support physicians in this process, a better understanding of how they learn in clinical practice is necessary. This study investigates how physicians recognise and use informal feedback from interactions with patients in outpatient settings as learning cues to adjust their communication behaviours in daily practice., Methods: To understand physicians' use of informal feedback, we combined non-participant observations with semi-structured interviews. We enrolled 10 respiratory physicians and observed 100 physician-patient interactions at two teaching hospitals in the Netherlands. Data collection and analysis were performed iteratively according to the principles of constructivist grounded theory., Results: Following stages of open, axial and selective coding, we were able to conceptualise how physicians use cues to reflect on and adjust their communication. In addition to vast variations within and across patient encounters, we observed recurring adjustments in physicians' communication behaviours in response to specific informal feedback cues. Physicians recognised and used these cues to self-monitor communication performance. They had established 'communication repertoires' based on multiple patient interactions, which many saw as learning opportunities contributing to the development of expertise. Our findings, however, show differences in physicians' individual levels of sensitivity in recognising and using learning opportunities in daily practice, which were further influenced by contextual, personal and interpersonal factors. Whereas some described themselves as having little inclination to change, others used critical incidents to fine-tune their communication repertoires, and yet others constantly reshaped them, seeking learning opportunities in their daily work., Conclusions: There is large variation in how physicians use learning cues from daily practice. To enhance learning in and from daily practice, we propose turning workplace learning into a collaborative effort with the aim of increasing awareness and the use of informal performance-relevant feedback., (© 2020 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Objectives: Medical residents can play key roles in improving health care quality by speaking up and giving suggestions for improvements. However, previous research on speaking up by medical residents has shown that speaking up is difficult for residents. This study explored: (i) whether two main aspects of medical residents' work context (job control and supervisor support) are associated with speaking up by medical residents, and (ii) whether these associations differ between in-hospital and out-of-hospital settings., Methods: Speaking up was operationalised and measured as voice behaviour. Structural equation modelling using a cross-sectional survey design was used to identify and test factors pertaining to speaking up and to compare hospital settings., Results: A total of 499 medical residents in the Netherlands participated in the study. Correlational analysis showed significant positive associations between each of support and control, and voice behaviour. The authors assumed that the associations between support and control, and voice behaviour would be partially mediated by engagement. This partial mediation model fitted the data best, but showed no association between support and voice. However, multi-group analysis showed that for residents in hospital settings, support is associated with voice behaviour. For residents outside hospital settings, control is more important. Engagement mediated the effects of control and support outside hospital settings, but not within the hospital., Conclusions: This study shows that in order to enable medical residents to share their suggestions for improvement, it is beneficial to invest in supportive supervision and to increase their sense of control. Boosting medical residents' support would be most effective in hospital settings, whereas in other health care organisations it would be more effective to focus on job control., (© 2019 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Introduction: Outcome-based approaches to education and the inherent emphasis on programmatic assessment in particular, require models of mentoring in which mentors fulfil dual roles: coach and assessor. Fulfilling multiple roles could result in role confusion or even role conflicts, both of which may affect mentoring processes and outcomes. In this study, we explored how mentors conceptualise and enact their role in a multiple-role mentoring system and to what extent they experience role conflicts., Methods: We conducted a constructivist grounded theory study at one undergraduate medical school. A purposive sample of 12 physician-mentors active in a programmatic assessment system was interviewed. Data analysis followed stages of open, axial and selective coding through which themes were constructed., Results: Three predominant mentoring approaches were constructed: (i) empowering (a reflective and holistic approach to student development); (ii) checking (an observant approach to check whether formal requirements are met), and (iii) directing (an authoritative approach to guide students' professional development). Each approach encompassed a corresponding type of mentor-mentee relationship: (i) partnership; (ii) instrumental, and (iii) faculty-centred. Furthermore, mentors' strategies, focus, agency provided to students and perception of the assessment system characterised mentoring approaches and relationships. Role conflicts were mainly experienced by mentors with a directing mentoring approach. They used various coping mechanisms, including deviation from assessment guidelines., Conclusions: In multiple-role mentoring in the context of programmatic assessment, mentors adopted certain predominant mentoring approaches, which were characterised by different strategies for mentoring and resulted in different mentor-mentee relationships. Multiple-role mentoring does not necessarily result in role conflict. Mentors who do experience role conflict seem to favour the directing approach, which is most at odds with key principles of competency-based education and programmatic assessment. These findings build upon existing mentoring literature and offer practical suggestions for faculty development regarding approaches to mentoring in programmatic assessment systems., (© 2019 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Context: Ethnicity-related differences in clinical grades exist. Broad sampling in assessment of clinical competencies involves multiple assessments used by multiple assessors across multiple moments. Broad sampling in assessment potentially reduces irrelevant variances and may therefore mitigate ethnic disparities in clinical grades., Objectives: Research question 1 (RQ1): to assess whether the relationship between students' ethnicity and clinical grades is weaker in a broadly sampled versus a global assessment. Research question 2 (RQ2): to assess whether larger ethnicity-related differences in grades occur when supervisors are given the opportunity to deviate from the broadly sampled assessment score., Methods: Students' ethnicity was classified as Turkish/Moroccan/African, Surinamese/Antillean, Asian, Western, and native Dutch. RQ1: 1667 students (74.3% native Dutch students) were included, who entered medical school between 2002 and 2004 (global assessment, 818 students) and between 2008 and 2010 (broadly sampled assessment, 849 students). The main outcome measure was whether or not students received ≥3 times a grade of 8 or higher on a scale from 1 to 10 in five clerkships. RQ2: 849 students (72.4% native Dutch students) were included, who were assessed by broad sampling. The main outcome measure was the number of grade points by which supervisors had deviated from broadly sampled scores. Both analyses were adjusted for gender, age, (im)migration status and average bachelor grade., Results: Research question 1: ethnicity-related differences in clinical grades were smaller in broadly sampled than in global assessment, and this was also seen after adjustments. More specifically, native Dutch students had reduced probabilities (0.87-0.65) in broadly sampled as compared with global assessment, whereas Surinamese (0.03-0.51) and Asian students (0.21-0.30) had increased probabilities of having ≥3 times a grade of 8 or higher in five clerkships. Research question 2: when supervisors were allowed to deviate from original grades, ethnicity-related differences in clinical grades were reintroduced., Conclusions: Broadly sampled assessment reduces ethnicity-related differences in grades., (© 2019 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Context: Medical experts have access to elaborate and integrated knowledge networks consisting of biomedical and clinical knowledge. These coherent knowledge networks enable them to generate more accurate diagnoses in a shorter time. However, students' knowledge networks are less organised and students have difficulties linking theory and practice and transferring acquired knowledge. Therefore we wanted to explore the development and transfer of knowledge of third-year preclinical students on a problem-based learning (PBL) course with real patient contacts., Methods: Before and after a 10-week PBL course with real patients, third-year medical students were asked to think out loud while diagnosing four types of paper patient problems (two course cases and two transfer cases), and explain the underlying pathophysiological mechanisms of the patient features. Diagnostic accuracy and time needed to think through the cases were measured. The think-aloud protocols were transcribed verbatim and different types of knowledge were coded and quantitatively analysed. The written pathophysiological explanations were translated into networks of concepts. Both the concepts and the links between concepts in students' networks were compared to model networks., Results: Over the course diagnostic accuracy increased, case-processing time decreased, and students used less biomedical and clinical knowledge during diagnostic reasoning. The quality of the pathophysiological explanations increased: the students used more concepts, especially more model concepts, and they used fewer wrong concepts and links. The findings differed across course and transfer cases. The effects were generally less strong for transfer cases., Conclusions: Students' improved diagnostic accuracy and the improved quality of their knowledge networks suggest that integration of biomedical and clinical knowledge took place during a 10-week course. The differences between course and transfer cases demonstrate that transfer is complex and time-consuming. We therefore suggest offering students many varied patient contacts with the same underlying pathophysiological mechanism and encouraging students to link biomedical and clinical knowledge., (© 2015 John Wiley & Sons Ltd.)

Context: Despite evidence for the predictive value of both pre-admission characteristics and past performance at medical school, their relative contribution to predicting medical school performance has not been thoroughly investigated., Objectives: This study was designed to determine the relative importance of pre-admission characteristics and past performance in medical school in predicting student performance in pre-clinical and clinical training., Methods: This longitudinal prospective study followed six cohorts of students admitted to a Dutch, 6-year, undergraduate medical course during 2002-2007 (n = 2357). Four prediction models were developed using multivariate logistic regression analysis. Main outcome measures were 'Year 1 course completion within 1 year' (models 1a, 1b), 'Pre-clinical course completion within 4 years' (model 2) and 'Achievement of at least three of five clerkship grades of ≥ 8.0' (model 3). Pre-admission characteristics (models 1a, 1b, 2, 3) and past performance at medical school (models 1b, 2, 3) were included as predictor variables., Results: In model 1a - including pre-admission characteristics only - the strongest predictor for Year 1 course completion was pre-university grade point average (GPA). Success factors were 'selected by admission testing' and 'age > 21 years'; risk factors were 'Surinamese/Antillean background', 'foreign pre-university degree', 'doctor parent' and male gender. In model 1b, number of attempts and GPA at 4 months were the strongest predictors for Year 1 course completion, and male gender remained a risk factor. Year 1 GPA was the strongest predictor for pre-clinical course completion, whereas being male or aged 19-21 years were risk factors. Pre-clinical course GPA positively predicted clinical performance, whereas being non-Dutch or a first-generation university student were important risk factors for lower clinical grades. Nagelkerke's R(2) ranged from 0.16 to 0.62., Conclusions: This study not only confirms the importance of past performance as a predictor of future performance in pre-clinical training, but also reveals the importance of a student's background as a predictor in clinical training. These findings have important practical implications for selection and support during medical school., (© 2015 John Wiley & Sons Ltd.)

Objectives: The importance of self-regulated learning (SRL) has been broadly recognised by medical education institutions and regulatory bodies. Supporting the development of SRL skills has proven difficult because self-regulation is a complex interactive process and we know relatively little about the factors influencing this process in real practice settings. The aim of our study was therefore to identify factors that support or hamper medical students' SRL in a clinical context., Methods: We conducted a constructivist grounded theory study using semi-structured interviews with 17 medical students from two universities enrolled in clerkships. Participants were purposively sampled to ensure variety in age, gender, experience and current clerkship. The Day Reconstruction Method was used to help participants remember their activities of the previous day. The interviews were transcribed verbatim and analysed iteratively using constant comparison and open, axial and interpretive coding., Results: Self-regulated learning by students in the clinical environment was influenced by the specific goals perceived by students, the autonomy they experienced, the learning opportunities they were given or created themselves, and the anticipated outcomes of an activity. All of these factors were affected by personal, contextual and social attributes., Conclusions: Self-regulated learning of medical students in the clinical environment is different for every individual. The factors influencing this process are affected by personal, social and contextual attributes. Some of these are similar to those known from previous research in classroom settings, but others are unique to the clinical environment and include the facilities available, the role of patients, and social relationships pertaining to peers and other hospital staff. To better support students' SRL, we believe it is important to increase students' metacognitive awareness and to offer students more tailored learning opportunities., (© 2015 John Wiley & Sons Ltd.)

Context: It is widely acknowledged that assessment can affect student learning. In recent years, attention has been called to 'programmatic assessment', which is intended to optimise both learning functions and decision functions at the programme level of assessment, rather than according to individual methods of assessment. Although the concept is attractive, little research into its intended effects on students and their learning has been conducted., Objectives: This study investigated the elements of programmatic assessment that students perceived as supporting or inhibiting learning, and the factors that influenced the active construction of their learning., Methods: The study was conducted in a graduate-entry medical school that implemented programmatic assessment. Thus, all assessment information, feedback and reflective activities were combined into a comprehensive, holistic programme of assessment. We used a qualitative approach and interviewed students (n = 17) in the pre-clinical phase of the programme about their perceptions of programmatic assessment and learning approaches. Data were scrutinised using theory-based thematic analysis., Results: Elements from the comprehensive programme of assessment, such as feedback, portfolios, assessments and assignments, were found to have both supporting and inhibiting effects on learning. These supporting and inhibiting elements influenced students' construction of learning. Findings showed that: (i) students perceived formative assessment as summative; (ii) programmatic assessment was an important trigger for learning, and (iii) the portfolio's reflective activities were appreciated for their generation of knowledge, the lessons drawn from feedback, and the opportunities for follow-up. Some students, however, were less appreciative of reflective activities. For these students, the elements perceived as inhibiting seemed to dominate the learning response., Conclusions: The active participation of learners in their own learning is possible when learning is supported by programmatic assessment. Certain features of the comprehensive programme of assessment were found to influence student learning, and this influence can either support or inhibit students' learning responses., (© 2015 John Wiley & Sons Ltd.)

Context: A significant challenge facing health care is the ageing of the population, which calls for a major response in medical education. Most clinical learning takes place within hospitals, but nursing homes may also represent suitable learning environments in which students can gain competencies in geriatric medicine., Objectives: This study explores what students perceive as the main learning outcomes of a geriatric medicine clerkship in a hospital or a nursing home, and explicitly addresses factors that may stimulate or hamper the learning process., Methods: This qualitative study falls within a constructivist paradigm: it draws on socio-cultural learning theory and is guided by the principles of constructivist grounded theory. There were two phases of data collection. Firstly, a maximum variation sample of 68 students completed a worksheet, giving brief written answers on questions regarding their geriatric medicine clerkships. Secondly, focus group discussions were conducted with 19 purposively sampled students. We used template analysis, iteratively cycling between data collection and analysis, using a constant comparative process., Results: Students described a broad range of learning outcomes and formative experiences that were largely distinct from their learning in previous clerkships with regard to specific geriatric knowledge, deliberate decision making, end-of-life care, interprofessional collaboration and communication. According to students, the nursing home differed from the hospital in three aspects: interprofessional collaboration was more prominent; the lower resources available in nursing homes stimulated students to be creative, and students reported having greater autonomy in nursing homes compared with the more extensive educational guidance provided in hospitals., Conclusions: In both hospitals and nursing homes, students not only learn to care for older patients, but also describe various broader learning outcomes necessary to become good doctors. The results of our study, in particular the specific benefits and challenges associated with learning in the nursing home, may further inform the implementation of geriatric medicine clerkships in hospitals and nursing homes., (© 2015 John Wiley & Sons Ltd.)

Context: Medical schools in Western societies seek measures to increase the diversity of their student bodies with respect to ethnicity and social background. Currently, little is known about the effects of different selection procedures on student diversity., Objectives: This prospective cohort study aimed to determine performance differences between traditional and non-traditional (i.e. ethnic minority and first-generation university candidates) medical school applicants in academic and non-academic selection criteria., Methods: Applicants in 2013 (n = 703) were assessed on academic and non-academic selection criteria. They also completed a questionnaire on ethnicity and social background. Main outcome measures were 'not selected' (i.e. failure on any criteria), 'failure on academic criteria' and 'failure on non-academic criteria'. Odds ratios (ORs) with 95% confidence intervals (CIs) were estimated by logistic regression analysis for ethnic subgroups (Surinamese/Antillean, Turkish/Moroccan/African, Asian, Western) compared with Dutch applicants, adjusted for age, gender, additional socio-demographic variables (first-generation immigrant, first-generation university applicant, first language, medical doctor as parent) and pre-university grade point average (pu-GPA). Similar analyses were performed for first-generation university applicants., Results: Compared with Dutch applicants, Surinamese/Antillean applicants underperformed in the selection procedure (failure rate: 78% versus 57%; adjusted OR 2.52, 95% CI 1.07-5.94), in particular on academic criteria (failure rate: 66% versus 34%; adjusted OR 3.00, 95% CI 1.41-6.41). The higher failure rate of first-generation university applicants on academic criteria (50% versus 37%; unadjusted OR 1.66, 95% CI 1.18-2.33) was partly explained by additional socio-demographic variables and pu-GPA. The outcome measure 'failure on non-academic criteria' showed no significant differences among the ethnic or social subgroups., Conclusions: The absence of differences on non-academic criteria was promising with reference to increasing social and ethnic diversity; however, the possibility that self-selection instigated by the selection procedure is stronger in applicants from non-traditional backgrounds cannot be ruled out. Further research should also focus on why cognitive tests might favour traditional applicants., (© 2014 John Wiley & Sons Ltd.)

Context: The use of roles such as medical expert, advocate or communicator to define competencies is currently popular in health professions education. CanMEDS is one framework that has been subject to great uptake across multiple countries and professions. The examination of the historical and cultural choices of names for roles generates insight into the nature and construction of roles. One role that has appeared in and disappeared from roles-based frameworks is that of the 'person'., Methods: In order to examine the implications of explicitly including or excluding the role of the 'physician as person' in a competency framework, we conducted a contrastive analysis of the development of frameworks in Canada and the Netherlands. We drew upon critical social science theoretical understandings of the power of language in our analysis., Results: In Canada, the 'person' role was a late addition to the precursory work that informed CanMEDS, and was then excluded from the final set of CanMEDS role names. In the Netherlands, a 'reflector' role was added in some Dutch schools and programmes when CanMEDS was adopted. This was done in order to explicitly emphasise the importance of the 'person' of the trainee., Conclusions: In analysing choices of names for roles, we have the opportunity to see how cultural and historical contexts affect conceptions of the roles of doctors. The taking up and discarding of the 'person' role in Canada and the Netherlands suggest that as medical educators we may need to further consider the ways in which we wish the trainee as a person to be made visible in the curriculum and in assessment tools., (© 2014 John Wiley & Sons Ltd.)

Objectives: Traditional student feedback questionnaires are imperfect course evaluation tools, largely because they generate low response rates and are susceptible to response bias. Preliminary research suggests that prediction-based methods of course evaluation - in which students estimate their peers' opinions rather than provide their own personal opinions - require significantly fewer respondents to achieve comparable results and are less subject to biasing influences. This international study seeks further support for the validity of these findings by investigating: (i) the performance of the prediction-based method, and (ii) its potential for bias., Methods: Participants (210 Year 1 undergraduate medical students at McGill University, Montreal, Quebec, Canada, and 371 Year 1 and 385 Year 3 undergraduate medical students at the University Medical Center Groningen [UMCG], University of Groningen, Groningen, the Netherlands) were randomly assigned to complete course evaluations using either the prediction-based or the traditional opinion-based method. The numbers of respondents required to achieve stable outcomes were determined using an iterative process. Differences between the methods regarding the number of respondents required were analysed using t-tests. Differences in evaluation outcomes between the methods and between groups of students stratified by four potentially biasing variables (gender, estimated general level of achievement, expected test result, satisfaction after examination completion) were analysed using multivariate analysis of variance (manova)., Results: Overall response rates in the three student cohorts ranged from 70% to 94%. The prediction-based method required significantly fewer respondents than the opinion-based method (averages of 26-28 and 67-79 respondents, respectively) across all samples (p < 0.001), whereas the outcomes achieved were fairly similar. Bias was found in four of 12 opinion-based condition comparisons (three sites, four variables), and in only one comparison in the prediction-based condition., Conclusions: Our study supports previous findings that prediction-based methods require significantly fewer respondents to achieve results comparable with those obtained through traditional course evaluation methods. Moreover, our findings support the hypothesis that prediction-based responses are less subject to bias than traditional opinion-based responses. These findings lend credence to prediction-based as an accurate and efficient method of course evaluation., (© Blackwell Publishing Ltd 2013.)

Context: The supervision of specialty registrars during on-call shifts is essential to ensure the quality of both health care and medical education, but has been identified as a major novelty and stressor for new consultants in the transition from specialty training. There is a paucity of research on how consultants deal with their new supervisory roles and which factors influence this process. These issues are addressed in a prospective study designed to gather insights that can inform measures to ensure the provision of high-quality supervision and specialty training., Methods: A longitudinal qualitative study was performed in the Netherlands. Semi-structured interviews were conducted with new consultants. The study was guided by an interpretative phenomenological approach until saturation was reached. At 3-month intervals between July 2011 and March 2012, eight novice consultants in internal medicine were interviewed three times each about their supervisory role while on call. Interviews focused on their preparation for the role in training, the actions they took to master the role, and their progression over time., Results: Three interrelated domains of relevant factors emerged from the data: preparedness; personal characteristics, and contextual characteristics. Preparedness referred to the extent to which new consultants were prepared by training to take full responsibility for registrars' actions while supervising them from a distance. Personal characteristics, such as coping strategies and views on supervision, guided consultants' development as supervisors. Essential to this process were contextual characteristics, especially those concerning the extent to which the consultant knew the registrar, was familiar with departmental procedures, and had access to support from colleagues., Conclusions: New consultants should be prepared for their supervisory role by training and by being given a proper introduction to their workplace. The former requires progressive independence and exposure to supervisory tasks during specialty training; the latter requires an induction programme to enable new consultants to familiarise themselves with the departmental environment and the registrars they will be supervising., (© Blackwell Publishing Ltd 2013.)

Context: Many studies have examined how educational innovations in postgraduate medical education (PGME) impact on teaching and learning, but little is known about effects in the clinical workplace outside the strictly education-related domain. Insights into the full scope of effects may facilitate the implementation and acceptance of innovations because expectations can be made more realistic, and difficulties and pitfalls anticipated. Using workplace-based assessment (WBA) as a reference case, this study aimed to determine which types of effect are perceived by users of innovations in PGME., Methods: Focusing on WBA as a recent instance of innovation in PGME, we conducted semi-structured interviews to explore perceptions of the effects of WBA in a purposive sample of Dutch trainees and (lead) consultants in surgical and non-surgical specialties. Interviews conducted in 2011 with 17 participants were analysed thematically using template analysis. To support the exploration of effects outside the domain of education, the study design was informed by theory on the diffusion of innovations., Results: Six domains of effects of WBA were identified: sentiments (affinity with the innovation and emotions); dealing with the innovation; specialty training; teaching and learning; workload and tasks, and patient care. Users' affinity with WBA partly determined its effects on teaching and learning. Organisational support and the match between the innovation and routine practice were considered important to minimise additional workload and ensure that WBA was used for relevant rather than easily assessable training activities. Dealing with WBA stimulated attention for specialty training and placed specialty training on the agenda of clinical departments., Conclusions: These outcomes are in line with theoretical notions regarding innovations in general and may be helpful in the implementation of other innovations in PGME. Given the substantial effects of innovations outside the strictly education-related domain, individuals designing and implementing innovations should consider all potential effects, including those identified in this study., (© Blackwell Publishing Ltd 2013.)

Context: Medical schools worldwide are increasingly switching to student-centred methods such as problem-based learning (PBL) to foster lifelong self-directed learning (SDL). The cross-cultural applicability of these methods has been questioned because of their Western origins and because education contexts and learning approaches differ across cultures., Objectives: This study evaluated PBL's cross-cultural applicability by investigating how it is applied in three medical schools in regions with different cultures in, respectively, East Asia, the Middle East and Western Europe. Specifically, it investigated how students' cultural backgrounds impact on SDL in PBL and how this impact affects students., Methods: A qualitative, cross-cultural, comparative case study was conducted in three medical schools. Data were collected through 88 semi-structured, in-depth interviews with Year 1 and 3 students, tutors and key persons involved in PBL, 32 observations of Year 1 and 3 PBL tutorials, document analysis, and contextual information. The data were thematically analysed using the template analysis method. Comparisons were made among the three medical schools and between Year 1 and 3 students across and within the schools., Results: The cultural factors of uncertainty and tradition posed a challenge to Middle Eastern students' SDL. Hierarchy posed a challenge to Asian students and achievement impacted on both sets of non-Western students. These factors were less applicable to European students, although the latter did experience some challenges. Several contextual factors inhibited or enhanced SDL across the cases. As students grew used to PBL, SDL skills increased across the cases, albeit to different degrees., Conclusions: Although cultural factors can pose a challenge to the application of PBL in non-Western settings, it appears that PBL can be applied in different cultural contexts. However, its globalisation does not postulate uniform processes and outcomes, and culturally sensitive alternatives might be developed., (© Blackwell Publishing Ltd 2012.)

Objectives: Feedback in workplace-based clinical settings often relies on expert trainers' judgements of directly observed trainee performance. There is ample literature on effective feedback, but in practice trainees in workplace-based training are not regularly observed. We aimed to examine external conditions that impact feedback in observational workplace-based assessment (WBA)., Methods: Interviews were conducted and the resulting data analysed using a qualitative, phenomenological approach. Between October 2009 and January 2010, we interviewed 22 postgraduate general practice trainees at two institutions in the Netherlands. Three researchers analysed the transcripts of the interviews., Results: A three-step scheme emerged from the data. Feedback as part of WBA is of greater benefit to trainees if: (i) observation and feedback are planned by the trainee and trainer; (ii) the content and delivery of the feedback are adequate, and (iii) the trainee uses the feedback to guide his or her learning by linking it to learning goals. Negative emotions reported by almost all trainees in relation to observation and feedback led to different responses. Some trainees avoided observation, whereas others overcame their apprehension and actively sought observation and feedback. Active trainers were able to help trainees overcome their fears. Four types of trainer-trainee pairs were distinguished according to their engagement in observation and feedback. External requirements set by training institutions may stimulate inactive trainers and trainees., Conclusions: In line with the literature, our results emphasise the importance of the content of feedback and the way it is provided, as well as the importance of its incorporation in trainees' learning. Moreover, we highlight the step before the actual feedback itself. The way arrangements for feedback are made appears to be important to feedback in formative WBA. Finally, we outline several factors that influence the success or failure of feedback but precede the process of observation and feedback., (© Blackwell Publishing Ltd 2012.)

Context: Research from numerous medical schools has shown that students from ethnic minorities underperform compared with those from the ethnic majority. However, little is known about why this underperformance occurs and whether there are performance differences among ethnic minority groups., Objectives: This study aimed to investigate underperformance across ethnic minority groups in undergraduate pre-clinical and clinical training., Methods: A longitudinal prospective cohort study of progress on a 6-year undergraduate medical course was conducted in a Dutch medical school. Participants included 1661 Dutch and 696 non-Dutch students who entered the course over a consecutive 6-year period (2002-2007). Main outcome measures were performance in Year 1 and in the pre-clinical and clinical courses. Odds ratios (ORs) with 95% confidence intervals (CIs) were estimated by logistic regression analysis for ethnic subgroups (Surinamese/Antillean, Turkish/Moroccan/African, Asian, Western) compared with Dutch students, adjusted for age, gender, pre-university grade point average (pu-GPA), additional socio-demographic variables (first-generation immigrant, urban background, first-generation university student, first language, medical doctor as parent) and previous performance at medical school., Results: Compared with Dutch students, Surinamese and Antillean students specifically underperformed in the Year 1 course (pass rate: 37% versus 64%; adjusted OR 0.40, 95% CI 0.27-0.60) and the pre-clinical course (pass rate: 19% versus 41%; adjusted OR 0.57, 95% CI 0.35-0.93). On the clinical course all non-Dutch subgroups were less likely than Dutch students to receive a grade of ≥ 8.0 (at least three of five grades: 54-77% versus 88%; adjusted ORs: 0.17-0.45)., Conclusions: Strong ethnic disparities exist in medical school performance even after adjusting for age, gender, pu-GPA and socio-demographic variables. More subjective grading cannot be ruled out as a cause of lower grades in clinical training, but other possible explanations should be studied further to mitigate the disparities., (© Blackwell Publishing Ltd 2012.)

Context:   Consultants in charge of postgraduate medical education (PGME) in hospital departments ('lead consultants') are responsible for the implementation of educational change. Although difficulties in innovating in medical education are described in the literature, little is known about how lead consultants approach educational change., Objectives:   This study was conducted to explore lead consultants' approaches to educational change in specialty training and factors influencing these approaches., Methods:   From an interpretative constructivist perspective, we conducted a qualitative exploratory study using semi-structured interviews with a purposive sample of 16 lead consultants in the Netherlands between August 2010 and February 2011. The study design was based on the research questions and notions from corporate business and social psychology about the roles of change managers. Interview transcripts were analysed thematically using template analysis., Results:   The lead consultants described change processes with different stages, including cause, development of content, and the execution and evaluation of change, and used individual change strategies consisting of elements such as ideas, intentions and behaviour. Communication is necessary to the forming of a strategy and the implementation of change, but the nature of communication is influenced by the strategy in use. Lead consultants differed in their degree of awareness of the strategies they used. Factors influencing approaches to change were: knowledge, ideas and beliefs about change; level of reflection; task interpretation; personal style, and department culture., Conclusions:   Most lead consultants showed limited awareness of their own approaches to change. This can lead them to adopt a rigid approach, whereas the ability to adapt strategies to circumstances is considered important to effective change management. Interventions and research should be aimed at enhancing the awareness of lead consultants of approaches to change in PGME., (© Blackwell Publishing Ltd 2012.)

Objectives:   Evaluations of faculty members are widely used to identify excellent or substandard teaching performance. In order to enable such evaluations to be properly interpreted and used in faculty development, it is essential to understand the factors that influence resident doctors' (residents) evaluations of the teaching qualities of faculty members and their perceptions of faculty members as role-model specialists., Methods:   We carried out a cross-sectional survey within a longitudinal study of the System for Evaluation of Teaching Qualities (SETQ) of clinical teachers. The study sample included 889 residents and 1014 faculty members in 61 teaching programmes spanning 22 specialties in 20 hospitals in the Netherlands. Main outcome measures included residents' (i) global and (ii) specific ratings of faculty member teaching qualities, and (iii) global ratings of faculty members as role-model specialists. Statistical analysis was conducted using adjusted multivariable logistic generalised estimating equations., Results:   In total, 690 residents (77.6%) completed 6485 evaluations of 962 faculty members, 848 (83.6%) of whom also self-evaluated. More recently certified faculty members, those who had attended a teacher training programme, and those who spent more time teaching than seeing patients or conducting research were more likely to score highly on most teaching qualities. However, faculty members who had undergone teacher training were less likely to be seen as role models (odds ratio [OR] 0.72, 95% confidence interval [CI] 0.59-0.88). In addition, faculty members were evaluated slightly higher by male than female residents on core teaching domains and overall teaching quality, but were less likely to be seen as role models by male residents (OR 0.80, 95% CI 0.67-0.97). Lastly, faculty members had higher odds of receiving top scores in specific teaching domains from residents in the first 4 years of residency and were less likely to be considered as role models by more senior residents., Conclusions:   Younger faculty members who dedicated more time to teaching, had attended a teacher training programme, and were evaluated by male residents in the early years of residency were more likely to receive higher scores for teaching performance., (© Blackwell Publishing Ltd 2012.)

Objectives: A recent controlled study by our group showed that the dropout rate in the first 2 years of study of medical students selected for entry by the assessment of a combination of non-cognitive and cognitive abilities was 2.6 times lower than that of a control group of students admitted by lottery. The aim of the present study was to compare the performance of these two groups in the clinical phase., Methods: A prospective cohort study was performed to compare the performance of 389 medical students admitted by selection with that of 938 students admitted by weighted lottery between 2001 and 2004. Follow-up of these cohorts lasted 5.5-8.5 years. The main outcome measures were the mean grade obtained on the first five discipline-specific clerkships by all cohorts and the mean grade achieved on all 10 clerkships by the cohorts of 2001 and 2002., Results: Selected students obtained a significantly higher mean grade during their first five clerkships than lottery-admitted students (mean ± standard error [SE] 7.95 ± 0.03, 95% confidence interval [CI] 7.90-8.00 versus mean ± SE 7.84 ± 0.02, 95% CI 7.81-7.87; p < 0.001). This difference reflected the fact that selected students achieved a grade of ≥ 8.0 1.5 times more often than lottery-admitted students. An analysis of all mean grades awarded on 10 clerkships revealed the same results. Moreover, the longer follow-up period over the clerkships showed that the relative risk for dropout was twice as low in the selected student group as in the lottery-admitted student group., Conclusions: The selected group received significantly higher mean grades on their first five clerkships, which could not be attributed to factors other than the selection procedure. Although the risk for dropout before the clinical phase increased somewhat in both groups, the actual dropout rate proved to be twice as low in the selected group., (© Blackwell Publishing Ltd 2011.)

Context: Despite frequent complaints that biomedical knowledge is quickly forgotten after it has been learned, few investigations of actual long-term retention of basic science knowledge have been conducted in the medical domain., Objectives: Our aim was to illuminate the long-term retention of basic science knowledge, particularly of unrehearsed knowledge., Methods: Using a cross-sectional study design, medical students and doctors in the Netherlands were tested for retention of basic science knowledge. Relationships between retention interval and proportion of correct answers on a knowledge test were investigated., Results: The popular notion that most of basic science knowledge is forgotten shortly after graduation is not supported by our findings. With respect to the full test scores, which reflect a composite of unrehearsed and rehearsed knowledge, performance decreased from approximately 40% correct answers for students still in medical school, to 25-30% correct answers for doctors after many years of practice. When rehearsal during the retention interval is controlled for, it appears that little knowledge is lost for 1.5-2 years after it was last used; from then on, retention is best described by a negatively accelerated (logarithmic) forgetting curve. After ≥ 25 years, retention levels were in the range of 15-20%., Conclusions: Conclusions about the forgetting of unrehearsed knowledge in this study are in line with findings reported in other domains: it proceeds in accordance with the Ebbinghaus curve for meaningful material, except that in our findings the 'downward' part appears to start later than in most other studies. The limitations of the study are discussed and possible ramifications for medical education are proposed., (© Blackwell Publishing Ltd 2011.)

Context: teaching students in reflection calls for specific teacher competencies. We developed and validated a rating scale focusing on Student perceptions of their Teachers' competencies to Encourage Reflective Learning in small Groups (STERLinG)., Methods: we applied an iterative procedure to reduce an initial list of 241 items pertaining to teacher competencies to 47 items. Subsequently, we validated the instrument in two successive studies. In the first study, we invited 679 medical and speech and language therapy students to assess the teachers of their professional development groups with the STERLinG. Principal components analysis (PCA) with varimax rotation was used to investigate the internal structure of the instrument. In the second study, which involved 791 medical, dental, and speech and language therapy students, we performed a confirmatory factor analysis using the oblique multiple group (OMG) method to verify the original structure., Results: in Study 1, 463 students (68%) completed the STERLinG. The PCA yielded three components: Supporting self-insight; Creating a safe environment, and Encouraging self-regulation. The final 36-item instrument explained 44.3% of the variance and displayed high reliability with α-values of 0.95 for the scale, and 0.91, 0.86 and 0.86 for the respective subscales. In Study 2, 501 students (63%) completed the STERLinG. The OMG confirmed the original structure of the STERLinG and explained 53.0% of the total variance with high α-values of 0.96 for the scale, and 0.94, 0.90 and 0.90 for the respective subscales., Conclusions: the STERLinG is a practical and valid tool for gathering student perceptions of their teachers' competencies to facilitate reflective learning in small groups considering its stable structure, the correspondence of the STERLinG structure with educational theories and the coverage of important domains of reflection. In addition, our study may provide a theoretical framework for the practice of and research into reflective learning.

Objectives: The aim of this cross-sectional study was to investigate the influence of job-related autonomy and social support provided by consultants and colleagues on the stress-related health complaints of surgical residents in the Netherlands., Methods: All (n = 400) Dutch residents in training in general surgery were sent validated self-report questionnaires. Odds ratios were calculated predicting health and exposure to long-term stress for gender, number of working hours, type of hospital, level of social support, job-related autonomy and training phase. The interactions between job-related autonomy and level of social support provided by consultants and colleagues, and all variables, were analysed., Results: A total of 254 of 400 (64%) residents returned questionnaires that were eligible for analysis. Residents experienced more health complaints than the average member of the Dutch working population (4.0 versus 2.5; p = 0.000). Male and senior residents were significantly 'healthier' than female and junior residents, respectively. Social support by consultants was a strong predictor of health and social support by colleagues showed a significant interaction with gender. Women and residents in university hospitals experienced less social support by consultants than men and residents in general teaching hospitals. Residents working in university hospitals experienced lower levels of job-related autonomy and less support from colleagues in comparison with those working in general teaching hospitals. A working week of > 60 hours adversely affected health and job-related autonomy., Conclusions: Social support provided by consultants and colleagues, and job control, are important factors that interact with the work-associated, stress-related health of residents in training in general surgery. Residents report a greater number of health complaints than the average member of the working population, especially female and junior residents. General teaching hospitals seem to provide better support at work than university hospitals.

Objectives: Social and cultural diversity are increasingly important characteristics of the medical professional workforce. Every year, substantial numbers of international medical graduates (IMGs) seek jobs outside the countries in which they were educated. This article concerns IMGs who enter the Netherlands as refugees or as spouses of Dutch citizens. As their non-European medical qualifications are not considered equivalent to the Dutch qualifications, they are required to undertake additional medical training. Because little is known about their professional careers, we set out to identify the barriers that confront and the facilitating factors that support IMGs before, during and after their supplementary medical training., Methods: We invited 58 IMGs who had successfully completed their additional medical training requirements in Maastricht, the Netherlands (1996-2007) to participate in in-depth interviews. They were identified by the university's Institute of Medical Education and from its alumni database., Results: Thirty-two IMGs participated and reported a range of issues affecting their attempts to practise medicine in the Netherlands. Reported barriers included difficulties in accessing information on complementary medical education and lack of (financial) support. Perseverance was reported to be essential. Financial and social support were also reported as facilitating factors. Lack of command of the Dutch language and age were seen as barriers to securing employment and entrance to specialisation., Conclusions: The barriers identified have major implications for IMGs wishing to practise medicine in the Netherlands. Better support to overcome the difficulties inherent in migration and career change will result in better trained and acculturated doctors who will be more motivated to contribute to society.

Objectives: This study was performed in order to gather insight into the well-being of Dutch medical residents., Methods: In 2005, all Dutch residents registered through the Medical Registration Committee (n = 5245) were sent a self-report questionnaire to assess socio-demographic and work-related characteristics, burnout and engagement., Results: Of the 5140 eligible residents, 2115 completed the questionnaire (41%). Of those, 21% fulfilled the criteria for moderate to severe burnout and 27% were highly engaged with their work. Women reported more emotional exhaustion and less depersonalisation than men; age was weakly but significantly related to depersonalisation, and married residents and parents reported less depersonalisation than their single or childless counterparts. More men than women were found to be highly engaged and men specifically reported more vigour. Number of years in training was weakly but significantly related to absorption. With regard to occupational risk factors, significant between-group differences were found for the effects of clinical setting on emotional exhaustion, engagement, vigour and absorption. Residents in training in a mental health clinic were most emotionally exhausted and those in a rehabilitation centre were least engaged. General surgery represented the specialty with the lowest number of residents suffering from burnout, followed by obstetrics and gynaecology and any supportive specialty. General surgery residents were also found to be more highly engaged, vigorous, dedicated and absorbed than others., Conclusions: As more than a fifth of the medical residents who responded could be diagnosed as suffering from burnout, we conclude that this problem needs addressing in the Dutch health care system, especially given that a relationship was proven between burnout and suboptimal patient care. We must look for solutions and interventions which will improve the work situation of medical residents. Striving for healthy workers in health care has to become daily practice.

Objectives: Recently, many medical schools' curricula have been revised so that they represent vertically integrated (VI) curricula. Important changes include: the provision of earlier clinical experience; longer clerkships, and the fostering of increasing levels of responsibility. One of the aims of vertical integration is to facilitate the transition to postgraduate training. The purpose of the present study is to determine whether a VI curriculum at medical school affects the transition to postgraduate training in a positive way., Methods: We carried out a questionnaire study among graduates of six medical schools in the Netherlands, who had followed either a VI or a non-VI curriculum. Items in the questionnaire focused on preparedness for work and postgraduate training, the time and number of applications required to be admitted to residency, and the process of making career choices., Results: In comparison with those who have followed non-VI programmes, graduates of VI curricula appear to make definitive career choices earlier, need less time and fewer applications to obtain residency positions and feel more prepared for work and postgraduate training., Conclusions: The curriculum at medical school affects the transition to postgraduate training. Additional research is required to determine which components of the curriculum cause this effect and to specify under which conditions this effect occurs.

Context: Mentors are increasingly involved in doctor performance assessments. Mentoring seems to be a key determinant in achieving the ultimate goal of those assessments, namely, improving doctor performance. Little is known, however, about how mentors perceive and fulfil this role., Objective: The aim of this paper is to expand understanding of the role of mentors in performance assessment., Methods: Thirty-eight mentors undertook formative performance assessments of their peers in a pilot study. A mixed-methods design was used, consisting of a postal survey (n = 28) and qualitative interviews with a subset of mentors (n = 11). Individual semi-structured interviews were completed and transcripts were analysed by two researchers using a grounded theory approach., Results: The results of the survey showed that 89% of mentors intended to continue in their mentorship role. Interviews revealed that mentors used several strategies in the assessments, including: contrasting and collating information; posing reflective questions, and goal setting. Mentors experienced difficulty in disregarding their views of the doctors evaluated. Some mentors noticed obstacles with specific interview skills such as 'paying attention to their colleagues' strengths' and 'enabling doctors to find their own solutions'. Mentors reported that they and their organisations benefited from the assessments. The perceived benefits included: improved interview skills; increased solidarity, and increased mutual respect., Conclusions: The study provides insights into what mentors can do to increase the chance that externally derived information is integrated into doctors' self-assessments. Mainly, mentors used strategies aimed at effectively delivering feedback and encouraging reflection. However, we found that mentors who took part in our study appeared to struggle with a number of obstacles related to: time investment; familiarity with the doctor assessed, and the acquiring of specific interview skills.

Context: This study aimed to assess if an additional patient feedback training programme leads to better consultation skills in general practice trainees (GPTs) than regular communication skills training, and whether process measurements (intensity of participation in the programme) predict the effect of the intervention., Methods: We carried out a controlled trial in which two sub-cohorts of GPTs were allocated to an intervention group (n = 23) or a control group (n = 30), respectively. In 2006, allocated first-year GPTs in the VU University Medical Centre attended a patient feedback training programme in addition to the regular communication skills training. The control group attended only regular communication skills training. Trainees were assessed by simulated patients who visited the practices and videotaped the consultations at baseline and after 3 months. The videotapes were randomly assigned to eight trained staff members. The MAAS-Global Instrument (range 0-6) was used to assess (a change in) trainee consultation skills., Results: were analysed using a multi-level, linear mixed-model analysis. Results Data on 50 GPTs were available for the follow-up analysis. Both intervention group and control group GPTs improved their consultation skills: mean MAAS-Global scores for all participants were 3.29 (standard deviation [SD] 0.75) at baseline and 3.54 (SD 0.66) at follow-up (P = 0.047). The improvement in MAAS-Global scores in the intervention group did not differ significantly from the improvement in the control group. The analysis showed a trend for intensity of participation in the patient feedback programme to predict greater improvement in MAAS-Global scores., Discussion: Although the baseline scores were already in the high range, consultation skills in both groups improved significantly. This is reassuring for current teaching methods. The patient feedback programme did not improve consultation skills more than regular communication skills training. However, a subgroup of GPTs who participated intensively in the programme did improve their consultation skills further in comparison with the less motivated subgroup.

Context: At present, competency-based, outcome-focused training is gradually replacing more traditional master-apprentice teaching in postgraduate training. This change requires a different approach to the assessment of clinical competence, especially given the decisions that must be made about the level of independence allowed to trainees., Methods: This study was set within postgraduate obstetrics and gynaecology training in the Netherlands. We carried out seven focus group discussions, four with postgraduate trainees from four training programmes and three with supervisors from three training programmes. During these discussions, we explored current opinions of supervisors and trainees about how to determine when a trainee is competent to perform a clinical procedure and the role of formal assessment in this process., Results: When the focus group recordings were transcribed, coded and discussed, two higher-order themes emerged: factors that determine the level of competence of a trainee in a clinical procedure, and factors that determine the level of independence granted to a trainee or acceptable to a trainee., Conclusions: From our study, it is evident that both determining the level of competence of a trainee for a certain professional activity and making decisions about the degree of independence entrusted to a trainee are complex, multi-factorial processes, which are not always transparent. Furthermore, competence achieved in a certain clinical procedure does not automatically translate into more independent practice. We discuss the implications of our findings for the assessment of clinical competence and provide suggestions for a transparent assessment structure with explicit attention to progressive independence.

Objectives: Delivery of 360-degree feedback is widely used in revalidation programmes. However, little has been done to systematically identify the variables that influence whether or not performance improvement is actually achieved after such assessments. This study aims to explore which factors represent incentives, or disincentives, for consultants to implement suggestions for improvement from 360-degree feedback., Methods: In 2007, 109 consultants in the Netherlands were assessed using 360-degree feedback and portfolio learning. We carried out a qualitative study using semi-structured interviews with 23 of these consultants, purposively sampled based on gender, hospital, work experience, specialty and views expressed in a previous questionnaire. A grounded theory approach was used to analyse the transcribed tape-recordings., Results: We identified four groups of factors that can influence consultants' practice improvement after 360-degree feedback: (i) contextual factors related to workload, lack of openness and social support, lack of commitment from hospital management, free-market principles and public distrust; (ii) factors related to feedback; (iii) characteristics of the assessment system, such as facilitators and a portfolio to encourage reflection, concrete improvement goals and annual follow-up interviews, and (iv) individual factors, such as self-efficacy and motivation., Conclusions: It appears that 360-degree feedback can be a positive force for practice improvement provided certain conditions are met, such as that skilled facilitators are available to encourage reflection, concrete goals are set and follow-up interviews are carried out. This study underscores the fact that hospitals and consultant groups should be aware of the existing lack of openness and absence of constructive feedback. Consultants indicated that sharing personal reflections with colleagues could improve the quality of collegial relationships and heighten the chance of real performance improvement.

Context: Students' perceptions of their learning environment are of great importance to their learning process. In this study we assessed the time allocated by students to clerkship activities and the relationship between students' allocations of time and their perceptions of the quality of their clinical learning environment., Methods: Participants were 133 undergraduate students from eight hospitals taking part in four clerkship rotations. All students recorded the time they spent on eight clerkship activities over 2 weeks and completed the Postgraduate Hospital Educational Environment Measure (PHEEM). Partial correlation analyses were undertaken to examine the relationship between the amount of time students spent on each activity and their PHEEM scores., Results: Students spent nearly 8 hours a day on clerkship activities. Most time was spent on observing doctors (40%), followed by participating in consultations without direct supervision (12%). The time students spent on observing doctors (r = 0.206, P < 0.05) and in consultations without direct supervision (r = 0.211, P < 0.05) was significantly related to the students' PHEEM scores. There was a significant relationship at the P < 0.10 level between the time spent on directly supervised activities and students' PHEEM scores (r = 0.165, P < 0.10)., Conclusions: The results suggest that the time spent on activities involving direct patient contact is positively related to students' perceptions of the quality of their learning environment. None of the activities were significantly negatively related to the students' perceptions of their clinical learning environment. Future research should examine the optimal time allocations required to enhance the perceived quality of the clinical learning environment.

Objectives: This study set out to examine how much time students and teachers devote to different learning-oriented interactions during seminar sessions and students' and teachers' perceptions about the occurrence and desirability of these interactions., Methods: Students and teachers participating in eight seminar group sessions in Year 4 of an undergraduate veterinary curriculum completed an 11-item questionnaire which asked them to rate, on a 5-point Likert scale, the frequency of occurrence and level of desirability of three learning-oriented types of interaction: exploratory questioning; cumulative reasoning, and handling of conflict about knowledge. The questionnaire also invited positive and negative responses to aspects of group interactions and an overall mark (1-10) for the seminars and group interactions. Four group sessions were video-recorded and analysed using a coding scheme. The amount of time devoted to the different interactions was calculated., Results: Both students and teachers gave scores of 3.0-3.5 for frequency of occurrence of exploratory questioning and cumulative reasoning and < 3.0 for occurrence of handling of conflict about knowledge. The desired occurrences of all interaction types were significantly higher than the actual occurrences according to students and teachers. Teachers were responsible for the majority of the interactions (93%). The percentages of session time devoted to teacher-centred cumulative reasoning, exploratory questioning and handling of conflict about knowledge were 65.8%, 15.6% and 3.1%, respectively., Conclusions: Group interactions in seminar groups are dominated by the posing of questions by teachers to students. The moderate occurrence of group interactions as perceived by students and teachers may be explained by the inadequate preparation of teachers and students to stimulate group interactions.

Objectives: We aimed to study the effects of active-learning curricula on graduation rates of students and on the length of time needed to graduate., Methods: Graduation rates for 10 generations of students enrolling in the eight Dutch medical schools between 1989 and 1998 were analysed. In addition, time needed to graduate was recorded. Three of the eight schools had curricula emphasising active learning, small-group instruction and limited numbers of lectures; the other five had conventional curricula to varying degrees., Results: Overall, the active-learning curricula graduated on average 8% more students per year, and these students graduated on average 5 months earlier than their colleagues from conventional curricula., Conclusions: Four hypotheses potentially explaining the effect of active learning on graduation rate and study duration were considered: (i) active-learning curricula promote the social and academic integration of students; (ii) active-learning curricula attract brighter students; (iii) active-learning curricula retain more poor students, and (iv) the active engagement of students with their study required by active-learning curricula induces better academic performance and, hence, lower dropout rates. The first three hypotheses had to be rejected. It was concluded that the better-learning hypothesis provides the most parsimonious account for the data.

Objectives: The lack of published studies into effective skills teaching in clinical skills centres inspired this study of student views of the teaching behaviours of skills teachers., Methods: We organised focus group discussions with students from Years 1-3 of a 6-year undergraduate medical curriculum. A total of 30 randomly selected students, divided into three groups, took part in two sessions. They discussed what teaching skills helped them to acquire physical examination skills., Results: Students' opinions related to didactic skills, interpersonal and communication skills and preconditions. Students appreciated didactic skills that stimulate deep and active learning. Another significant set of findings referred to teachers' attitudes towards students. Students wanted teachers to be considerate and to take them seriously. This was reflected in student descriptions of positive behaviours, such as: 'responding to students' questions'; 'not exposing students' weaknesses in front of the group', and '[not] putting students in an embarrassing position in skill demonstrations'. They also appreciated enthusiasm in teachers. Important preconditions included: the integration of skills training with basic science teaching; linking of skills training to clinical practice; the presence of clear goals and well-structured sessions; good time management; consistency of teaching, and the appropriate personal appearance of teachers and students., Conclusions: The teaching skills and behaviours that most facilitate student acquisition of physical examination skills are interpersonal and communication skills, followed by a number of didactic interventions, embedded in several preconditions. Findings related to interpersonal and communication skills are comparable with findings pertaining to the teaching roles of tutors and clinical teachers; however, the didactic skills merit separate attention as teaching skills for use in skills laboratories. The results of this study should be complemented by a study performed in a larger population and a study exploring teachers' views.