Search

Gamification refers to using game attributes in a non-gaming context. Health professions educators increasingly turn to gamification to optimize students' learning outcomes. However, little is known about the concept of gamification and its possible working mechanisms. This review focused on empirical evidence for the effectiveness of gamification approaches and theoretical rationales for applying the chosen game attributes. We systematically searched multiple databases, and included all empirical studies evaluating the use of game attributes in health professions education. Of 5044 articles initially identified, 44 met the inclusion criteria. Negative outcomes for using gamification were not reported. Almost all studies included assessment attributes (n = 40), mostly in combination with conflict/challenge attributes (n = 27). Eight studies revealed that this specific combination had increased the use of the learning material, sometimes leading to improved learning outcomes. A relatively small number of studies was performed to explain mechanisms underlying the use of game attributes (n = 7). Our findings suggest that it is possible to improve learning outcomes in health professions education by using gamification, especially when employing game attributes that improve learning behaviours and attitudes towards learning. However, most studies lacked well-defined control groups and did not apply and/or report theory to understand underlying processes. Future research should clarify mechanisms underlying gamified educational interventions and explore theories that could explain the effects of these interventions on learning outcomes, using well-defined control groups, in a longitudinal way. In doing so, we can build on existing theories and gain a practical and comprehensive understanding of how to select the right game elements for the right educational context and the right type of student.

Background: A well-known problem with student surveys is a too low response rate. Experiences with predicting electoral outcomes, which required much smaller sample sizes, inspired us to adopt a similar approach to course evaluation. We expected that having respondents estimate the average opinions of their peers required fewer respondents for comparable outcomes than giving own opinions. Methods: Two course evaluation studies were performed among successive first-year medical students ( N = 380 and 450, respectively). Study 1: Half the cohort gave opinions on nine questions, while the other half predicted the average outcomes. A prize was offered for the three best predictions (motivational remedy). Study 2: Half the cohort gave opinions, a quarter made predictions without a prize and a quarter made predictions with previous year's results as prior knowledge (cognitive remedy). The numbers of respondents required for stable outcomes were determined following an iterative process. Differences between numbers of respondents required and between average scores were analysed with ANOVA. Results: In both studies, the prediction conditions required significantly fewer respondents ( p < 0.001) for comparable outcomes. The informed prediction condition required the fewest respondents ( N < 20). Conclusion: Problems with response rates can be reduced by asking respondents to predict evaluation outcomes rather than giving opinions. [ABSTRACT FROM AUTHOR]

Copyright of Tijdschrift voor Medisch Onderwijs is the property of Springer Nature and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.)

Introduction: In this study we aimed to identify behaviours representative of agentic engagement in pre-clinical medical education problem-based learning (PBL) groups. Agentic engagement is defined as the proactive, intentional contributions students make to their flow of instruction. This concept, developed in secondary education, appears relevant for benefitting optimally from PBL in higher medical education., Methods: We followed a four-step process to identify any behaviours representative of agentic engagement in our PBL setting. Following a literature search on agentic engagement scales, proactive behaviour, PBL practices and adult learning, we listed behaviours that could denote agentic engagement in our context. We fine-tuned this list through exploratory observations and tailored it to our specific context of second-year PBL groups., Results: We identified ten observable student behaviours representative of agentic engagement within medical PBL groups. Some aligned with previous literature (asking questions, telling the teacher what they (dis)like, telling the teacher what they are interested in, defending opinions, expressing expectations, suggesting co-operation), and others had not been identified before as representative of agentic engagement (making learning as interactive as possible, creating alternative ways of covering the material, correcting content and enriching others' insights); thereby introducing novel behaviours unique to our setting., Discussion: In medical PBL groups, we identified both known agentic engagement behaviours and distinctive behaviours specific to our context, thereby highlighting that the expression of agentic engagement is context-bound., Competing Interests: The authors have no competing interests to declare., (Copyright: © 2024 The Author(s).)

Background: Although medical courses are frequently evaluated via surveys with Likert scales ranging from " strongly agree " to " strongly disagree ," low response rates limit their utility. In undergraduate medical education, a new method with students predicting what their peers would say, required fewer respondents to obtain similar results. However, this prediction-based method lacks validation for continuing medical education (CME), which typically targets a more heterogeneous group than medical students., Methods: In this study, 597 participants of a large CME course were randomly assigned to either express personal opinions on a five-point Likert scale (opinion-based method; n = 300) or to predict the percentage of their peers choosing each Likert scale option (prediction-based method; n = 297). For each question, we calculated the minimum numbers of respondents needed for stable average results using an iterative algorithm. We compared mean scores and the distribution of scores between both methods., Results: The overall response rate was 47%. The prediction-based method required fewer respondents than the opinion-based method for similar average responses. Mean response scores were similar in both groups for most questions, but prediction-based outcomes resulted in fewer extreme responses (strongly agree/disagree)., Conclusions: We validated the prediction-based method in evaluating CME. We also provide practical considerations for applying this method., Competing Interests: The authors do not have competing interests., (© 2024 Chua, van Diepen, Trietsch, Dekker, Schönrock-Adema, Bustraan; licensee Synergies Partners.)

Introduction: To facilitate various transitions of medical residents, healthcare team members and departments may employ various organizational socialization strategies, including formal and informal onboarding methods. However, residents' preferences for these organizational socialization strategies to ease their transition can vary. This study identifies patterns (viewpoints) in these preferences., Methods: Using Q-methodology, we asked a purposeful sample of early-career residents to rank a set of statements into a quasi-normal distributed grid. Statements were based on previous qualitative interviews and organizational socialization theory. Participants responded to the question, 'What are your preferences regarding strategies other health care professionals, departments, or hospitals should use to optimize your next transition?' Participants then explained their sorting choices in a post-sort questionnaire. We identified different viewpoints based on by-person (inverted) factor analysis and Varimax rotation. We interpreted the viewpoints using distinguishing and consensus statements, enriched by residents' comments., Results: Fifty-one residents ranked 42 statements, among whom 36 residents displayed four distinct viewpoints: Dependent residents (n = 10) favored a task-oriented approach, clear guidance, and formal colleague relationships; Social Capitalizing residents (n = 9) preferred structure in the onboarding period and informal workplace social interactions; Autonomous residents (n = 12) prioritized a loosely structured onboarding period, independence, responsibility, and informal social interactions; and Development-oriented residents (n = 5) desired a balanced onboarding period that allowed independence, exploration, and development., Discussion: This identification of four viewpoints highlights the inadequacy of one-size-fits-all approaches to resident transition. Healthcare professionals and departments should tailor their socialization strategies to residents' preferences for support, structure, and formal/informal social interaction., Competing Interests: The authors have no competing interests to declare., (Copyright: © 2024 The Author(s).)

The aim of this study was to develop and evaluate an instrument to assess international students' perceptions of the international learning environment called 'Measure of the International Learning Environment Status' (MILES). We based the development of the MILES on a solid theoretical framework from Moos by addressing three domains to measure the quality of the international learning environment, namely goal direction, relationships, and system change and system maintenance. We have designed and constructed the instrument in three steps. Firstly, we have collected items from relevant existing instruments and grouped them into the three domains via content analysis. Secondly, we applied a Delphi procedure involving international higher education experts from different stakeholder groups and from different cultural backgrounds to identify and reach consensus on the items comprehensively covering important elements of the international learning environment. Thirdly, we carried out an initial questionnaire evaluation. The final MILES consisted of 47 items with 13 in the first domain, 17 in the second and 17 in the third domain. The content of the domains was clearly in line with Moos theoretical framework and we interpreted the sets of items as goal direction, relationships, and supporting services, respectively. This study provides a comprehensive and systematically developed instrument for future research to better understand international students' perspectives towards the international learning environment that are supported by stakeholders from a range of cultures., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2023 Xu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Introduction: The social distancing restrictions due to the COVID-19 pandemic have changed students' learning environment and limited their social interactions. Therefore, the objective of this study was to investigate the influence of the social distancing restrictions on students' social networks, wellbeing, and academic performance., Methods: We performed a questionnaire study in which 102 students participated before and 167 students during the pandemic. They completed an online questionnaire about how they formed their five peer social networks (study-related support, collaboration, friendship, share information, and learn-from) out-of-class. We performed social network analysis to compare the sizes, structures, and compositions of students' five social networks before and during the pandemic, between first- and second-year students, and between international and domestic students. Additionally, we performed Kruskal-Wallis H test to compare students' academic performance before and during the pandemic. We performed thematic analysis to answers for two open-end questions in the online questionnaire to explore what difficulties students encountered during the COVID-19 pandemic and what support they needed., Results: The results showed that the size of students' social networks during the pandemic was significantly smaller than before the pandemic. Besides, the formation of social networks differed between first- and second-year students, and between domestic and international students. However, academic performance did not decline during the COVID-19 pandemic. Furthermore, we identified three key areas in which students experienced difficulties and needed support by thematic analysis: social connections and interactions, learning and studying, and physical and mental wellbeing., Conclusion: When institutions implement learning with social distancing, such as online learning, they need to consider changes in students' social networks and provide appropriate support., Competing Interests: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest., (Copyright © 2023 Zhou, Xu, Schönrock-Adema, Brouwer, Bos and Diemers.)

Background: Given the positive outcomes of patient-centred care on health outcomes, future doctors should learn how to deliver patient-centred care. The literature describes a wide variety of educational interventions with standardized patients (SPs) that focus on learning patient-centredness. However, it is unclear which mechanisms are responsible for learning patient-centredness when applying educational interventions with SPs., Objective: This study aims to clarify how healthcare learners and professionals learn patient-centredness through interventions involving SPs in different healthcare educational contexts., Methods: A realist approach was used to focus on what works, for whom, in what circumstances, in what respect and why. Databases were searched through 2019. Nineteen papers were included for analysis. Through inductive and deductive coding, CIC'MO configurations were identified to build partial program theories. These CIC'MOs describe how Interventions with SPs change the Context (C→C') such that Mechanisms (M) are triggered that are expected to foster patient-centredness as Outcome., Results: Interventions with SPs create three contexts which are 'a safe learning environment,' 'reflective practice,' and 'enabling people to learn together.' These contexts trigger the following seven mechanisms: feeling confident, feeling a sense of comfort, feeling safe, self-reflection, awareness, comparing & contrasting perspectives, combining and broadening perspectives. A tentative final program theory with mechanisms belonging to three main learning components (cognitive, regulative metacognitive and affective) is proposed: Interventions with SPs create a safe learning environment (C') in which learners gain feelings of confidence, comfort and safety (affective M). This safe learning environment enables two other mutual related contexts in which learners learn together (C'), through comparing & contrasting, combining and broadening their perspectives (cognitive M) and in which reflective practice (C') facilitates self-reflection and awareness (metacognitive M) in order to learn patient-centeredness., Conclusion: These insights offer educators ways to deliberately use interventions with SPs that trigger the described mechanisms for learning patient-centredness.

Objective: Repeated practice, or spacing, can improve various types of skill acquisition. Similarly, virtual reality (VR) simulators have demonstrated their effectiveness in fostering surgical skill acquisition and provide a promising, realistic environment for spaced training. To explore how spacing impacts VR simulator-based acquisition of surgical psychomotor skills, we performed a systematic literature review., Methods: We systematically searched the databases PubMed, PsycINFO, Psychology and Behavioral Sciences Collection, ERIC and CINAHL for studies investigating the influence of spacing on the effectiveness of VR simulator training focused on psychomotor skill acquisition in healthcare professionals. We assessed the quality of all included studies using the Medical Education Research Study Quality Instrument (MERSQI) and the risk of bias using the Cochrane Collaboration's risk of bias assessment tool. We extracted and aggregated qualitative data regarding spacing interval, psychomotor task performance and several other performance metrics., Results: The searches yielded 1662 unique publications. After screening the titles and abstracts, 53 publications were retained for full text screening and 7 met the inclusion criteria. Spaced training resulted in better performance scores and faster skill acquisition when compared to control groups with a single day (massed) training session. Spacing across consecutive days seemed more effective than shorter or longer spacing intervals. However, the included studies were too heterogeneous in terms of spacing interval, obtained performance metrics and psychomotor skills analysed to allow for a meta-analysis to substantiate our outcomes., Conclusion: Spacing in VR simulator-based surgical training improved skill acquisition when compared to massed training. The overall number and quality of available studies were only moderate, limiting the validity and generalizability of our findings., (© 2023. The Author(s).)

Objective: Because both clerks and medical faculty quality management workers expressed the need for it, we aimed to develop a compact, valid and uniform instrument to assess the quality of Dutch clinical clerkships across all medical faculties in the Netherlands., Method: We divided all 249 items from existing published and unpublished clerkship quality instruments into the three essential learning environment domains: content, atmosphere and organisation. In a 3-stage Delphi procedure, the 45 most relevant items from this list were selected that comprehensively covered the three domains. All clinical clerks in the country's northeastern educational region were invited to evaluate their last clerkship using this draft instrument. We used half of these data for item reduction and the other half to validate the final instrument, the QUality Instrument for ClerKships (QUICK)., Results: After the Delphi procedure and further item reduction, the QUICK comprises 15 items, 5 in each domain. The internal consistency of the QUICK and each of the three domains was satisfactory (Cronbach's α 0.88, 0.73, 0.84 and 0.67, respectively). The variance of the draft instrument domain scores were explained for >80% by item variance of the final QUICK. A panel of educational experts and medical faculty quality management workers evaluated QUICK's face validity as good., Conclusion: The QUICK is a concise and valid instrument to assess the quality of Dutch clinical clerkships. Its repeated use in a quality cycle can contribute to monitoring and ongoing development of the quality of this key phase in the medical education curriculum.

Background: Cultural differences might challenge the acceptance of the implementation of assessment formats that are developed in other countries. Acceptance of assessment formats is essential for its effectiveness; therefore, we explored the views of students and specialists on the practicality and impact on learning of these formats. This study was conducted to explore Indonesian students' and specialists' appreciation of the implementation of the Mini-Clinical Evaluation Exercise (Mini-CEX) in Indonesian clerkships., Methods: This study was conducted at the Universitas Gadjah Mada, Indonesia. Participants were 52 students and 21 specialists in neurology and 78 students and 50 specialists in internal medicine. They were asked to complete a 19-item questionnaire that covered the characteristics of the mini-CEX such as its practicality, and the impact on learning and professional development. We used a Mann-Whitney U test to analyse the data., Results: In total, 124 students (46 from neurology and 78 from internal medicine) and 38 specialists (13 from neurology and 25 from internal medicine) participated in this study. Students and specialists were positive about the practicality of the mini-CEX and the impact of this assessment format on learning and on professional development. The Mann-Whitney U test showed that there were no significant differences between students' and specialists' opinions on the mini-CEX, except for 2 items: specialists' appreciation of direct observation (mean rank = 93.16) was statistically significantly higher than students' appreciation of it (mean rank = 77.93; z = 2.065; p < 0.05), but students' appreciation of the item that students' past mini-CEX results affected their recent mini-CEX outcomes (mean rank = 85.29) was significantly higher than specialists' appreciation of it (mean rank = 69.12; z = 2140; p < 0.05)., Conclusion: Students and specialists were positive about the mini-CEX in Indonesian clerkships, although it was developed and validated in another culture. We found only small differences between their appreciations, which could be explained by the patterns of specialist-student interaction in Indonesian culture as large power distance and low individualism country.

Background: Patient-centred work is an essential part of contemporary medicine. Literature shows that educational interventions contribute to developing patient-centredness, but there is a lack of insight into the associated learning processes. Objective: Through reviewing articles about educational interventions involving patients, we aspire to develop a program theory that describes the processes through which the educational interventions are expected to result in change. The processes will clarify contextual elements (called contexts) and mechanisms connected to learning patient-centredness. Methods: In our realist review, an initial, rough program theory was generated during the scoping phase, we searched for relevant articles in PubMed, PsycINFO, ERIC, CINAHL and Embase for all years before and through 2016. We included observational studies, case reports, interviews, and experimental studies in which the participants were students, residents, doctors, nurses or dentists. The relevance and rigour of the studies were taken into account during analysis. With deductive as well as inductive coding, we extended the rough program theory. Results: In our review, we classified five different contexts which affect how upcoming professionals learn patient-centredness. These aspects are influenced through components in the intervention(s) related to the learner , the teacher, a nd the patient. We placed the mechanisms together in four clusters - comparing and combining as well as broadening perspectives, developing narratives and engagement with patients, self-actualisation, and socialisation - to show how the development of (dimensions of) patient-centredness occurs. Three partial-program-theories (that together constituting a whole program theory) were developed, which show how different components of interventions within certain contexts will evoke mechanisms that contribute to patient-centredness. Translation into daily practice: These theories may help us better understand how the roles of patients, learners and teachers interact with contexts such as the kind of knowledge that is considered legitimate or insight in the whole illness trajectory. Our partial program theories open up potential areas for future research and interventions that may benefit learners, teachers, and patients.

Background: Even in anonymous evaluations of a postgraduate medical education (PGME) program, residents may be reluctant to provide an honest evaluation of their PGME program, because they fear embarrassment or repercussions from their supervisors if their anonymity as a respondent is endangered. This study was set up to test the hypothesis that current residents in a PGME program provide more positive evaluations of their PGME program than residents having completed it. We therefore compared PGME learning environment evaluations of current residents in the program to leaving residents having completed it., Methods: This observational study used data gathered routinely in the quality cycle of PGME programs at two Dutch teaching hospitals to test our hypothesis. At both hospitals, all current PGME residents are requested to complete the Scan of Postgraduate Education Environment Domains (SPEED) annually. Residents leaving the hospital after completion of the PGME program are also asked to complete the SPEED after an exit interview with the hospital's independent residency coordinator. All SPEED evaluations are collected and analysed anonymously. We compared the residents' grades (on a continuous scale ranging from 0 (poor) to 10 (excellent)) on the three SPEED domains (content, atmosphere, and organization of the program) and their mean (overall department grade) between current and leaving residents., Results: Mean (SD) overall SPEED department grades were 8.00 (0.52) for 287 current residents in 39 PGME programs and 8.07 (0.48) for 170 leaving residents in 39 programs. Neither the overall SPEED department grades (t test, p = 0.53, 95% CI for difference - 0.16 to 0.31) nor the department SPEED domain grades (MANOVA, F(3, 62) = 0.79, p = 0.51) were significantly different between current and leaving residents., Conclusions: Residents leaving the program did not provide more critical evaluations of their PGME learning environment than current residents in the program. This suggests that current residents' evaluations of their postgraduate learning environment were not affected by social desirability bias or fear of repercussions from faculty.

Objective: To investigate how quality control of clinical placements in the Netherlands is organised, which tools are available for this purpose, and what Dutch clinical placement students think about current clinical placement assessment., Design: Document analysis, literature search and questionnaire., Method: In 2017, we asked all 8 medical schools to share their procedures and tools for assessing clinical placement quality with us. We searched various databases to find all published tools developed to measure clinical placement quality. In the same year, we also conducted a survey of 15 clinical placement students per school with questions about current and desired clinical placement assessment., Results: All 8 schools sent detailed information about clinical placement quality assessment contents and procedures. All schools indicated that they are cyclically measuring each clinical placement's quality using evaluations by the clinical placement students. Each school uses its own questionnaire, none of these questionnaires have been validated. Literature search only found two tools specifically developed for assessing clinical placement quality, none of which have been validated for the Dutch language and situation. Clinical placement students feel that not enough noticeable improvement actions are being taken as a result of their evaluations. They preferred a short, uniform questionnaire with questions about clinical placement content, atmosphere and organisation., Conclusion: The quality cycle of clinical placements in the Netherlands could be improved with respect to uniformity and implementation of actions for improvement. There is a need for standardisation of the clinical placement quality cycle and for development of a validated Dutch measuring tool for this.

Background: Feedback is essential for workplace learning. Most papers in this field concern individual feedback. In collectivistic cultures, however, group feedback is common educational practice. This study was conducted to investigate the perceived learning value and characteristics of individual and group feedback in a collectivistic culture., Methods: During two weeks, on a daily basis, clerkship students (n = 215) from 12 clinical departments at Faculty of Medicine, Universitas Gadjah Mada, Yogyakarta, Indonesia, recorded individual and group feedback moments by using a structured form: the providers, focus and perceived learning value of feedback. Data were analysed with logistic regression and multilevel techniques., Results: Students reported 2687 group and 1535 individual feedback moments. Group feedback more often focused on history taking, clinical judgment, patient management, patient counselling, and professional behaviour (OR ranging from 1.232, p < .01, to 2.152, p < .001), but less often on physical examination (OR = .836, p < .01). Group feedback less often aimed at correcting performance deficiencies (OR = .523, p < .001) and more often at comparing performance to the standard (OR = 2.447, p < .001) and planning action to improve performance (OR = 1.759, p < .001). Group feedback was perceived as more valuable than individual feedback (M = 4.08 and 3.96, respectively, β group  = .065, SE = .026, p < .01)., Conclusion: In collectivistic cultures, group feedback may add to the array of educational measures that optimize student learning. Congruence between culture and type of feedback may be important for the effectiveness of feedback.

Background: Job satisfaction is essential for physicians' well-being and patient care. The work ethic of long days and hard work that has been advocated for decades is acknowledged as a threat for physicians' job satisfaction, well-being, and patient safety. Our aim was to determine the actual and preferred job size of physicians and to investigate how these and the differences between them influence physicians' job satisfaction., Method: Data were retrieved from a larger, longitudinal study among physicians starting medical training at Groningen University in 1982/83/92/93 (N = 597). Data from 506 participants (85%) were available for this study. We used regression analysis to investigate the influence of job size on physicians' job satisfaction (13 aspects) and ANOVA to examine differences in job satisfaction between physicians wishing to retain, reduce or increase job size., Results: The majority of the respondents (57%) had an actual job size less than 1.0 FTE. More than 80% of all respondents preferred not to work full-time in the future. Respondents' average actual and preferred job sizes were .85 FTE and .81 FTE, respectively. On average, respondents who wished to work less (35% of respondents) preferred a job size reduction of 0.18 FTE and those who wished to work more (12%) preferred an increase in job size of 0.16 FTE. Job size influenced satisfaction with balance work-private hours most (β = -.351). Physicians who preferred larger job sizes were - compared to the other groups of physicians - least satisfied with professional accomplishments., Conclusions: A considerable group of physicians reported a gap between actual and preferred job size. Realizing physicians' preferences as to job size will hardly affect total workforce, but may greatly benefit individual physicians as well as their patients and society. Therefore, it seems time for a shift in work ethic.

Background: Various feedback characteristics have been suggested to positively influence student learning. It is not clear how these feedback characteristics contribute to students' perceived learning value of feedback in cultures classified low on the cultural dimension of individualism and high on power distance. This study was conducted to validate the influence of five feedback characteristics on students' perceived learning value of feedback in an Indonesian clerkship context., Methods: We asked clerks in Neurology (n = 169) and Internal Medicine (n = 132) to assess on a 5-point Likert scale the learning value of the feedback they received. We asked them to record whether the feedback provider (1) informed the student what went well, (2) mentioned which aspects of performance needed improvement, (3) compared the student's performance to a standard, (4) further explained or demonstrated the correct performance, and (5) prepared an action plan with the student to improve performance. Data were analyzed using multilevel regression., Results: A total of 250 students participated in this study, 131 from Internal Medicine (response rate 99%) and 119 from Neurology (response rate 70%). Of these participants, 225 respondents (44% males, 56% females) completed the form and reported 889 feedback moments. Students perceived feedback as more valuable when the feedback provider mentioned their weaknesses (β = 0.153, p < 0.01), compared their performance to a standard (β = 0.159, p < 0.01), explained or demonstrated the correct performance (β = 0.324, p < 0.001) and prepared an action plan with the student (β =0.496, p < 0.001). Appraisal of good performance did not influence the perceived learning value of feedback. No gender differences were found for perceived learning value., Conclusions: In Indonesia, we could validate four out of the five characteristics for effective feedback. We argue that our findings relate to culture, in particular to the levels of individualism and power distance. The recognized characteristics of what constitutes effective feedback should be validated across cultures.

- Assessing the quality of the medical learning environment is an important part of the quality cycle of postgraduate medical education programmes.- The quality of the medical learning environment is primarily assessed by systematically documenting the experiences of doctors-in-training (residents).- For this purpose, several questionnaires have been developed, two of which have been specifically developed for use in the Dutch clinical learning environment.- D-RECT is a commonly-used, 50-item questionnaire (11 subscales), developed from qualitative research on the optimal learning environment for ObGyn residents.- SPEED ('Training Thermometer') is a recently developed 15-item, 3-domain (i.e., content, atmosphere and organisation of training) instrument, based on a generic theoretical framework of human interaction.- Both D-RECT and SPEED are validated instruments to be used to reliably assess the clinical learning environment for Dutch residents in postgraduate medical education programmes.

Background: Research from outside the medical field shows that leadership behaviours influence job satisfaction. Whether the same is true for the medical training setting needs to be explored. The aim of this study was to investigate the influence of residents' overall appreciation of their supervisor's leadership and observation of specific supervisor leadership behaviours on job satisfaction., Methods: We invited residents (N = 117) to rate how often they observed certain task and relation-oriented leadership behaviours in their supervisor and overall appreciation of their supervisor's leadership. Furthermore, they rated their satisfaction with 13 different aspects of their jobs on a 10-point scale. Using exploratory factor analysis we identified four factors covering different types of job satisfaction aspects: personal growth, autonomy, affective, and instrumental job satisfaction aspects. Influence of overall appreciation for supervisor leadership and observation of certain leadership behaviours on these job satisfaction factors were analysed using multiple regression analyses., Results: The affective aspects of job satisfaction were positively influenced by overall appreciation of leadership (B = 0.792, p = 0.017), observation of specific instructions (B = 0.972, p = 0.008) and two-way communication (B = 1.376, p = 0.008) and negatively by mutual decision-making (B = -1.285, p = 0.007). No effects were found for the other three factors of job satisfaction., Conclusions: We recommend that supervisors become more aware of whether and how their behaviours influence residents' job satisfaction. Especially providing specific instructions and using two-way communication seem important to help residents deal with their insecurities and to offer them support.

Background: Within the current health care system, leadership is considered important for physicians. leadership is mostly self-taught, through observing and practicing. Does the practice environment offer residents enough opportunities to observe the supervisor leadership behaviours they have to learn? In the current study we investigate which leadership behaviours residents observe throughout their training, which behaviours supervisors report to display and whether residents and supervisors have a need for more formal training., Methods: We performed two questionnaire studies. Study 1: Residents (n = 117) answered questions about the extent to which they observed four basic and observable Situational Leadership behaviours in their supervisors. Study 2: Supervisors (n = 201) answered questions about the extent to which they perceived to display these Situational Leadership behaviours in medical practice. We asked both groups of participants whether they experienced a need for formal leadership training., Results: One-third of the residents did not observe the four basic Situational Leadership behaviours. The same pattern was found among starting, intermediate and experienced residents. Moreover, not all supervisors showed these 4 leadership behaviours. Both supervisors and residents expressed a need for formal leadership training., Conclusion: Both findings together suggest that current practice does not offer residents enough opportunities to acquire these leadership behaviours by solely observing their supervisors. Moreover, residents and supervisors both express a need for more formal leadership training. More explicit attention should be paid to leadership development, for example by providing formal leadership training for supervisors and residents.

Introduction: Current instruments to evaluate the postgraduate medical educational environment lack theoretical frameworks and are relatively long, which may reduce response rates. We aimed to develop and validate a brief instrument that, based on a solid theoretical framework for educational environments, solicits resident feedback to screen the postgraduate medical educational environment quality., Methods: Stepwise, we developed a screening instrument, using existing instruments to assess educational environment quality and adopting a theoretical framework that defines three educational environment domains: content, atmosphere and organization. First, items from relevant existing instruments were collected and, after deleting duplicates and items not specifically addressing educational environment, grouped into the three domains. In a Delphi procedure, the item list was reduced to a set of items considered most important and comprehensively covering the three domains. These items were triangulated against the results of semi-structured interviews with 26 residents from three teaching hospitals to achieve face validity. This draft version of the Scan of Postgraduate Educational Environment Domains (SPEED) was administered to residents in a general and university hospital and further reduced and validated based on the data collected., Results: Two hundred twenty-three residents completed the 43-item draft SPEED. We used half of the dataset for item reduction, and the other half for validating the resulting SPEED (15 items, 5 per domain). Internal consistencies were high. Correlations between domain scores in the draft and brief versions of SPEED were high (>0.85) and highly significant (p<0.001). Domain score variance of the draft instrument was explained for ≥80% by the items representing the domains in the final SPEED., Conclusions: The SPEED comprehensively covers the three educational environment domains defined in the theoretical framework. Because of its validity and brevity, the SPEED is promising as useful and easily applicable tool to regularly screen educational environment quality in postgraduate medical education.

Background: The importance of medical education research in Saudi Arabia has been acknowledged increasingly and a lot of concepts used have been derived from the Western world. The question arises, however, whether Western concepts and questionnaires are transferable to societies with different cultures. The aim of this study was to investigate the instrument structure and the reliability of the Arabic version of the Zuckerman-Kuhlman Personality Questionnaire-medium (ZKPQ-m)., Methods: Three statistical methods with decreased amount of strictness were used to analyse our data: Confirmatory Factor Analysis, Procrustes rotation and Principal Component Analysis., Results: Our outcomes did not confirm the original instrument structure. Instead, we found four interpretable components: Emotional Instability, Impulse-seeking, Activeness and Self-Control. However, the amount of explained variance was not very high and the internal consistencies ranged from unsatisfactory to only moderate. The data showed a high percentage of respondents agreeing with more than three items of the Infrequency scale, which may be attributable to the collectivistic culture in Saudi Arabia., Conclusion: We did not succeed in replicating the ZKPQ structure in the Arabic context. Social desirability, a common characteristic in collectivistic cultures, may have reduced the replicability of the internal structure of the ZKPQ-m. Different methods to measure concepts in collectivistic cultures may help to get round social desirability.

In medical education, student distress is known to hamper learning and professional development. To address this problem, recent studies aimed at helping students cope with stressful situations. Undergraduate students in clinical practice frequently use experiences of surrounding peers to estimate their abilities to master such challenging situations. This use of the experiences of others, known as social comparison, may affect student distress both positively and negatively. To find characteristics of a beneficial use of social comparison, we examined differences in comparison behaviours between students expressing low and high levels of distress. The participants in our study, response rate 93% (N = 301/321), were all medical students in their first year in clinical practice. They completed the General Health Questionnaire (GHQ-12) to measure distress, and three separate questionnaires to measure: (1) orientation to comparison, (2) motive for comparison, and (3) interpretation of comparison. Differences were analysed using multivariate analysis of variance. Although all students were oriented towards social comparison, the analyses showed that this orientation was less apparent among low-distress students. Besides, the low-distress students were less inclined to use motives indicative for comparisons with peers perceived as performing worse and were less negative in the interpretations of their comparisons. As social comparison is frequently used among all students, we recommend to make them aware of their comparison behaviours and inform them about the pros and cons of the distinguished aspects of the comparison process.

In this longitudinal study, we investigated the relationship between physicians' prior achievements (before, during and after medical school) and job satisfaction, and tested the two lines of reasoning that prior achievements influence job satisfaction positively or negatively, respectively. The participants were graduates who started their medical training in 1982 (n = 147), 1983 (n = 154), 1992 (n = 143) and 1993 (n = 153). We operationalised job satisfaction as satisfaction (on a 10-point scale) with 13 cognitive, affective and instrumental aspects of the participants' jobs. The measures of achievement before, during and after medical school included pre-university grade point average, study progress and a residency position in the specialty of first choice, respectively. We included the effect of curriculum type (problem-based learning versus traditional), gender and years of experience as moderator variables. Higher achievers before and during medical school were more satisfied about their income (β = .152, p < .01 and β = .149, p < .05), but less satisfied with their opportunities for personal development (β = -.159, p < .05). High achievers after medical school were more satisfied with professional accomplishments (β = .095, p < .05), with appreciation from support personnel (β = .154, p < .01) and from patients (β = .120, p < .05). Effect sizes were small. Prior achievements influenced job satisfaction. The direction of the influences depended on the job satisfaction aspect in question, which indicates that it is important to distinguish between aspects of job satisfaction. To optimize job satisfaction of high achievers, it is important for graduates to obtain their preferred specialty. Furthermore, it is vital to provide them with enough opportunities for further development.

Unlabelled: Abstract Background: Medical schools all over the world try to adapt their programs to meet international standards. However, local culture might hamper innovation attempts., Aims: To describe challenges in implementing the mini-CEX in Indonesia and investigate its effect on students' clinical competence., Methods: The study was conducted in the Internal Medicine and Neurology departments of the Universitas Gadjah Mada, Indonesia. Implementing the mini-CEX into the existing curriculum, while taking the Indonesian culture into account, implied a shift from group to individual feedback. We compared students' final clinical competence before (Internal Medicine n = 122, Neurology n = 183) and after (n = 183 and 186, respectively) the implementation of the mini-CEX, using a modified Objective Structured Long Examination Record (OSLER). The Mann-Whitney test was used to analyze the data., Results: We took power distance and individualism into account to facilitate the implementation process. After implementing the mini-CEX, the OSLER results were significant higher in Internal Medicine (p < 0.05). However, no differences were found in Neurology., Conclusion: By managing the innovation process carefully and taking culture and local context into account, the mini-CEX can be implemented without changing the underlying concept. The shift from group to individual feedback seems to have a positive effect on student learning.

Teachers are important role models for the development of professional behaviour of young trainee doctors. Unfortunately, sometimes they show unprofessional behaviour. To address misconduct in teaching, it is important to determine where the thresholds lie when it comes to inappropriate behaviours in student-teacher encounters. We explored to what extent students and teachers perceive certain behaviours as misconduct or as sexual harassment. We designed-with a reference group-five written vignettes describing inappropriate behaviours in the student-teacher relationship. Clinical students (n = 1,195) and faculty of eight different hospitals (n = 1,497) were invited to rate to what extent they perceived each vignette as misconduct or sexual harassment. Data were analyzed using t tests and Pearson's correlations. In total 643 students (54 %) and 551 teachers (37 %) responded. All vignettes were consistently considered more as misconduct than as actual sexual harassment. At an individual level, respondents differed largely as to whether they perceived an incident as misconduct or sexual harassment. Comparison between groups showed that teachers' and students' perceptions on three vignettes differed significantly, although the direction differed. Male students were more lenient towards certain behaviours than female students. To conclude, perceptions of misconduct and sexual harassment are not univocal. We recommend making students and teachers aware that the boundaries of others may not be the same as their own.

Background: To optimize response rates, it is important to have brief, comprehensive instruments., Aims: We have developed and validated a short form of an instrument for measuring students' perceptions of teachers' competencies to encourage students' reflective learning in small groups (the STERLinG)., Methods: Based on statistical and content criteria, the original 36-item STERLinG was reduced to 15 items: three scales with five items each. This mini-STERLinG was validated. Confirmatory factor analysis was performed and internal consistencies were calculated., Results: The instrument was completed by 501 respondents (63%). The original instrument structure was confirmed with 62.6% explained variance. Reliabilities were high with 0.91 for the entire mini-STERLinG and 0.87, 0.85 and 0.81 for its subscales., Conclusions: The mini-STERLinG was found to be a feasible, valid and reliable instrument.

Background: Teacher feedback on student reflective writing is recommended to improve learners' reflective competence. To be able to improve teacher feedback on reflective writing, it is essential to gain insight into which characteristics of written feedback stimulate students' reflection processes. Therefore, we investigated (1) which characteristics can be distinguished in written feedback comments on reflective writing and (2) which of these characteristics are perceived to stimulate students' reflection processes., Methods: We investigated written feedback comments from forty-three teachers on their students' reflective essays. In Study 1, twenty-three medical educators grouped the comments into distinct categories. We used Multiple Correspondence Analysis to determine dimensions in the set of comments. In Study 2, another group of twenty-one medical educators individually judged whether the comments stimulated reflection by rating them on a five-point scale. We used t-tests to investigate whether comments classified as stimulating and not stimulating reflection differed in their scores on the dimensions., Results: Our results showed that characteristics of written feedback comments can be described in three dimensions: format of the feedback (phrased as statement versus question), focus of the feedback (related to the levels of students' reflections) and tone of the feedback (positive versus negative). Furthermore, comments phrased as a question and in a positive tone were judged as stimulating reflection more than comments at the opposite side of those dimensions (t = (14.5) = 6.48; p = < .001 and t = (15) = -1.80; p < .10 respectively). The effect sizes were large for format of the feedback comment (r = .86) and medium for tone of the feedback comment (r = .42)., Conclusions: This study suggests that written feedback comments on students' reflective essays should be formulated as a question, positive in tone and tailored to the individual student's reflective level in order to stimulate students to reflect on a slightly higher level. Further research is needed to examine whether incorporating these characteristics into teacher training helps to improve the quality of written feedback comments on reflective writing.

Objectives: Traditional student feedback questionnaires are imperfect course evaluation tools, largely because they generate low response rates and are susceptible to response bias. Preliminary research suggests that prediction-based methods of course evaluation - in which students estimate their peers' opinions rather than provide their own personal opinions - require significantly fewer respondents to achieve comparable results and are less subject to biasing influences. This international study seeks further support for the validity of these findings by investigating: (i) the performance of the prediction-based method, and (ii) its potential for bias., Methods: Participants (210 Year 1 undergraduate medical students at McGill University, Montreal, Quebec, Canada, and 371 Year 1 and 385 Year 3 undergraduate medical students at the University Medical Center Groningen [UMCG], University of Groningen, Groningen, the Netherlands) were randomly assigned to complete course evaluations using either the prediction-based or the traditional opinion-based method. The numbers of respondents required to achieve stable outcomes were determined using an iterative process. Differences between the methods regarding the number of respondents required were analysed using t-tests. Differences in evaluation outcomes between the methods and between groups of students stratified by four potentially biasing variables (gender, estimated general level of achievement, expected test result, satisfaction after examination completion) were analysed using multivariate analysis of variance (manova)., Results: Overall response rates in the three student cohorts ranged from 70% to 94%. The prediction-based method required significantly fewer respondents than the opinion-based method (averages of 26-28 and 67-79 respondents, respectively) across all samples (p < 0.001), whereas the outcomes achieved were fairly similar. Bias was found in four of 12 opinion-based condition comparisons (three sites, four variables), and in only one comparison in the prediction-based condition., Conclusions: Our study supports previous findings that prediction-based methods require significantly fewer respondents to achieve results comparable with those obtained through traditional course evaluation methods. Moreover, our findings support the hypothesis that prediction-based responses are less subject to bias than traditional opinion-based responses. These findings lend credence to prediction-based as an accurate and efficient method of course evaluation., (© Blackwell Publishing Ltd 2013.)

The educational environment has been increasingly acknowledged as vital for high-quality medical education. As a result, several instruments have been developed to measure medical educational environment quality. However, there appears to be no consensus about which concepts should be measured. The absence of a theoretical framework may explain this lack of consensus. Therefore, we aimed to (1) find a comprehensive theoretical framework defining the essential concepts, and (2) test its applicability. An initial review of the medical educational environment literature indicated that such frameworks are lacking. Therefore, we chose an alternative approach to lead us to relevant frameworks from outside the medical educational field; that is, we applied a snowballing technique to find educational environment instruments used to build the contents of the medical ones and investigated their theoretical underpinnings (Study 1). We found two frameworks, one of which was described as incomplete and one of which defines three domains as the key elements of human environments (personal development/goal direction, relationships, and system maintenance and system change) and has been validated in different contexts. To test its applicability, we investigated whether the items of nine medical educational environment instruments could be mapped unto the framework (Study 2). Of 374 items, 94% could: 256 (68%) pertained to a single domain, 94 (25%) to more than one domain. In our context, these domains were found to concern goal orientation, relationships and organization/regulation. We conclude that this framework is applicable and comprehensive, and recommend using it as theoretical underpinning for medical educational environment measures.

Students' perceptions of teaching quality are vital for quality assurance purposes. An increasingly used, department-independent instrument is the (Cleveland) clinical teaching effectiveness instrument (CTEI). Although the CTEI was developed carefully and its validity and reliability confirmed, we noted an opportunity for improvement given an intermingling in its rating scales: the labels of the answering scales refer to both frequency and quality of teaching behaviours. Our aim was to investigate whether frequency and quality scores on the CTEI items differed. A sample of 112 residents anonymously completed the CTEI with separate 5-point rating scales for frequency and quality. Differences between frequency and quality scores were analyzed using paired t tests. Quality was, on average, rated higher than frequency, with significant differences for ten out of 15 items. The mean scores differed significantly in favour of quality. As the effect size was large, the difference in mean scores was substantial. Since quality was generally rated higher than frequency, the authors recommend distinguishing frequency from quality. This distinction helps to obtain unambiguous outcomes, which may be conducive to providing concrete and accurate feedback, improving faculty development and making fair decisions concerning promotion, tenure or salary.

Context: teaching students in reflection calls for specific teacher competencies. We developed and validated a rating scale focusing on Student perceptions of their Teachers' competencies to Encourage Reflective Learning in small Groups (STERLinG)., Methods: we applied an iterative procedure to reduce an initial list of 241 items pertaining to teacher competencies to 47 items. Subsequently, we validated the instrument in two successive studies. In the first study, we invited 679 medical and speech and language therapy students to assess the teachers of their professional development groups with the STERLinG. Principal components analysis (PCA) with varimax rotation was used to investigate the internal structure of the instrument. In the second study, which involved 791 medical, dental, and speech and language therapy students, we performed a confirmatory factor analysis using the oblique multiple group (OMG) method to verify the original structure., Results: in Study 1, 463 students (68%) completed the STERLinG. The PCA yielded three components: Supporting self-insight; Creating a safe environment, and Encouraging self-regulation. The final 36-item instrument explained 44.3% of the variance and displayed high reliability with α-values of 0.95 for the scale, and 0.91, 0.86 and 0.86 for the respective subscales. In Study 2, 501 students (63%) completed the STERLinG. The OMG confirmed the original structure of the STERLinG and explained 53.0% of the total variance with high α-values of 0.96 for the scale, and 0.94, 0.90 and 0.90 for the respective subscales., Conclusions: the STERLinG is a practical and valid tool for gathering student perceptions of their teachers' competencies to facilitate reflective learning in small groups considering its stable structure, the correspondence of the STERLinG structure with educational theories and the coverage of important domains of reflection. In addition, our study may provide a theoretical framework for the practice of and research into reflective learning.