Search

Although other web-based approaches to assessment of professional behaviour have been studied, no publications studying the potential advantages of a web-based instrument versus a classic, paper-based method have been published to date. This study has two research goals: it focuses on the quantity and quality of comments provided by students and their peers (two researchers independently scoring comments as correct and incorrect in relation to five commonly used feedback rules (and resulting in an aggregated score of the five scores) on the one, and on the feasibility, acceptability and perceived usefulness of the two approaches on the other hand (using a survey). The amount of feedback was significantly higher in the web-based group than in the paper based group for all three categories (dealing with work, others and oneself). Regarding the quality of feedback, the aggregated score for each of the three categories was not significantly different between the two groups, neither for the interim, nor for the final assessment. Some, not statistically significant, but nevertheless noteworthy trends were nevertheless noted. Feedback in the web-based group was more often unrelated to observed behaviour for several categories for both the interim and final assessment. Furthermore, most comments relating to the category 'Dealing with oneself' consisted of descriptions of a student's attendance, thereby neglecting other aspects of personal functioning. The survey identified significant differences between the groups for all questionnaire items regarding feasibility, acceptability and perceived usefulness in favour of the paper-based form. The use of a web-based instrument for professional behaviour assessment yielded a significantly higher number of comments compared to the traditional paper-based assessment. Unfortunately, the quality of the feedback obtained by the web-based instrument as measured by several generally accepted feedback criteria did not parallel this increase. [ABSTRACT FROM AUTHOR]

Introduction: The emphasis on the importance of professionalism in a recent CoBaTrICE-IT paper was impressive. However, insight into the elements of professionalism as perceived relevant for intensivists from the fellows' view, and how these are taught and learned, is limited.Objectives and Methods: A nationwide study was performed in 2007-2008. All ICM fellows (n = 90) were sent a questionnaire containing the following questions regarding training in professionalism (7-point Likert scale (1 = very inadequate, 7 = very adequate)): which are the elements perceived to be important in intensivists'' daily practice (38 items, cat. I)? Which methods of learning and teaching are recognised (16 items, cat. II)? Which methods of teaching and learning are considered especially useful (16 items, cat. III)? Finally, the perceived quantity and quality of formal and informal learning methods, as well as the responsible organisational body was studied. Data were analysed using SPSS 15.0.Results: Response was 75.5 % (n = 68), mean age 34 years. Regarding Elements, scores on virtually all items were high. The factor 'striving for excellence' explained half the variance. Two other aspects, 'Teamwork' and 'Dealing with ethical dilemmas', were identified. Regarding Methods, three dimensions, 'formal curriculum'', 'private and academic experiences' and 'role modelling', proved important. The factor 'formal curriculum' explained most of the variance. Regarding Usefulness the same factors, now mainly explained by the factor Private and academic experiences, emerged with variance. In both categories the items 'observations in daily practice' and 'watching television programmes like ER and House' were the highest- and lowest-scoring items (5.99 and 5.81, and 2.69 and 2.49, respectively). Mean scores regarding the quantity of formal and informal teaching were 4.06 and 4.58 (range 1.841 and 1.519). For the quality of teaching, the figures were 4.22 and 4.52 (range 1.659 and 1.560, respectively). 54 suggestions for improvement of teaching were documented. The need for some form of formal teaching of professionalism aspects as well as for feedback was most frequently mentioned (n = 19 and 16). The local training centres are considered and should remain pivotal for teaching professionalism issues (n = 17 and 28).Conclusions: Almost all elements of professionalism were considered relevant to intensivists' daily practice. Although formal teaching methods regarding professionalism aspects are easily recognised in daily practice, learning by personal experiences and informal ways quantitatively plays a more important, and more valued role. Qualitative comments, nevertheless, stress the need for providing and receiving (solicited and unsolicited) feedback, thereby requesting expansion of formal teaching methods. The local training centres (should continue to) play a major role in teaching professionalism, although an additional role for the (inter)national intensive care organisations remains. [ABSTRACT FROM AUTHOR]

CONTEXT Continuing professional development (CPD) of general practitioners. OBJECTIVE Criterion-referenced standards for assessing performance in the real practice of general practitioners (GPs) should be available to identify learning needs or poor performers for CPD. The applicability of common standard setting procedures in authentic assessment has not been investigated. METHODS To set a standard for assessment of GP-patient communication with video observation of daily practice, we investigated 2 well known examples of 2 different standard setting approaches. An Angoff procedure was applied to 8 written cases. A border-line regression method was applied to videotaped consultations of 88 GPs. The procedures and outcomes were evaluated by the applicability of the procedure, the reliability of the standards and the credibility as perceived by the stakeholders, namely, the GPs. RESULTS Both methods are applicable and reliable; the obtained standards are credible according to the GPs. CONCLUSIONS Both modified methods can be used to set a standard for assessment in daily practice. The context in which the standard will be used - i.e. the specific purpose of the standard, the moment the standard must be available or if specific feedback must be given - is important because methods differ in practical aspects. [ABSTRACT FROM AUTHOR]

For more than two decades the Medical School in Maastricht, the Netherlands, has used simulated patients (SPs) to provide students with opportunities to practise their skills in communication and physical examination. In this educational setting a student meets a SP in a videotaped session. Feedback by the SP to the student at the end of the session is considered an important educational feature. We found no instruments to assess individual SP performance during those sessions. To develop a valid, reliable and feasible instrument to evaluate the performance of SPs. The content of the instrument was validated through interviews with students, teachers and experts who are involved with SPs. They were asked to indicate key features of good SP performance. Based on the interviews, a written checklist was developed to measure individual SP performance. The instrument was evaluated in a regular SP session at the medical school, involving 152 students and their teachers. All interviewees considered the scale to be satisfactory and the instrument to be valid. The feasibility and reliability of the checklists were investigated using the data of 398 returned checklists. Cronbach's alpha was found to be 0.73. Generalizability analysis showed that 12 completed checklists were required to obtain a reliable assessment of one SP. The Maastricht Assessment of Simulated Patients (MaSP) appears to be a valid, reliable and feasible tool to assess the performance of SPs in an educational setting. [ABSTRACT FROM AUTHOR]

OBJECTIVE: To assess the quality of communication skills of triagists, working at out-of-hours (OOH) centres, and to determine the correlation between the communication score and the duration of the telephone consultation. METHODS: Telephone incognito standardised patients (TISPs) called 17 OOH centres presenting different clinical cases. The assessment of communication skills was carried out using the RICE-communication rating list. The duration of each telephone consultation was determined. RESULTS: The mean overall score for communication skills was 35% of the maximum feasible. Triagists usually asked questions about the clinical situation correctly and little about the patients' personal situation, perception of the problem or expectation. Advice about the outcome of triage and self-care advice was usually given without checking for patients' understanding and acceptance of the advice. Calls were often handled in an unstructured way, without summarizing or clarifying the different steps within the consultation. There was a positive correlation of 0.86 (p<0.01) between the overall communication score and the duration of the telephone consultation. CONCLUSION: Assessment of communication skills of triagists revealed specific shortcomings and learning points to improve the quality of communication skills during telephone triage. PRACTICE IMPLICATIONS: Training in telephone consultation should focus more on patient-centred communication with active listening, active advising and structuring the call. Apart from adequate communication skills, triagists need sufficient time for telephone consultation to enable high quality performance. [ABSTRACT FROM AUTHOR]

Objective: To compare learning outcomes of postpartum hemorrhage simulation training based on either instructional design guidelines or best practice., Methods: A pretest-post-test non-equivalent groups study was conducted among obstetrics and gynecology residents in Recife, Brazil, from June 8 to August 30, 2013. The instructional design group included 13 teams, whereas the best practice group included seven teams. A standardized task checklist was used for scenario analysis and the proportion of correctly executed tasks compared (post-test minus pretest)., Results: The instructional design group scored higher than the best practice group for total number of tasks completed (median difference 0.46 vs 0.17; P<0.001; effect size [r]=0.72). Similar results were observed for communication (median difference 0.56 vs 0.22; P=0.004; r=0.58), laboratory evaluation (median difference 0.83 vs 0.00; P<0.001; r=0.76), and mechanical management (median difference 0.25 vs -0.15; P=0.048; r=0.39). Speed of learning was also increased. The median differences were 0.20 for the instructional design group compared with 0.05 for the best practice group at 60 seconds (P=0.015; r=0.49), and 0.49 versus 0.26 (P=0.001; r=0.65) at 360 seconds., Conclusion: The use of simulation training for postpartum hemorrhage that was based on instructional design guidelines yielded better learning outcomes than did training based on best practice., (© 2016 International Federation of Gynecology and Obstetrics.)

Background: Although simulation training is increasingly used to meet modern technology and patient safety demands, its successful integration within surgical curricula is still rare. The Dutch Urological Practical Skills (D-UPS) curriculum provides modular simulation-based training of technical and non-technical basic urological skills in the local hospital setting. This study aims to assess the educational impact of implementing the D-UPS curriculum in the Netherlands and to provide focus points for improvement of the D-UPS curriculum according to the participants., Methods: Educational impact was assessed by means of qualitative individual module-specific feedback and a quantitative cross-sectional survey among residents and supervisors. Twenty out of 26 Dutch teaching hospitals participated. The survey focussed on practical aspects, the D-UPS curriculum in general, and the impact of the D-UPS curriculum on the development of technical and non-technical skills., Results: A considerable survey response of 95 % for residents and 76 % for supervisors was obtained. Modules were attended by junior and senior residents, supervised by a urologist, and peer teaching was used. Ninety percent of supervisors versus 67 % of residents judged the D-UPS curriculum as an important addition to current residency training (p = 0.007). Participants' aggregated general judgement of the modules showed a substantial percentage favorable score (M ± SE: 57 ± 4 %). The impact of training on, e.g., knowledge of materials/equipment and ability to anticipate on complications was high, especially for junior residents (77 ± 5 and 71 ± 7 %, respectively). Focus points for improvement of the D-UPS curriculum according to the participants include adaptation of the training level to residents' level of experience and focus on logistics., Conclusion: The simulation-based D-UPS curriculum has a high educational impact. Residents and supervisors consider the curriculum to be an important addition to current residency training. Focus points for improvement of the D-UPS curriculum according to the participants include increased attention to logistics and integration of a spiral learning approach.

Background: Progress testing (PT) is used in Western countries to evaluate students' level of functional knowledge, and to enhance meaning-oriented and self-directed learning. However, the use of PT has not been investigated in East Asia, where reproduction-oriented and teacher-centered learning styles prevail. Here, we explored the applicability of PT by focusing on student perceptions., Methods: Twenty-four students from Years 2, 3, and 5 at Jichi Medical University in Japan attended a pilot PT session preceded by a brief introduction of its concept and procedures. Variations in obtained test scores were analyzed by year, and student perceptions of PT were explored using focus groups., Results: Formula scores (mean ± standard deviation) in Years 2, 3, and 5 were 12.63 ± 3.53, 35.88 ± 14.53, and 71.00 ± 18.31, respectively. Qualitative descriptive analysis of focus group data showed that students disfavored testing of medical knowledge without tangible goals, but instead favored repetitive assessment of knowledge that had been learned and was tested on a unit basis in the past in order to achieve deep learning. Further, students of all school years considered that post-test explanatory lectures by teachers were necessary., Conclusions: East Asian students' perceptions indicated that, in addition to their intensive memorization within narrow test domains compartmentalized by end-of-unit tests, the concept of PT was suitable for repetitive memorization, as it helped them to integrate their knowledge and to increase their understanding. Post-test explanatory lectures might lessen their dislike of the intangible goals of PT, but at the expense of delaying the development of self-directed learning. Key issues for the optimization of PT in East Asia may include administration of PT after completed end-of-unit tests and a gradual change in feedback methodology over school years from test-oriented post-test lectures to the provision of literature references only, as a means of enhancing test self-review and self-directed learning.

Background: Portfolios are used as tools to coach and assess students in the workplace. This study sought to evaluate the content validity of portfolios as reflected in their capacity to adequately assess achieved competences of medical students during clerkships., Methods: We reviewed 120 workplace portfolios at three medical universities (Belgium and the Netherlands). To validate their content, we developed a Validity Inventory for Portfolio Assessment (VIPA) based on the CanMEDS roles. Two raters evaluated each portfolio and indicated for each VIPA item whether the portfolio provided sufficient information to enable satisfactory assessment of the item. We ran a descriptive analysis on the validation data and computed Cohen's Kappa to investigate interrater agreement., Results: The portfolios adequately covered the items pertaining to the communicator (90%) and professional (87%) roles. Coverage of the medical expert, collaborator, scholar and manager roles ranged between 75% and 85%. The health advocate role, covering 59%, was clearly less well represented. This role also exhibited little interrater agreement (Kappa < 0.4)., Conclusions: This study lends further credence to the evidence that portfolios can indeed adequately assess the different CanMEDS roles during clerkships, the health advocate role, which was less well represented in the portfolio content, excepted.

Objective: To investigate the value of the physical Simbla Transurethral Resection of a Bladder Tumor (TURBT) simulator as an educational tool within urological residency training, by means of a training needs analysis (TNA) and assessment of its feasibility, acceptability, and face, content, and construct validity., Methods: To analyze the training needs for TURBT, procedural steps and pitfalls were identified and the TNA was completed during an expert consensus meeting. Participants (n = 76) were divided into three groups based on their experience in TURBT: novices, intermediates, and experts. Participants performed two standardized TURBT procedures on the simulator. Face validity and content validity, as well as feasibility and acceptability, were assessed with a quantitative survey. Construct validity was assessed by comparing the performance of novices, intermediates, and experts on resection time, quality of tumor resection, and overall performance., Results: Of the 21 procedural steps and 17 pitfalls defined in TNA, 13 steps and 8 pitfalls were covered by the Simbla. Participants rated the Simbla's overall realism (face validity) with a score of 8 of 10 (range 6-9). The simulator was judged to be most useful (content validity) for learning eye-hand coordination: score 8 (6-10). All aspects regarding realism and usefulness were rated above the acceptability threshold of 6/10. Intermediates (100%) and experts (96%) considered the Simbla to be a useful educational tool within the urological curriculum. Resection time was longer for novices than for experts (p < 0.05; construct validity). In addition, the overall performance of novices was rated lower compared with intermediates and experts, and novices showed more irradical resections and bladder perforations (all p < 0.05)., Conclusions: The Simbla TURBT simulator is a valid, feasible, and acceptable educational tool for training procedural skills and may be implemented in the urological curriculum to complement learning in clinical practice. TNA is valuable in defining training objectives and evaluating the educational value of a simulator.

Formula scoring (FS) is the use of a don't know option (DKO) with subtraction of points for wrong answers. Its effect on construct validity and reliability of progress test scores, is subject of discussion. Choosing a DKO may not only be affected by knowledge level, but also by risk taking tendency, and may thus introduce construct-irrelevant variance into the knowledge measurement. On the other hand, FS may result in more reliable test scores. To evaluate the impact of FS on construct validity and reliability of progress test scores, a progress test for radiology residents was divided into two tests of 100 parallel items (A and B). Each test had a FS and a number-right (NR) version, A-FS, B-FS, A-NR, and B-NR. Participants (337) were randomly divided into two groups. One group took test A-FS followed by B-NR, and the second group test B-FS followed by A-NR. Evidence for impaired construct validity was sought in a hierarchical regression analysis by investigating how much of the participants' FS-score variance was explained by the DKO-score, compared to the contribution of the knowledge level (NR-score), while controlling for Group, Gender, and Training length. Cronbach's alpha was used to estimate NR and FS-score reliability per year group. NR score was found to explain 27 % of the variance of FS [F(1,332) = 219.2, p < 0.0005], DKO-score, and the interaction of DKO and Gender were found to explain 8 % [F(2,330) = 41.5, p < 0.0005], and the interaction of DKO and NR 1.6 % [F(1,329) = 16.6, p < 0.0005], supporting our hypothesis that FS introduces construct-irrelevant variance into the knowledge measurement. However, NR-scores showed considerably lower reliabilities than FS-scores (mean year-test group Cronbach's alphas were 0.62 and 0.74, respectively). Decisions about FS with progress tests should be a careful trade-off between systematic and random measurement error.

General practitioners (GPs) are increasingly called upon to identify patients at risk for hereditary cancers, and their genetic competencies need to be enhanced. This article gives an overview of a research project on how to build effective educational modules on genetics, assessed by randomized controlled trials (RCTs), reflecting the prioritized educational needs of primary care physicians. It also reports on an ongoing study to investigate long-term increase in genetic consultation skills (1-year follow-up) and interest in and satisfaction with a supportive website on genetics among GPs. Three oncogenetics modules were developed: an online Continuing Professional Development (G-eCPD) module, a live genetic CPD module, and a "GP and genetics" website (huisartsengenetica.nl) providing further genetics information applicable in daily practice. Three assessments to evaluate the effectiveness (1-year follow-up) of the oncogenetic modules were designed: 1.An online questionnaire on self-reported genetic competencies and changes in referral behaviour, 2.Referral rates from GPs to clinical genetics centres and 3.Satisfaction questionnaire and visitor count analytics of supportive genetics website. The setting was Primary care in the Netherlands and three groups of study participants were included in the reported studies:. Assessment 1. 168 GPs responded to an email invitation and were randomly assigned to an intervention or control group, evaluating the G-eCPD module (n = 80) or the live module (n = 88). Assessment 2. Referral rates by GPs were requested from the clinical genetics centres, in the northern and southern parts of the Netherlands (Amsterdam and Maastricht), for the two years before (2010 [n = 2510] and 2011 [n = 2940]) and the year after (2012 [n = 2875]) launch of the oncogenetics CPD modules and the website. Assessment 3. Participants of the website evaluation were all recruited online. When they visited the website during the month of February 2013, a pop-up invitation came up. Of the 1350 unique visitors that month, only 38 completed the online questionnaire. Main outcomes measure showed long-term (self-reported) genetic consultation skills (i.e. increased genetics awareness and referrals to clinical genetics centres) among GPs who participated in the oncogenetic training course, and interest in and satisfaction with the supportive website. 42 GPs (52%) who previously participated in the G-eCPD evaluation study and 50 GPs (57%) who participated in the live training programme responded to the online questionnaire on long-term effects of educational outcome. Previous RCTs showed that the genetics CPD modules achieved sustained improvement of oncogenetic knowledge and consultation skills (3-months follow-up). Participants of these RCTs reported being more aware of genetic problems long term; this was reported by 29 GPs (69%) and 46 GPs (92%) participating in the G-eCPD and live module evaluation studies, respectively (Chisquare test, p<0.005). One year later, 68% of the respondents attending the live training reported that they more frequently referred patients to the clinical genetics centres, compared to 29% of those who attended the online oncogenetics training (Chisquare test, p<0.0005). However, the clinical genetics centres reported no significant change in referral numbers one year after the training. Website visitor numbers increased, as did satisfaction, reflected in a 7.7 and 8.1 (out of 10) global rating of the website (by G-eCPD and live module participants, respectively). The page most often consulted was "family tree drawing". Self-perceived genetic consultation skills increased long-term and GPs were interested in and satisfied with the supportive website. Further studies are necessary to see whether the oncogenetics CPD modules result in more efficient referral. The results presented suggest we have provided a flexible and effective framework to meet the need for effective educational programmes for non-geneticist healthcare providers, enabling improvement of genetic medical care.

Background: Teachers' conceptions of learning and teaching are partly unconscious. However, they are critical for the delivery of education and affect students' learning outcomes. Lasting changes in teaching behaviour can only be realized if conceptions of teachers have been changed accordingly. Previously we constructed a questionnaire named COLT to measure conceptions. In the present study, we investigated if different teacher profiles could be assessed which are based on the teachers' conceptions. These teacher profiles might have implications for individual teachers, for faculty development activities and for institutes. Our research questions were: (1) Can we identify teacher profiles based on the COLT? (2) If so, how are these teacher profiles associated with other teacher characteristics?, Methods: The COLT questionnaire was sent electronically to all teachers in the first three years of the undergraduate curriculum of Medicine in two medical schools in the Netherlands with student-centred education. The COLT (18 items, 5 point Likert scales) comprises three scales: 'teacher centredness', 'appreciation of active learning' and 'orientation to professional practice'. We also collected personal information about the participants and their occupational characteristics. Teacher profiles were studied using a K-means cluster analysis and calculating Chi squares., Results: The response rate was 49.4% (N = 319/646). A five-cluster solution fitted the data best, resulting in five teacher profiles based on their conceptions as measured by the COLT. We named the teacher profiles: Transmitters (most traditional), Organizers, Intermediates, Facilitators and Conceptual Change Agents (most modern). The teacher profiles differed from each other in personal and occupational characteristics., Conclusions: Based on teachers' conceptions of learning and teaching, five teacher profiles were found in student-centred education. We offered suggestions how insight into these teacher profiles might be useful for individual teachers, for faculty development activities and for institutes and departments, especially if involved in a curriculum reform towards student-centred education.

Objective: To determine the perceived importance of specific competencies in professional veterinary practice and education among veterinarians in several countries., Design: Survey-based prospective study., Sample: 1,137 veterinarians in 10 countries., Procedures: Veterinarians were invited via email to participate in the study. A framework of 18 competencies grouped into 7 domains (veterinary expertise, communication, collaboration, entrepreneurship, health and welfare, scholarship, and personal development) was used. Respondents rated the importance of each competency for veterinary professional practice and for veterinary education by use of a 9-point Likert scale in an online questionnaire. Quantitative statistical analyses were performed to assess the data., Results: All described competencies were perceived as having importance (with overall mean ratings [all countries] ≥ 6.45/9) for professional practice and education. Competencies related to veterinary expertise had the highest ratings (overall mean, 8.33/9 for both professional practice and education). For the veterinary expertise, entrepreneurship, and scholarship domains, substantial differences (determined on the basis of statistical significance and effect size) were found in importance ratings among veterinarians in different countries., Conclusions and Clinical Relevance: Results indicated a general consensus regarding the importance of specific types of competencies in veterinary professional practice and education. Further research into the definition of competencies essential for veterinary professionals is needed to help inform an international dialogue on the subject.

Background: In 2005 a competency based curriculum was introduced in the Dutch postgraduate medical training programs. While the manager's role is one of the seven key competencies, there is still no formal management course in most postgraduate curricula. Based on a needs assessment we conducted, several themes were identified as important for a possible management training program. We present the results of the pilot training we performed to investigate two of these themes., Methods: The topics "knowledge of the healthcare system" and "time management" were developed from the list of suggested management training themes. Fourteen residents participated in the training and twenty-four residents served as control. The training consisted of two sessions of four hours with a homework assignment in between. 50 True/false-questions were given as pre- and post-test to both the test and control groups to assess the level of acquired knowledge among the test group as well as the impact of the intervention. We also performed a qualitative evaluation using evaluation forms and in-depth interviews., Results: All fourteen residents completed the training. Six residents in the control group were lost to follow up. The pre- and post-test showed improvement among the participating residents in comparison to the residents from the control group, but this improvement was not significant. The qualitative assessment showed that all residents evaluated the training positively and experienced it as a useful addition to their training in becoming a medical specialist., Conclusion: Our training was evaluated positively and considered to be valuable. This study supports the need for mandatory medical management training as part of the postgraduate medical curriculum. Our training could be an example of how to teach two important themes in the broad area of medical management education.

Purpose: This study aims to provide an overview of type and frequency of musculoskeletal complaints among urologists. In addition, the urologists' knowledge about ergonomic conditions during minimally invasive urology was assessed, and they were asked how they would prefer to gain knowledge about this topic., Materials and Methods: An online and hard copy version questionnaire was administered to urologists from different countries, mainly from Europe, performing endourology and laparoscopy., Results: Of the 285 respondents, 245 (86.0%) urologists experienced musculoskeletal complaints in the past 12 months and 62.1% were considered to be work related. Most common areas for chronic complaints were neck, back, and shoulders. Almost 50% of the urologists experienced chronic musculoskeletal complaints, for which endourology (odds ratio [OR] 3.06; 95% confidence interval [CI] 1.37-6.80) and laparoscopy (OR 1.70; 95% CI 1.27-2.28) were significant risk factors. One third of the urologists considered their knowledge about ergonomics minimal, and 8% stated that they had no knowledge about these topics. Fifty percent of the respondents preferred to integrate information about ergonomic rules into hands-on training of urologic skills., Conclusion: High prevalence of experienced musculoskeletal complaints was found among urologists predominantly related to endourology and laparoscopy. Urologists indicate that they have a lack of knowledge about ergonomics in the operating room. Hence, we recommend integration of ergonomics in hands-on training programs early in the residency curriculum to gain knowledge and awareness and hopefully to offer possibilities to prevent these complaints in the future.

Background: Emotional Intelligence (EI) is the ability to deal with your own and others emotions. Medical students are inducted into medical schools on the basis of their academic achievement. Professionally, however, their success rate is variable and may depend on their interpersonal relationships. EI is thought to be significant in achieving good interpersonal relationships and success in life and career. Therefore, it is important to measure EI and understand its correlates in an undergraduate medical student population., Aim: The objective of study was to investigate the relationship between the EI of medical students and their academic achievement (based on cumulative grade point average [CGPA]), age, gender and year of study., Methods: A cross-sectional survey design was used. The SSREIS and demographic survey were administered in the three medical schools in Saudi Arabia from April to May 2012., Results: The response rate was 30%. For the Optimism subscale, the mean score was M = 3.79, SD ± 0.54 (α = 0.82), for Awareness-of-emotion subscale M = 3.94, SD ± 0.57 (α = 0.72) and for Use-of-emotion subscale M = 3.92, SD ± 0.54 (α = 0.63). Multiple regression showed a significant positive correlation between CGPA and the EI of medical students (r = 0.246, p = 0.000) on the Optimism subscale. No correlation was seen between CGPA and Awareness of Emotions and Use of Emotions subscales. No relationship was seen for the other independent variables., Conclusion: The current study demonstrates that CGPA is the only significant predictor, indicating that Optimism tends to be higher for students with a higher CPGA. None of the other independent variables (age, year of study, gender) showed a significant relationship.

Medical professionals are increasingly expected to deliver genetic services in daily patient care. However, genetics education is considered to be suboptimal and in urgent need of revision and innovation. We designed a Genetics e-learning Continuing Professional Development (CPD) module aimed at improving general practitioners' (GPs') knowledge about oncogenetics, and we conducted a randomized controlled trial to evaluate the outcomes at the first two levels of the Kirkpatrick framework (satisfaction, learning and behavior). Between September 2011 and March 2012, a parallel-group, pre- and post-retention (6-month follow-up) controlled group intervention trial was conducted, with repeated measurements using validated questionnaires. Eighty Dutch GP volunteers were randomly assigned to the intervention or the control group. Satisfaction with the module was high, with the three item's scores in the range 4.1-4.3 (5-point scale) and a global score of 7.9 (10-point scale). Knowledge gains post test and at retention test were 0.055 (P<0.05) and 0.079 (P<0.01), respectively, with moderate effect sizes (0.27 and 0.31, respectively). The participants appreciated applicability in daily practice of knowledge aspects (item scores 3.3-3.8, five-point scale), but scores on self-reported identification of disease, referral to a specialist and knowledge about the possibilities/limitations of genetic testing were near neutral (2.7-2.8, five-point scale). The Genetics e-learning CPD module proved to be a feasible, satisfactory and clinically applicable method to improve oncogenetics knowledge. The educational effects can inform further development of online genetics modules aimed at improving physicians' genetics knowledge and could potentially be relevant internationally and across a wider range of potential audiences.

The Job Demands-Resources model (JD-R model) was used as the theoretical basis of a tailormade questionnaire to measure the psychosocial work environment and personal resources of recently graduated veterinary professionals. According to the JD-R model, two broad categories of work characteristics that determine employee wellbeing can be distinguished: job demands and job resources. Recently, the JD-R model has been expanded by integrating personal resource measures into the model. Three semistructured group interviews with veterinarians active in different work domains were conducted to identify relevant job demands, job resources and personal resources. These demands and resources were organised in themes (constructs). For measurement purposes, a set of questions ('a priori scale') was selected from the literature for each theme. The full set of a priori scales was included in a questionnaire that was administered to 1760 veterinary professionals. Exploratory factor analysis and reliability analysis were conducted to arrive at the final set of validated scales (final scales). 860 veterinarians (73 per cent females) participated. The final set of scales consisted of seven job demands scales (32 items), nine job resources scales (41 items), and six personal resources scales (26 items) which were considered to represent the most relevant potential predictors of work-related wellbeing in this occupational group. The procedure resulted in a tailormade questionnaire: the Veterinary Job Demands and Resources Questionnaire (Vet-DRQ). The use of valid theory and validated scales enhances opportunities for comparative national and international research.

With the aim to assess levels of burnout and work engagement in junior veterinarians and identify predictors of burnout and work engagement in male and female veterinarians, 1760 veterinarians who had graduated in The Netherlands between 1999 and 2009, received an electronic questionnaire. Veterinarians numbering 860 (73 per cent females) participated. Levels of exhaustion, cynicism and work engagement were significantly lower compared to the norm group (a random sample of the Dutch working population). Male veterinarians were less exhausted and more engaged than female veterinarians. Exhaustion decreased over the years. Job demands positively related to exhaustion were work-home interference and workload. Job resources positively related to work engagement were opportunities for professional development and skills discretion (ie, the ability to use and develop skills on the job. Personal resources explained more of the variance in work engagement of female and male veterinarians (31 per cent and 42 per cent) than of the variance in exhaustion (19 per cent and 21 per cent) and cynicism (19 per cent and 10 per cent). Personal resources positively related to work engagement were self-efficacy and proactive behaviour. Relative importance analysis revealed differences between men and women in the importance of various job demands, job resources and personal resources in explaining burnout and engagement in young veterinary professionals.

Background: In 2011, the European Basic Laparoscopic Urological Skills (E-BLUS) examination was introduced as a pilot for the examination of final-year urologic residents., Objective: In this study, we aimed to answer the following research questions: What level of laparoscopic skills do final-year residents in urology have in Europe, and do the participants of the E-BLUS pass the examination according to the validated criteria?, Design, Setting, and Participants: Participants of the examination were final-year urology residents from different European countries taking part in the European Urology Residents Education Program in 2011 and 2012., Surgical Procedure: The E-BLUS exam consists of five tasks validated for the training of basic urologic laparoscopic skills., Outcome Measurements and Statistical Analysis: Performances of the tasks were recorded on DVD and analysed by an objective rater. Time and number of errors made in tasks 1-4 were noted. Furthermore, all expert laparoscopic urologists were asked to score participants on a global rating scale (1-5) based on three items: depth perception, bimanual dexterity, and efficiency. Participants were asked to complete a questionnaire on prior training and laparoscopic experience., Results and Limitations: Seventy DVD recordings were analysed. Most participants did not pass the time criteria on task 4 (90%), task 2 (85.7%), task 1 (74.3%), and task 5 (71.4%). Task 3 was passed by 84.3%. The overall quality score was passed by 64%. When combining time and quality, only three participants (4.2%) passed the examination according to the validated criteria. According to the questionnaire, 61% did not have the opportunity to train in laparoscopic skills., Conclusions: The results of the E-BLUS examination show that the level of basic laparoscopic skills among European residents is low. Although quality of performance is good, most residents do not pass the validated time criteria. Regular laparoscopic training or a dedicated fellowship should improve the laparoscopic level of residents in urology., (Copyright © 2013 European Association of Urology. Published by Elsevier B.V. All rights reserved.)

Purpose: General practitioners are increasingly called upon to deliver genetic services and could play a key role in translating potentially life-saving advancements in oncogenetic technologies to patient care. If general practitioners are to make an effective contribution in this area, their genetics competencies need to be upgraded. The aim of this study was to investigate whether oncogenetics training for general practitioners improves their genetic consultation skills., Methods: In this pragmatic, blinded, randomized controlled trial, the intervention consisted of a 4-h training (December 2011 and April 2012), covering oncogenetic consultation skills (family history, familial risk assessment, and efficient referral), attitude (medical ethical issues), and clinical knowledge required in primary-care consultations. Outcomes were measured using observation checklists by unannounced standardized patients and self-reported questionnaires., Results: Of 88 randomized general practitioners who initially agreed to participate, 56 completed all measurements. Key consultation skills significantly and substantially improved; regression coefficients after intervention were equivalent to 0.34 and 0.28 at 3-month follow-up, indicating a moderate effect size. Satisfaction and perceived applicability of newly learned skills were highly scored., Conclusion: The general practitioner-specific training proved to be a feasible, satisfactory, and clinically applicable method to improve oncogenetics consultation skills and could be used as an educational framework to inform future training activities with the ultimate aim of improving medical care.

Background: One of the methods used for standard setting is the borderline regression method (BRM). This study aims to assess the reliability of BRM when the pass-fail standard in an objective structured clinical examination (OSCE) was calculated by averaging the BRM standards obtained for each station separately., Materials and Methods: In nine stations of the OSCE with direct observation the examiners gave each student a checklist score and a global score. Using a linear regression model for each station, we calculated the checklist score cut-off on the regression equation for the global scale cut-off set at 2. The OSCE pass-fail standard was defined as the average of all station's standard. To determine the reliability, the root mean square error (RMSE) was calculated. The R (2) coefficient and the inter-grade discrimination were calculated to assess the quality of OSCE., Results: The mean total test score was 60.78. The OSCE pass-fail standard and its RMSE were 47.37 and 0.55, respectively. The R (2) coefficients ranged from 0.44 to 0.79. The inter-grade discrimination score varied greatly among stations., Conclusion: The RMSE of the standard was very small indicating that BRM is a reliable method of setting standard for OSCE, which has the advantage of providing data for quality assurance.

Weaknesses in the nature of rater judgments are generally considered to compromise the utility of workplace-based assessment (WBA). In order to gain insight into the underpinnings of rater behaviours, we investigated how raters form impressions of and make judgments on trainee performance. Using theoretical frameworks of social cognition and person perception, we explored raters' implicit performance theories, use of task-specific performance schemas and the formation of person schemas during WBA. We used think-aloud procedures and verbal protocol analysis to investigate schema-based processing by experienced (N = 18) and inexperienced (N = 16) raters (supervisor-raters in general practice residency training). Qualitative data analysis was used to explore schema content and usage. We quantitatively assessed rater idiosyncrasy in the use of performance schemas and we investigated effects of rater expertise on the use of (task-specific) performance schemas. Raters used different schemas in judging trainee performance. We developed a normative performance theory comprising seventeen inter-related performance dimensions. Levels of rater idiosyncrasy were substantial and unrelated to rater expertise. Experienced raters made significantly more use of task-specific performance schemas compared to inexperienced raters, suggesting more differentiated performance schemas in experienced raters. Most raters started to develop person schemas the moment they began to observe trainee performance. The findings further our understanding of processes underpinning judgment and decision making in WBA. Raters make and justify judgments based on personal theories and performance constructs. Raters' information processing seems to be affected by differences in rater expertise. The results of this study can help to improve rater training, the design of assessment instruments and decision making in WBA.

Background: Earlier studies suggested national culture to be a potential barrier to curriculum reform in medical schools. In particular, Hofstede's cultural dimension 'uncertainty avoidance' had a significant negative relationship with the implementation rate of integrated curricula., Aims: However, some schools succeeded to adopt curriculum changes despite their country's strong uncertainty avoidance. This raised the question: 'How did those schools overcome the barrier of uncertainty avoidance?', Method: Austria offered the combination of a high uncertainty avoidance score and integrated curricula in all its medical schools. Twenty-seven key change agents in four medical universities were interviewed and transcripts analysed using thematic cross-case analysis., Results: Initially, strict national laws and limited autonomy of schools inhibited innovation and fostered an 'excuse culture': 'It's not our fault. It is the ministry's'. A new law increasing university autonomy stimulated reforms. However, just this law would have been insufficient as many faculty still sought to avoid change. A strong need for change, supportive and continuous leadership, and visionary change agents were also deemed essential., Conclusions: In societies with strong uncertainty avoidance strict legislation may enforce resistance to curriculum change. In those countries opposition by faculty can be overcome if national legislation encourages change, provided additional internal factors support the change process.

The influence of problem-based learning (PBL) and open-book tests on long-term knowledge retention is unclear and subject of discussion. Hypotheses were that PBL as well as open-book tests positively affect long-term knowledge retention. Four progress test results of fifth and sixth-year medical students (n = 1,648) of three medical schools were analyzed. Two schools had PBL driven curricula, and the third one had a traditional curriculum (TC). One of the PBL schools (PBLob) used a combination of open-book (assessing backup knowledge) and closed-book tests (assessing core knowledge); the other two schools (TC and PBLcb) only used closed-book tests. The items of the progress tests were divided into core and backup knowledge. T tests (with Bonferroni correction) were used to analyze differences between curricula. PBL students performed significantly better than TC students on core knowledge (average effect size (av ES) = 0.37-0.74) and PBL students tested with open-book tests scored somewhat higher than PBL students tested without such tests (av ES = 0.23-0.30). Concerning backup knowledge, no differences were found between the scores of the three curricula. Students of the two PBL curricula showed a substantially better long-term knowledge retention than TC students. PBLob students performed somewhat better on core knowledge than PBLcb students. These outcomes suggest that a problem-based instructional approach in particular can stimulate long-term knowledge retention. Distinguishing knowledge into core and backup knowledge and using open-book tests alongside closed-book tests could enhance long-term core knowledge retention.

Background: The Dutch postgraduate medical training has been revised to focus on seven competencies. The role as manager is one of these competencies. Recent studies show that this competency receives little attention during the residency training. In an earlier study, we discovered that residents perceived their competency as managers to be moderate., Aim: In this study, we investigated how medical specialists perceived the managerial competencies of medical residents and their need for management education., Methods: In September 2010, a 46-item questionnaire was designed which examined medical specialists' perceptions of the competency and needs of residents in the field of medical management. Two hundred ninety-eight specialists were invited via email to participate., Results: Hundred twenty-nine specialists (43.3%) responded to our survey. They rated the residents' competencies in contract negotiating skills, knowledge of the healthcare system, and specialist department poorly. They felt that residents were competent in updating their medical knowledge. Ninety-four percent reported a need for training in management among residents. Preferred topics were time management and healthcare organization. The preferred training method was a workshop given during residency by an extramural expert., Conclusion: Dutch medical specialists perceive the management competencies of residents in some areas to be inadequate. They feel that training in medical management during residency is necessary.

Background: Although preparation for educational activities is considered beneficial for student learning, many students do not perform preparatory assignments. This phenomenon has received little attention in the literature although it might provide medical educators with the opportunity to enhance student learning. Therefore, we explored why students prepare or not prepare., Methods: An explorative mixed methods study was performed. In a qualitative study, 24 short group interviews with medical undergraduate students (n=209) were conducted on why they prepared for skills training sessions. In a subsequent quantitative study the resulting themes were used to construct a questionnaire. The questionnaire was presented to all undergraduate medical students at Maastricht University and 847 students completed it. Scales were constructed by a combination of exploratory factor analysis, reliability analysis, and content analysis. Between-class differences in the scale scores were investigated using ANOVA., Results: The qualitative study showed that students' opinions on preparation are influenced by both personal factors, categorized as 'personal learning style', 'attitudes and beliefs', and 'planning and organization', as well as external factors, including 'preparatory advice', 'pressure, consequence, and checking of preparation', 'teacher-related motivations', and 'contents and schedule of the training sessions'. The quantitative study showed that 'the objective structured clinical examination' and 'facilitation of both understanding and memorizing the learning material', were the two most motivating items. The two most demotivating aspects were 'other students saying that preparation was not useful' and 'indistinct preparatory advices'. Factor analyses yielded three scales: 'urge to learn', 'expected difficulties', and 'lack of motivation'. Between group differences were found between the three classes on the first two scales., Conclusions: Students make an active and complex choice whether to prepare or not, based on multiple factors. Practical implications for educational practice are discussed.

Aim: There is growing pressure from the government and the public to define proficiency standards for surgical skills. Aim of this study was to estimate the reliability of the Program for Laparoscopic Urological Skills (PLUS) assessment and to set a certification standard for second-year urological residents., Methods: Fifty participants were assessed on performance time and performance quality to investigate the reliability of the PLUS assessment. Generalisability coefficient of 0.8, on a scale of 0 to 1.0, was considered to indicate good reliability for assessment purposes. Pass/fail standards were based on laparoscopic experience: Novices, intermediates, and experts (>100 procedures). The pass/fail standards were investigated for the PLUS performances of 33 second-year urological residents., Results: Fifteen novices, twenty-three intermediates and twelve experts were included. An inter-trial reliability of >0.80 was reached with two trials for each task. Inter-rater reliability of the quality measurements was 0.79 for two judges. Pass/fail scores were determined for the novice/intermediate boundary and the intermediate/expert boundary. Pass rates for second-year residents were 63.64% and 9.09%, respectively., Conclusion: The PLUS assessment is reliable for setting a certification standard for second-year urological residents that serves as a starting point for residents to proceed to the next level of laparoscopic competency.

Purpose: Studies that compare the effects of problem-based and conventional medical curricula on student performance generally show no significant differences. However, curriculum comparison studies are at best quasi-experimental, so they are prone to forms of selection bias. The purpose of this study was to reanalyze data from such comparisons by controlling for two potential biases: differential student attrition and differential exposure., Method: The authors reanalyzed 104 previously published comparisons involving a single, problem-based medical school in the Netherlands (Maastricht University's medical school), using student attrition and study duration data from this school and the schools with which it was compared. The authors removed bias by reequalizing the comparison groups in terms of attrition and study duration., Results: The uncorrected data showed no differences between problem-based and conventional curricula: Mean effect sizes as expressed by Cohen d were 0.02 for medical knowledge and 0.07 for diagnostic reasoning. However, the reanalysis demonstrated medium-level effect sizes favoring the problem-based curriculum. After corrections for attrition and study duration, the mean effect size for knowledge acquisition was 0.31 and for diagnostic reasoning was 0.51., Conclusions: Effects of the Maastricht problem-based curriculum were masked by differential attrition and differential exposure in the original studies. Because this school has been involved in many studies included in influential literature reviews published in the past 20 years, the authors' findings have implications for the assessment of the value of problem-based learning put forward by these reviews.

Background: Visual expertise relies on perceptive as well as cognitive processes. At present, knowledge of these processes when diagnosing clinical cases mainly stems from studies with still pictures. In contrast, patient video cases constitute a dynamic diagnostic challenge that may simulate seeing and diagnosing a patient in person., Aims: This study investigates visual attention and the concomitant cognitive processes of clinicians diagnosing authentic paediatric video cases., Methods: A total of 43 clinicians with varying levels of expertise took part in this cross-sectional study. They diagnosed four brief video recordings of children: two with seizures and two with disorders imitating seizures. We used eye tracking to investigate time looking at relevant areas in the video cases and a concurrent think-aloud procedure to explore the associated clinical reasoning processes., Results: More experienced clinicians were more accurate in visual diagnosis and spent more of their time looking at relevant areas. At the same time, they explored data less, yet they built and evaluated more diagnostic hypotheses., Conclusions: Clinicians of varying expertise analyse patient video cases differently. Clinical teachers should take these differences into account when optimising educational formats with patient video cases., (Copyright © 2011 European Paediatric Neurology Society. Published by Elsevier Ltd. All rights reserved.)

Background: Incident reporting systems (IRS) are used to identify medical errors in order to learn from mistakes and improve patient safety in hospitals. However, IRS contain only a small fraction of occurring incidents. A more comprehensive overview of medical error in hospitals may be obtained by combining information from multiple sources. The WHO has developed the International Classification for Patient Safety (ICPS) in order to enable comparison of incident reports from different sources and institutions., Methods: The aim of this paper was to provide a more comprehensive overview of medical error in hospitals using a combination of different information sources. Incident reports collected from IRS, patient complaints and retrospective chart review in an academic acute care hospital were classified using the ICPS. The main outcome measures were distribution of incidents over the thirteen categories of the ICPS classifier "Incident type", described as odds ratios (OR) and proportional similarity indices (PSI)., Results: A total of 1012 incidents resulted in 1282 classified items. Large differences between data from IRS and patient complaints (PSI = 0.32) and from IRS and retrospective chart review (PSI = 0.31) were mainly attributable to behaviour (OR = 6.08), clinical administration (OR = 5.14), clinical process (OR = 6.73) and resources (OR = 2.06)., Conclusions: IRS do not capture all incidents in hospitals and should be combined with complementary information about diagnostic error and delayed treatment from patient complaints and retrospective chart review. Since incidents that are not recorded in IRS do not lead to remedial and preventive action in response to IRS reports, healthcare centres that have access to different incident detection methods should harness information from all sources to improve patient safety.

Background: The role of deliberate practice in medical students' development from novice to expert was examined for preclinical skill training., Methods: Students in years 1-3 completed 34 Likert type items, adapted from a questionnaire about the use of deliberate practice in cognitive learning. Exploratory factor analysis and reliability analysis were used to validate the questionnaire. Analysis of variance examined differences between years and regression analysis the relationship between deliberate practice and skill test results., Results: 875 students participated (90%). Factor analysis yielded four factors: planning, concentration/dedication, repetition/revision, study style/self reflection. Student scores on 'Planning' increased over time, score on sub-scale 'repetition/revision' decreased. Student results on the clinical skill test correlated positively with scores on subscales 'planning' and 'concentration/dedication' in years 1 and 3, and with scores on subscale 'repetition/revision' in year 1., Conclusions: The positive effects on test results suggest that the role of deliberate practice in medical education merits further study. The cross-sectional design is a limitation, the large representative sample a strength of the study. The vanishing effect of repetition/revision may be attributable to inadequate feedback. Deliberate practice advocates sustained practice to address weaknesses, identified by (self-)assessment and stimulated by feedback. Further studies should use a longitudinal prospective design and extend the scope to expertise development during residency and beyond.

Objective: • To establish the effect of distraction on the performance of cystoscopy and basic endourological tasks by using a virtual reality (VR) simulator., Subjects and Methods: • A total of 86 third-year medical students from Maastricht University, who had no previous experience in performing the tasks on a VR simulator, were randomly assigned to an intervention or control group. • All participants performed three endourological tasks on the VR simulator. Participants in the intervention group were distracted 1 min into the third task. The distraction consisted of being asked to answer questions about a medical case that had been presented to all the participants before the hands-on session. After two adequate verbal responses the conversation was terminated. • Number of traumata, number of missed lesions in the bladder and time to completion were measured by the VR simulator., Results: • Number of traumata and missed lesions, as well as time to completion were significantly higher in the intervention than in the control group with effect sizes (using Cohen's categorization) of 0.48, 0.41 and 0.50 respectively. • Nevertheless, only 9.5% of the participants in the intervention group reported feeling burdened by the distraction., Conclusions: • Distraction during the performance of endourological skills results in significantly poorer performance by medical students on all the variables measured in a controlled learning environment. • Most students do not realize they are affected by distraction. • Further research is needed to determine the impact of distraction on more experienced participants and on patient safety., (© 2010 THE AUTHORS. BJU INTERNATIONAL © 2010 BJU INTERNATIONAL.)

Traditional psychometric approaches towards assessment tend to focus exclusively on quantitative properties of assessment outcomes. This may limit more meaningful educational approaches towards workplace-based assessment (WBA). Cognition-based models of WBA argue that assessment outcomes are determined by cognitive processes by raters which are very similar to reasoning, judgment and decision making in professional domains such as medicine. The present study explores cognitive processes that underlie judgment and decision making by raters when observing performance in the clinical workplace. It specifically focuses on how differences in rating experience influence information processing by raters. Verbal protocol analysis was used to investigate how experienced and non-experienced raters select and use observational data to arrive at judgments and decisions about trainees' performance in the clinical workplace. Differences between experienced and non-experienced raters were assessed with respect to time spent on information analysis and representation of trainee performance; performance scores; and information processing--using qualitative-based quantitative analysis of verbal data. Results showed expert-novice differences in time needed for representation of trainee performance, depending on complexity of the rating task. Experts paid more attention to situation-specific cues in the assessment context and they generated (significantly) more interpretations and fewer literal descriptions of observed behaviors. There were no significant differences in rating scores. Overall, our findings seemed to be consistent with other findings on expertise research, supporting theories underlying cognition-based models of assessment in the clinical workplace. Implications for WBA are discussed.

Background: Feedback to aid teachers in improving their teaching requires validated evaluation instruments. When implementing an evaluation instrument in a different context, it is important to collect validity evidence from multiple sources., Aim: We examined the validity and reliability of the Maastricht Clinical Teaching Questionnaire (MCTQ) as an instrument to evaluate individual clinical teachers during short clinical rotations in veterinary education., Methods: We examined four sources of validity evidence: (1) Content was examined based on theory of effective learning. (2) Response process was explored in a pilot study. (3) Internal structure was assessed by confirmatory factor analysis using 1086 student evaluations and reliability was examined utilizing generalizability analysis. (4) Relations with other relevant variables were examined by comparing factor scores with other outcomes., Results: Content validity was supported by theory underlying the cognitive apprenticeship model on which the instrument is based. The pilot study resulted in an additional question about supervision time. A five-factor model showed a good fit with the data. Acceptable reliability was achievable with 10-12 questionnaires per teacher. Correlations between the factors and overall teacher judgement were strong., Conclusions: The MCTQ appears to be a valid and reliable instrument to evaluate clinical teachers' performance during short rotations.

Background: It is often assumed that the way teachers approach their teaching is determined by the way they think about learning. This study explores how teachers of an undergraduate medical programme (UMP) think about learning, how they approach teaching and whether their conceptions of learning relate to their teaching approaches., Methods: Quantitative data of academic teachers involved in the undergraduate programme in medicine were collected and analysed. We used a questionnaire designed to measure teachers' conceptions of their own learning (COL) and of student learning as well as teachers' approaches to teaching (AT)., Results: Teachers of the medical undergraduate programme hold a variety of COL, of how students learn and their AT. No significant correlations were found between teachers' conceptions of learning and their AT., Conclusions: Although UMP teachers' ideas on learning and teaching are very diverse, some of their conceptions are interrelated. Teachers' ideas on their own learning is sometimes - but not always - related to how they think about student learning. But most importantly, the way UMP teachers think about learning is not automatically converted into the way they approach teaching.

Purpose: Clinical teaching's importance in the medical curriculum has led to increased interest in its evaluation. Instruments for evaluating clinical teaching must be theory based, reliable, and valid. The Maastricht Clinical Teaching Questionnaire (MCTQ), based on the theoretical constructs of cognitive apprenticeship, elicits evaluations of individual clinical teachers' performance at the workplace. The authors investigated its construct validity and reliability, and they used the underlying factors to test a causal model representing effective clinical teaching., Method: Between March 2007 and December 2008, the authors asked students who had completed clerkship rotations in different departments of two teaching hospitals to use the MCTQ to evaluate their clinical teachers. To establish construct validity, the authors performed a confirmatory factor analysis of the evaluation data, and they estimated reliability by calculating the generalizability coefficient and standard error measurement. Finally, to test a model of the factors, they fitted a structural linear model to the data., Results: Confirmatory factor analysis yielded a five-factor model which fit the data well. Generalizability studies indicated that 7 to 10 student ratings can produce reliable ratings of individual teachers. The hypothesized structural linear model underlined the central roles played by modeling and coaching (mediated by articulation)., Conclusions: The MCTQ is a valid and reliable evaluation instrument, thereby demonstrating the usefulness of the cognitive apprenticeship concept for clinical teaching during clerkships. Furthermore, a valuable model of clinical teaching emerged, highlighting modeling, coaching, and stimulating students' articulation and exploration as crucial to effective teaching at the clinical workplace.

Introduction: Models for training urological procedures without burdening patients are available at varying costs. We examined the value of training on a low-fidelity model in addition to training on a high-fidelity simulator in a cystoscopy training program., Methods: Thirty-two medical students were randomized to an intervention and a control group. The former started by performing cystoscopy on a low-cost, low-fidelity, glass globe model before moving on to training on the URO Mentor (UM), a computerized simulator. The control group took part in the same UM training program but not in the low-fidelity training. Performance on UM was assessed by a global rating score, percentage of correctly inspected areas of the bladder (% inspected areas), time, and number of traumas caused., Results: The intervention group had generally higher scores. Its global rating score on task 1 was significantly higher than that of the control group (Mann-Whitney U test, P = 0.046, effect size 0.6) and the group also scored higher, albeit not significantly, on time and % inspected areas. All students said they valued training with UM, but the appreciation of the intervention group was stronger (mean 8.9 vs. 8.1 on a scale from 1 to 10, P = 0.017, effect size 1.8)., Conclusion: A low-fidelity glass globe model seemed to be an inexpensive educational tool to practice the first steps of cystoscopy. It may reduce training time on the UM simulator. The combined use of a low- and high-fidelity training model may provide an optimal learning effect.

Objective: To assess whether real-time cysto-urethroscopy (CUS) performance improves by simulator-based training (criterion or predictive validity), addressing the research question 'Does practical skills training on the URO Mentor (UM, Simbionix USA Corp., Cleveland, OH, USA) virtual-reality simulator improve the performance of flexible CUS in patients'., Subjects and Methods: Participants (71 interns from Catharina Hospital Eindhoven, CHE, and 29 from University Medical Centre Groningen, UMCG) were randomized to carry out CUS in a patient after training on the UM (UM-trained, 50) or without training on UM (control, 50). The assessment of real-time performance consisted of scoring on a Global Rating Scale (GRS) by supervisors unaware of training status. Data were analysed using stepwise multiple linear regression. The effect size (ES) indication for correlations was used to interpret the magnitude of a standard regression coefficient (beta); an ES of 0.10, 0.30 and 0.50 were considered small, moderate and large, respectively. The study was approved by the Medical Review Ethics Committees of the participating hospitals., Results: Overall, the group that received training performed significantly better than the controls (P < or = 0.003, beta range 0.30-0.47). There was no effect of training for participants with a specific preference for a surgical speciality in two of five GRS scores. Participants from CHE obtained higher GRS 3 scores than those from UMCG. Significantly more UMCG trainees indicated having had stress than those from CHE (P < 0.001)., Conclusions: The results showed that interns who had trained on UM outperformed controls for a CUS procedure in a patient. Training for CUS on the UM is to be recommended for learning to respect tissue, procedural knowledge, flow of procedure and forward planning. Use of the UM to train interns with a specific interest in a surgical speciality in handling instruments, and time and motion, seems to be of limited value.

Objective: The goal was to determine whether the diagnostic accuracy of nonexperts in selected learning environments would improve with the use of patient video cases (PVCs)., Methods: We designed a stepwise, team-based, learning approach with a (1) text-based patient presentation, (2) first review of a PVC, (3) small-group discussion, (4) second review of a PVC, and (5) large-group discussion and listening to think-aloud modeling by a content expert. Four pediatric neurology PVCs were analyzed by 44 physicians. After each step, the diagnostic accuracy was assessed with a questionnaire with open-ended questions measuring the frequency of relevant diagnoses and clinical diagnostic reasoning processes., Results: The first review of the PVC was followed by a large number of relevant clinical diagnostic reasoning processes. Small-group discussions and listening to a think-aloud procedure with an expert were particularly effective in increasing the diagnostic accuracy of the nonexperts., Conclusions: The diagnostic accuracy of nonexperts was clearly enhanced by interaction in small-group discussions and subsequent listening to a think-aloud procedure with a content expert. Learning through PVCs in clinical settings thus is improved through the interactive participation of junior and senior clinicians. Such an environment (a "virtual examination room") may be introduced at grand rounds, case conferences, or morning rounds, to stimulate the development of diagnostic accuracy in nonexperts.

Background: Medical students increasingly participate in rotations in primary care settings, such as general practices. Although general practices can differ markedly from hospital settings, research on the instructional quality of general practice rotations is relatively scarce., Aim: We conducted a study to identify which aspects make a significant contribution to the instructional quality of general practice clerkships, as perceived by students., Method: After completing their general practice attachment, 155 fifth-year medical students filled out an evaluation questionnaire. Exploratory factor analysis and reliability analysis identified clusters of correlated independent variables. Subsequent regression analysis revealed the relations between the reduced set of independent variables and the dependent variable 'Instructional quality'., Results: Both the quality of supervision and the size and diversity of the patient mix substantially affected students' experienced instructional quality. Opportunities and facilities to perform independently were correlated with instructional quality, but did not affect the instructiveness directly., Conclusions: Supervision, patient mix and independence are crucial factors for learning in general practice. This is consistent with findings in hospital settings. The perceived quality of instruction hinges on supervision, which is not only the variable most strongly related to instructional quality, but which also affects both the patient mix and students' independence.

The potential richness of the feedback for learners and teachers is one of the educational advantages of progress tests (PTs). Every test administration yields information on a student's knowledge level in each sub-domain of the test (cross-sectional information), and it adds a next point to the corresponding knowledge growth curve (longitudinal information). Traditional paper-based feedback has severe limitations and requires considerable effort from the learners to give meaning to the data. We reasoned that the PT data should be flexibly accessible in all pathways and with any available comparison data, according to the personal interest of the learner. For that purpose, a web-based tool (Progress test Feedback, the ProF system) was developed. This article presents the principles and features of the generated feedback and shows how it can be used. In addition to enhancement of the feedback, the ProF database of longitudinal PT-data also provides new opportunities for research on knowledge growth, and these are currently being explored.

Objective: To assess the construct validity of the URO Mentor (Simbionix Corp., Cleveland, OH, USA) virtual reality training model for several variables of skills training in cysto-urethroscopy, addressing two research questions: (i) Does training on the URO Mentor significantly improve novices' performance in terms of time, trauma, areas inspected and Global Rating Scale (GRS) score?; (ii) is discrimination between different levels of expertise possible using the URO Mentor?, Methods: Thirty experts and 50 novices performed seven tasks on the URO Mentor during one training session. The first, fourth and seventh tasks were 'test tasks' to evaluate participants' performance. The simulator recorded procedure time and trauma; a supervisor scored which areas were inspected and gave scores on the GRS. A two-way analysis of variance with repeated-measures test was used to analyse experts' and novices' performances, with P < 0.05 considered to indicate statistical significance. Effect sizes (ES) were calculated to quantify the practical significance of the results; ES of 0.10, 0.30, and 0.50 were considered small, medium and large, respectively., Results: Novices' performances showed a significant improvement with large ES in time (linear trend of learning curve P < 0.001, ES 0.66) and mean GRS score (linear trend P < 0.001, ES 0.84, quadratic trend P = 0.018, ES 0.24). There was a medium improvement for trauma (linear trend P < 0.001, ES 0.40) and a small improvement in areas inspected (linear trend P = 0.032, ES 0.21). That the 95% confidence intervals of the measures on the first task of experts and novices did not coincide indicates that differentiation between experts and novices on the four variables measured can be achieved using the URO Mentor., Conclusions: Training on the URO Mentor appears to result in a medium to large improvement of novices' performances for time, trauma, areas inspected and GRS scores. Moreover, discrimination between different levels of expertise is possible using this simulator.

Background: A portfolio is used to mentor and assess students' clinical performance at the workplace. However, students and raters often perceive the portfolio as a time-consuming instrument., Purpose: In this study, we investigated whether assessment during medical internship by a portfolio can combine reliability and feasibility., Methods: The domain-oriented reliability of 61 double-rated portfolios was measured, using a generalisability analysis with portfolio tasks and raters as sources of variation in measuring the performance of a student., Results: We obtained reliability (Phi coefficient) of 0.87 with this internship portfolio containing 15 double-rated tasks. The generalisability analysis showed that an acceptable level of reliability (Phi = 0.80) was maintained when the amount of portfolio tasks was decreased to 13 or 9 using one and two raters, respectively., Conclusions: Our study shows that a portfolio can be a reliable method for the assessment of workplace learning. The possibility of reducing the amount of tasks or raters while maintaining a sufficient level of reliability suggests an increase in feasibility of portfolio use for both students and raters.

Introduction: This study investigates the effects of working face to face in small groups on the processes that occur when students elaborate on computer-based simulated cases., Methods: We performed a randomized controlled experiment that was designed to measure the effect of "social context" (triads versus individuals) on students' perceptions of the elaboration process and on the time spent on the different parts of the computer case. We sought students' perceptions using a questionnaire that was administered to all participating students (N = 47) and we examined the actions of the students working in triads (N = 12) and individually (N = 11) by analyzing the log files of the computer case., Results: The results demonstrated no significant effect of social context on the degree of elaboration of the computer case., Conclusions: Working with computer-based simulated cases in small groups as opposed to individually in itself is not enough to increase the scope and depth of the elaboration of computer cases.

Background: Changing concepts of education have led many medical schools to adopt student-centred approaches to teaching, requiring different teaching competencies than more traditional approaches., Aims: The aim of this study was to investigate whether participation in a faculty development (FD) programme had a positive effect on veterinary medical teachers' perceptions of their competence in seven different teaching roles., Method: All teaching staff of a veterinary medical school (251) were invited to complete a questionnaire asking about their perceived competence in seven teaching roles. A stepwise multiple linear regression analysis examined the effect of the completion of a FD programme on perceived teaching competence., Results: There was a significant positive effect of the FD programme on teachers' perceived competence in majority of the teaching roles at issue., Conclusions: FD appeared to have a positive effect on the perceived competence of veterinary medical teachers. Further research should investigate whether FD actually results in improved teaching performance.

In a previous study, we established that compared to a written case, a video case enhances observable cognitive processes in the verbal interaction in a postgraduate problem-based learning format. In a new study we examined non-observable cognitive processes using a stimulated recall procedure alongside a reanalysis of the data from the first study. We examined the development of shared cognition as reflected in collaborative concept link formation, an approach to connecting a series of concepts related to a particular topic. Eleven paediatric residents were randomly allocated to two groups. After both analysing the same written case vignette, one group watched a video of the case in the vignette and the other group read a written description of the video. Both groups then reanalysed the vignette. After the group sessions, time-logged transcripts were made of the verbal interaction in both groups and all residents individually took part in a stimulated recall procedure. Causal reasoning concept links were labelled as individual or collaborative depending on whether they originated from individual residents or were directly elicited by verbal utterances from others. The video led to a significantly increased frequency ratio (after intervention: before intervention) of collaborative concept links but did not affect the frequency of individual concept links. This novel process approach to chronological registration of concept link formation offered additional evidence that shared cognition by means of co-elaboration of concept formation is stimulated by the use of patient video recordings in small group learning.