Search

Context Thirty years ago, it was suggested in the Edinburgh Declaration that medical school applicants should be selected not only on academic, but also on non-academic, attributes. The main rationale behind extending medical school selection procedures with the evaluation of (non-academic) personal qualities is that this will lead to the selection of students who will perform better as a doctor than those who are selected on the basis of academic measures only. A second rationale is the expectation that this will lead to a representative health workforce as a result of reduced adverse impact. The aims of this paper are (i) to describe what can be learned about the use of selection criteria other than grades from over 15 years of Dutch experience and (ii) to summarise current knowledge on the issue of adverse impact in relation to non-grades-based selection. Methods A narrative review was undertaken of the (published) evidence that has resulted from non-grades-based school-specific selection procedures in the Netherlands and from recent explorations of the effect of the use of non-grades-based selection criteria on student diversity. Results The Dutch evidence is grouped into five key themes: the effect of participation in voluntary selection procedures, the assessment of pre-university extracurricular activities, the use of work samples, Dutch experiences with situational judgement tests and the effects of changing circumstances. This is followed by several lessons learned for medical schools that aim to increase their student diversity. Conclusion Over the last 30 years, important steps towards reliable and valid methods for measuring non-academic abilities have been taken. The current paper describes several lessons that can be learned from the steps taken in the Dutch context. The importance of sharing evidence gathered around the globe and building on this evidence to reach our goal of predicting who will be a good doctor is acknowledged. [ABSTRACT FROM AUTHOR]

Context Ethnic minority students find that their ethnicity negatively affects the evaluation of their capacities and their feelings in medical school. This study tests whether ethnic minority and majority students differ in their 'self‐regulatory focus' in clinical training, that is, their ways to approach goals, due to differences in social learning experiences. Self‐regulatory focus consists of a promotion and prevention focus. People who are prone to stereotypes and unfair treatments are more likely to have a prevention focus and conceal certain identity aspects. The objectives of the study are to test whether ethnic minority students, as compared with ethnic majority students, are equally likely to have a promotion focus, but more likely to have a prevention focus in clinical training due to more negative social learning experiences (Hypothesis 1), and whether the relationship between student ethnicity and clinical evaluations can be explained by students' gender, social learning experiences, self‐regulatory focus and impression management (Hypothesis 2). Methods: Survey and clinical evaluation data of 312 (71.2% female) clerks were collected and grouped into 215 ethnic majority (69.4%) and 95 ethnic minority students (30.6%). Students' social learning experiences were measured as perceptions of unfair treatment, trust in supervisors and social academic fit. Self‐regulatory focus (general and work specific) and impression management were also measured. A parallel mediation model (Hypothesis 1) and hierarchical multiple regression analyses were used (Hypothesis 2). Results: Ethnic minority students had higher perceptions of unfair treatment and lower trust in their supervisors in clinical training. They were more prevention focused in clinical training, but this was not mediated by having more negative social learning experiences. Lower clinical evaluations for ethnic minority students were unexplained. Promotion focus in clinical training and trust in supervisors positively relate to clinical grades. Conclusion: Student ethnicity predicts social learning experiences, self‐regulatory focus and grades in clinical training. The hidden curriculum plausibly plays a role here. van Andel et al. demonstrate that systematic differences between ethnic minority and majority students can be predicted based on social learning experiences, self‐regulatory focus and clinical grades. [ABSTRACT FROM AUTHOR]

Context Despite evidence for the predictive value of both pre-admission characteristics and past performance at medical school, their relative contribution to predicting medical school performance has not been thoroughly investigated. Objectives This study was designed to determine the relative importance of pre-admission characteristics and past performance in medical school in predicting student performance in pre-clinical and clinical training. Methods This longitudinal prospective study followed six cohorts of students admitted to a Dutch, 6-year, undergraduate medical course during 2002-2007 ( n = 2357). Four prediction models were developed using multivariate logistic regression analysis. Main outcome measures were 'Year 1 course completion within 1 year' (models 1a, 1b), 'Pre-clinical course completion within 4 years' (model 2) and 'Achievement of at least three of five clerkship grades of ≥ 8.0' (model 3). Pre-admission characteristics (models 1a, 1b, 2, 3) and past performance at medical school (models 1b, 2, 3) were included as predictor variables. Results In model 1a - including pre-admission characteristics only - the strongest predictor for Year 1 course completion was pre-university grade point average ( GPA). Success factors were 'selected by admission testing' and 'age > 21 years'; risk factors were 'Surinamese/Antillean background', 'foreign pre-university degree', 'doctor parent' and male gender. In model 1b, number of attempts and GPA at 4 months were the strongest predictors for Year 1 course completion, and male gender remained a risk factor. Year 1 GPA was the strongest predictor for pre-clinical course completion, whereas being male or aged 19-21 years were risk factors. Pre-clinical course GPA positively predicted clinical performance, whereas being non-Dutch or a first-generation university student were important risk factors for lower clinical grades. Nagelkerke's R2 ranged from 0.16 to 0.62. Conclusions This study not only confirms the importance of past performance as a predictor of future performance in pre-clinical training, but also reveals the importance of a student's background as a predictor in clinical training. These findings have important practical implications for selection and support during medical school. [ABSTRACT FROM AUTHOR]

Objectives This study was conducted to: (i) analyse whether students admitted to one medical school based on top pre-university grades, a voluntary multifaceted selection process, or lottery, respectively, differed in study performance; (ii) examine whether students who were accepted in the multifaceted selection process outperformed their rejected peers, and (iii) analyse whether participation in the multifaceted selection procedure was related to performance. Methods We examined knowledge test and professionalism scores, study progress and dropout in three cohorts of medical students admitted to the University of Groningen, the Netherlands in 2009, 2010 and 2011 ( n = 1055). We divided the lottery-admitted group into, respectively, students who had not participated and students who had been rejected in the multifaceted selection process. We used ancova modelling, logistic regression and Bonferroni post hoc multiple-comparison tests and controlled for gender and cohort. Results The top pre-university grade group achieved higher knowledge test scores and more Year 1 course credits than all other groups (p < 0.05). This group received the highest possible professionalism score more often than the lottery-admitted group that had not participated in the multifaceted selection process (p < 0.05). The group of students accepted in the multifaceted selection process obtained higher written test scores than the lottery-admitted group that had not participated (p < 0.05) and achieved the highest possible professionalism score more often than both lottery-admitted groups. The lottery-admitted group that had not participated in the multifaceted selection process earned fewer Year 1 and 2 course credits than all other groups (p < 0.05). Dropout rates differed among the groups (p < 0.05), but correction for multiple comparisons rendered all pairwise differences non-significant. Conclusions A top pre-university grade point average was the best predictor of performance. For so-called non-academic performance, the multifaceted selection process was efficient in identifying applicants with suitable skills. Participation in the multifaceted selection procedure seems to be predictive of higher performance. Further research is needed to assess whether our results are generalisable to other medical schools. [ABSTRACT FROM AUTHOR]

Medical Education 2011: 45: 987-994 Context Medical students often fail to finish medical school within the designated time. An academic dismissal (AD) policy aims to enforce satisfactory progress and to enable early identification and timely support or referral of struggling students. In this study, we assessed whether the implementation of an AD policy improved study progress in the first 2 years of medical school. Additionally, we analysed its effect on the help-seeking behaviour of struggling students. Methods We compared two AD cohorts (entering in 2005 and 2006, respectively) and two non-AD cohorts (entering in 2003 and 2004, respectively) on dropout rates, Year 1 curriculum completion rates and the percentage of students with an optimal study rate (i.e. all modules completed) at 1 and 2 years after enrolment. We also measured the effect on study progress of attending the support meetings offered. Results The AD ( n = 809) and non-AD cohorts ( n = 809) did not differ significantly in dropout rate at 5 months, in Year 1 completion rate at 2 years and in the percentage of optimally performing students at 1 year after enrolment. At 2 years after enrolment, more students from the AD cohorts had left and more non-AD students demonstrated optimal performance, but effect sizes (ESs) for these differences were small. Voluntary support at 4 months was attended by AD students more often than by non-AD students (68.9% versus 39.8%; χ2(1) = 43.95, p < 0.001, ES = 0.29). The AD students who attended the support meetings completed the Year 1 curriculum more often than those who did not (73.4% versus 52.5%; χ2(1) = 10.92, p < 0.001, ES = 0.20). Attending the obligatory support meeting at 7 months had a similar effect (70.5% versus 33.3%; χ2(1) = 13.60, p < 0.001, ES = 0.23). Conclusions The presence of an AD policy did not lead to earlier dropout, higher completion rates or an improved study rate during the first 2 years at medical school. However, uptake of the support offered increased to almost 70%. Although support participants finished the Year 1 curriculum more often than non-participants, the current support system was not sufficient to improve overall study progress. [ABSTRACT FROM AUTHOR]

Objective To determine the effectiveness of single-point benchmarking and longitudinal benchmarking for inter-school educational evaluation. Methods We carried out a mixed, longitudinal, cross-sectional study using data from 24 annual measurement moments (4 tests × 6 year groups) over 4 years for 4 annual progress tests assessing the graduation-level knowledge of all students from 3 co-operating medical schools. Participants included undergraduate medical students (about 5000) from 3 medical schools. The main outcome measures involved between-school comparisons of progress test results based on different benchmarking methods. Results Variations in relative school performance across different tests and year groups indicate instability and low reliability of single-point benchmarking, which is subject to distortions as a result of school-test and year group-test interaction effects. Deviations of school means from the overall mean follow an irregular, noisy pattern obscuring systematic between-school differences. The longitudinal benchmarking method results in suppression of noise and revelation of systematic differences. The pattern of a school’s cumulative deviations per year group gives a credible reflection of the relative performance of year groups. Conclusions Even with highly comparable curricula, single-point benchmarking can result in distortion of the results of comparisons. If longitudinal data are available, the information contained in a school’s cumulative deviations from the overall mean can be used. In such a case, the mean test score across schools is a useful benchmark for cross-institutional comparison. [ABSTRACT FROM AUTHOR]

A letter to the editor is presented in response to the article "Selection and Study Performance: Comparing Three Admission Processes Within One Medical School" by N.R. Schripsema, A.M. van Trigt, J.C.C. Borleffs, and J. Cohen-Schotanus in volume 48 of the periodical.