Search

Background: Robust and defensible clinical assessments attempt to minimise differences in student grades which are due to differences in examiner severity (stringency and leniency). Unfortunately there is little evidence to date that examiner training and feedback interventions are effective; "physician raters" have indeed been deemed "impervious to feedback". Our aim was to investigate the effectiveness of a general practitioner examiner feedback intervention, and explore examiner attitudes to this., Methods: Sixteen examiners were provided with a written summary of all examiner ratings in medical student clinical case examinations over the preceding 18 months, enabling them to identify their own rating data and compare it with other examiners. Examiner ratings and examiner severity self-estimates were analysed pre and post intervention, using non-parametric bootstrapping, multivariable linear regression, intra-class correlation and Spearman's correlation analyses. Examiners completed a survey exploring their perceptions of the usefulness and acceptability of the intervention, including what (if anything) examiners planned to do differently as a result of the feedback., Results: Examiner severity self-estimates were relatively poorly correlated with measured severity on the two clinical case examination types pre-intervention (0.29 and 0.67) and were less accurate post-intervention. No significant effect of the intervention was identified, when differences in case difficulty were controlled for, although there were fewer outlier examiners post-intervention. Drift in examiner severity over time prior to the intervention was observed. Participants rated the intervention as interesting and useful, and survey comments indicated that fairness, reassurance, and understanding examiner colleagues are important to examiners., Conclusions: Despite our participants being receptive to our feedback and wanting to be "on the same page", we did not demonstrate effective use of the feedback to change their rating behaviours. Calibration of severity appears to be difficult for examiners, and further research into better ways of providing more effective feedback is indicated.

Background: The transition from medical student to hospital-based first year junior doctor (termed "intern" in Australia) is known to be challenging, and recent changes in clinical learning environments may reduce graduate preparedness for the intern workplace. Although manageable challenges and transitions are a stimulus to learning, levels of burnout in junior medical colleagues are concerning. In order to prepare and support medical graduates, educators need to understand contemporary junior doctor perspectives on this transition., Methods: Final-year University of Queensland medical students recruited junior doctors working in diverse hospital settings, and videorecorded individual semi-structured interviews about their transition from medical student to working as a junior doctor. Two clinical academics (NS and JT) and an intern (ZT) independently conducted a descriptive analysis of interview transcripts, and identified preliminary emerging concepts and themes, before reaching agreement by consensus on the major overarching themes., Results: Three key themes emerged from the analysis of 15 interviews: internship as a "steep learning curve"; relationships and team; and seeking help. Participants described the intern transition as physically, mentally and emotionally exhausting. They learned to manage long days, administrative and clinical tasks, frequent interruptions and time pressures; identify priorities; deal with criticism without compromising key relationships; communicate succinctly; understand team roles (including their own status within hospital hierarchies); and negotiate conflict. Participants reported a drop in self-confidence, and difficulty maintaining self-care and social relationships. Although participants emphasised the importance of escalating concerns and seeking help to manage patients, they appeared more reluctant to seek help for personal issues and reported a number of barriers to doing so., Conclusion: Findings may assist educators in refining their intern preparation and intern training curricula, and ensuring that medical school and intern preparation priorities are not seen as competing. Insights from non-medical disciplines into the organisational and relational challenges facing junior doctors and their health-care teams may enhance inter-professional learning opportunities. Workplace support and teaching, especially from junior colleagues, is highly valued during the demanding intern transition.