Search

Context A challenge for medical educators is to better understand the personal factors that lead to individual success in medical school and beyond. Recently, educational researchers in fields outside medicine have acknowledged the importance of motivation and emotion in students' learning and performance. These affective factors have received less emphasis in the medical education literature. Objectives This longitudinal study examined the relations between medical students' motivational beliefs (task value and self-efficacy), achievement emotions (enjoyment, anxiety and boredom) and academic achievement. Methods Second-year medical students (n = 136) completed motivational beliefs and achievement emotions surveys following their first and second trimesters, respectively. Academic achievement was operationalised as students' average course examination grades and national board shelf examination scores. Results The results largely confirmed the hypothesised relations between beliefs, emotions and achievement. Structural equation modelling revealed that task value beliefs were positively associated with course-related enjoyment (standardised regression coefficient [?] = 0.59) and were negatively related to boredom (? = - 0.25), whereas self-efficacy beliefs were negatively associated with course-related anxiety only (? = - 0.47). Furthermore, student enjoyment was positively associated with national board shelf examination score (? = 0.31), whereas anxiety and boredom were both negatively related to course examination grade (? = - 0.36 and - 0.27, respectively). The overall structural model accounted for considerable variance in each of the achievement outcomes: R2 = 0.20 and 0.14 for the course examination grade and national board shelf examination score, respectively. Conclusions This study suggests that medical students' motivational beliefs and achievement emotions are important contributors to their academic achievement. These results have implications for medical educators striving to understand the personal factors that influence learning and performance in medical training. [ABSTRACT FROM AUTHOR]

Background: Physicians and physicians-in-training have repeatedly demonstrated poor accuracy of global self-assessments, which are assessments removed from the context of a specific task, regardless of any intervention. Self-monitoring, an in-the-moment self-awareness of one's performance, offers a promising alternative to global self-assessment. The purpose of this scoping review is to better understand the state of self-monitoring in graduate medical education., Methods: We performed a scoping review following Arksey and O'Malley's six steps: identifying a research question, identifying relevant studies, selecting included studies, charting the data, collating and summarising the results and consulting experts. Our search queried Ovid Medline, Web of Science, PsychINFO, Eric and EMBASE databases from 1 January 1999 to 12 October 2022., Results: The literature search yielded 5363 unique articles. The authors identified 77 articles for inclusion. The search process helped create a framework to identify self-monitoring based on time and context dependence. More than 20 different terms were used to describe self-monitoring, and only 13 studies (17%) provided a definition for the equivalent term. Most research focused on post-performance self-judgements of a procedural skill (n = 31, 42%). Regardless of task, studies focused on self-judgement (n = 66, 86%) and measured the accuracy or impact on performance of self-monitoring (n = 41, 71%). Most self-monitoring was conducted post-task (n = 65, 84%)., Conclusion: Self-monitoring is a time- and context-dependent phenomenon that seems promising as a research focus to improve clinical performance of trainees in graduate medical education and beyond. The landscape of current literature on self-monitoring is sparse and heterogeneous, suffering from a lack of theoretical underpinning, inconsistent terminology and insufficiently clear definitions., (© 2023 Association for the Study of Medical Education and John Wiley & Sons Ltd. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.)

Introduction: Optimising the use of subjective human judgement in assessment requires understanding what makes judgement fair. Whilst fairness cannot be simplistically defined, the underpinnings of fair judgement within the literature have been previously combined to create a theoretically-constructed conceptual model. However understanding assessors' and learners' perceptions of what is fair human judgement is also necessary. The aim of this study is to explore assessors' and learners' perceptions of fair human judgement, and to compare these to the conceptual model., Methods: A thematic analysis approach was used. A purposive sample of twelve assessors and eight post-graduate trainees undertook semi-structured interviews using vignettes. Themes were identified using the process of constant comparison. Collection, analysis and coding of the data occurred simultaneously in an iterative manner until saturation was reached., Results: This study supported the literature-derived conceptual model suggesting fairness is a multi-dimensional construct with components at individual, system and environmental levels. At an individual level, contextual, longitudinally-collected evidence, which is supported by narrative, and falls within ill-defined boundaries is essential for fair judgement. Assessor agility and expertise are needed to interpret and interrogate evidence, identify boundaries and provide narrative feedback to allow for improvement. At a system level, factors such as multiple opportunities to demonstrate competence and improvement, multiple assessors to allow for different perspectives to be triangulated, and documentation are needed for fair judgement. These system features can be optimized through procedural fairness. Finally, appropriate learning and working environments which considers patient needs and learners personal circumstances are needed for fair judgments., Discussion: This study builds on the theory-derived conceptual model demonstrating the components of fair judgement can be explicitly articulated whilst embracing the complexity and contextual nature of health-professions assessment. Thus it provides a narrative to support dialogue between learner, assessor and institutions about ensuring fair judgements in assessment., (© 2021 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Context: Language is one of the primary modalities for teaching and learning in the health professions in contexts ranging from the more formal teaching relationships of medical school to the guided practice of trainees through continuing education and the deliberate practice of lifelong learning. Yet linguistic analysis, with the possible exception of discourse analysis, has not become a core methodological tool in the field of health professions education (HPE). The purpose of this paper is to argue for the more widespread adoption of one particular approach to linguistics, one that examines less of what learners and instructors say and looks more at how they say it: functional linguistics., Functional Linguistics: THE POWER OF 'STEALTH WORDS': This approach theorises and structures the functions of language, regularly focusing attention on 'stealth words' such as I, but and was. Drawing on a rich body of literature in linguistics, psychology, the learning sciences and some early work in HPE, we demonstrate how functional linguistic tools can be applied to better understand learners' and instructors' beliefs, reasoning processes, values and emotions., Functional Linguistics and Reflection: AN APPLICATION OF STEALTH WORDS: A brief qualitative analysis of one tool - analysis of the generic use of 'you' to mean 'one' or 'anyone' - demonstrates how functional linguistics can offer insight into physicians' bids for credibility and alignment as they think aloud about their clinical reasoning., Functional Linguistics and Hpe: FUTURE DIRECTIONS: Finally, we offer suggestions for how functional linguistic tools might address questions and gaps in four active research areas in HPE: reflection; emotion and reasoning; learning in simulated contexts, and self-regulated learning., Conclusions: We argue that the words used by learners, instructors and practitioners in the health professions as they move through undergraduate and graduate training into practice can offer clues that will help researchers, instructors and colleagues to better support them., (© 2019 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Objectives: This paper reviews why tensions between service and education persist and highlights that this is an area of medical education research (MER) that, to date, lacks a robust body of theory-driven research. After carrying out a review of the literature on service-education tensions in medical education and training, we turn to consider how theory can help provide new insights into service-education tensions., Methods: We conducted a search of the literature on service-education tensions since 1998 to examine the use of theory in studies on this topic., Results: We identified 44 out of 603 relevant papers. Their focus fell into four broad categories: time residents spent on 'service' and 'education'; perceptions of the balance between service and education; considerations of how best to define service and education, and the impact of structural and systems changes on education/training. Of the papers reporting primary research, the dominant methodology was the bespoke survey. Rarely were the precise natures of tensions or how different factors interact to cause tensions examined in detail., Discussion: Through discussion and reflection, we then agreed on the applicability of four sociocultural theories for illuminating some examples of service-education tensions. We present four sociocultural theories: Holland's figured worlds, Kemmis et al.'s practice architectures, Lave and Wenger's situated learning and Engeström's cultural-historical activity theory (CHAT or AT). We describe each and then briefly illustrate how each theory can support new ways of thinking and potential directions for research focusing on education-service tensions., Conclusions: The use of theory in research studies will not resolve service-education tensions. However, what theory can do is illuminate and magnify different aspects of service-education tensions, to generate new insight and knowledge that can then be used to inform future research and changes in practice., (© 2018 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Context: As the practice of medicine evolves, the knowledge, skills and attitudes required to provide patient care will continue to change. These competency-based changes will necessitate the restructuring of assessment systems. High-quality assessment programmes are needed to fulfil health professions education's contract with society., Objectives: We discuss several issues that are important to consider when developing assessments in health professions education. We organise the discussion along the continuum of medical education, outlining the tension between what has been deemed important to measure and what should be measured. We also attempt to alleviate some of the apprehension associated with measuring evolving competencies by discussing how emerging technologies, including simulation and artificial intelligence, can play a role., Methods: We focus our thoughts on the assessment of competencies that, at least historically, have been difficult to measure. We highlight several assessment challenges, discuss some of the important issues concerning the validity of assessment scores, and argue that medical educators must do a better job of justifying their use of specific assessment strategies., Discussion: As in most professions, there are clear tensions in medicine in relation to what should be assessed, who should be responsible for administering assessment content, and how much evidence should be gathered to support the evaluation process. Although there have been advances in assessment practices, there is still room for improvement. From the student's, resident's and practising physician's perspectives, assessments need to be relevant. Knowledge is certainly required, but there are other qualities and attributes that are important, and perhaps far more important. Research efforts spent now on delineating what makes a good physician, and on aligning new and upcoming assessment tools with the relevant competencies, will ensure that assessment practices, whether aimed at establishing competence or at fostering learning, are effective with respect to their primary goal: to produce qualified physicians., (© 2018 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Context: Clinical-vignette multiple choice question (MCQ) examinations are used widely in medical education. Standardised MCQ examinations are used by licensure and certification bodies to award credentials that are meant to assure stakeholders as to the quality of physicians. Such uses are based on the interpretation of MCQ examination performance as giving meaningful information about the quality of clinical reasoning. There are several assumptions foundational to these interpretations and uses of standardised MCQ examinations. This study explores the implicit assumption that cognitive processes elicited by clinical-vignette MCQ items are like the processes thought to occur with 'real-world' clinical reasoning as theorised by dual-process theory., Methods: Fourteen participants (three medical students, five residents and six staff physicians) completed three sets of five timed MCQ items (total 15) from the Medical Knowledge Self-Assessment Program (MKSAP). Upon answering a set of MCQs, each participant completed a retrospective think aloud (TA) protocol. Using constant comparative analysis (CCA) methods sensitised by dual-process theory, we performed a qualitative thematic analysis., Results: Examinee behaviours fell into three categories: clinical reasoning behaviours, test-taking behaviours and reactions to the MCQ. Consistent with dual-process theory, statements about clinical reasoning behaviours were divided into two sub-categories: analytical reasoning and non-analytical reasoning. Each of these categories included several themes., Conclusions: Our study provides some validity evidence that test-takers' descriptions of their cognitive processes during completion of high-quality clinical-vignette MCQs align with processes expected in real-world clinical reasoning. This supports one of the assumptions important for interpretations of MCQ examination scores as meaningful measures of clinical reasoning. Our observations also suggest that MCQs elicit other cognitive processes, including certain test-taking behaviours, that seem 'inauthentic' to real-world clinical reasoning. Further research is needed to explore if similar themes arise in other contexts (e.g. simulated patient encounters) and how observed behaviours relate to performance on MCQ-based assessments., (Published 2017. This article is a U.S. Government work and is in the public domain in the USA.)

Context: Although health professions education scholarship units (HPESUs) share a commitment to the production and dissemination of rigorous educational practices and research, they are situated in many different contexts and have a wide range of structures and functions., Objectives: In this study, the authors explore the institutional logics common across HPESUs, and how these logics influence the organisation and activities of HPESUs., Methods: The authors analysed interviews with HPESU leaders in Canada (n = 12), Australia (n = 21), New Zealand (n = 3) and the USA (n = 11). Using an iterative process, they engaged in inductive and deductive analyses to identify institutional logics across all participating HPESUs. They explored the contextual factors that influence how these institutional logics impact each HPESU's structure and function., Results: Participants identified three institutional logics influencing the organisational structure and functions of an HPESU: (i) the logic of financial accountability; (ii) the logic of a cohesive education continuum, and (iii) the logic of academic research, service and teaching. Although most HPESUs embodied all three logics, the power of the logics varied among units. The relative power of each logic influenced leaders' decisions about how members of the unit allocate their time, and what kinds of scholarly contribution and product are valued by the HPESU., Conclusions: Identifying the configuration of these three logics within and across HPESUs provides insights into the reasons why individual units are structured and function in particular ways. Having a common language in which to discuss these logics can enhance transparency, facilitate evaluation, and help leaders select appropriate indicators of HPESU success., (© 2017 John Wiley & Sons Ltd and The Association for the Study of Medical Education.)

Objectives: The primary objectives of this study were to examine the regulatory processes of medical students as they completed a diagnostic reasoning task and to examine whether the strategic quality of these regulatory processes were related to short-term and longer-term medical education outcomes., Methods: A self-regulated learning (SRL) microanalytic assessment was administered to 71 second-year medical students while they read a clinical case and worked to formulate the most probable diagnosis. Verbal responses to open-ended questions targeting forethought and performance phase processes of a cyclical model of SRL were recorded verbatim and subsequently coded using a framework from prior research. Descriptive statistics and hierarchical linear regression models were used to examine the relationships between the SRL processes and several outcomes., Results: Most participants (90%) reported focusing on specific diagnostic reasoning strategies during the task (metacognitive monitoring), but only about one-third of students referenced these strategies (e.g. identifying symptoms, integration) in relation to their task goals and plans for completing the task. After accounting for prior undergraduate achievement and verbal reasoning ability, strategic planning explained significant additional variance in course grade (ΔR(2 ) = 0.15, p < 0.01), second-year grade point average (ΔR(2) = 0.14, p < 0.01), United States Medical Licensing Examination Step 1 score (ΔR(2) = 0.08, p < 0.05) and National Board of Medical Examiner subject examination score in internal medicine (ΔR(2) = 0.10, p < 0.05)., Conclusions: These findings suggest that most students in the formative stages of learning diagnostic reasoning skills are aware of and think about at least one key diagnostic reasoning process or strategy while solving a clinical case, but a substantially smaller percentage set goals or develop plans that incorporate such strategies. Given that students who developed more strategic plans achieved better outcomes, the potential importance of forethought regulatory processes is underscored., (Published 2014. This article is a U.S. Government work and is in the public domain in the USA. Medical Education published by John Wiley & Sons Ltd.)

Objectives: This study was conducted to assess the associations between several clerkship process measures and students' clinical and examination performance in an internal medicine clerkship., Methods: We collected data from the internal medicine clerkship at one institution over a 3-year period (classes of 2010-2012; n = 507) and conducted correlation and multiple regression analyses. We examined the associations between clerkship process measures (student-reported number of patients evaluated, percentage of core problems encountered, total number of core problems encountered, total number of clinics attended) and four clerkship outcomes (clinical points [a weighted summation of a student's clinical grade recommendations], ambulatory clinical points [the out-patient portion of clinical points], examination points [a weighted summation of scores on three clerkship examinations], and National Board of Medical Examiners examination score)., Results: After controlling for pre-clerkship ability and gender, percentage of core problems was significantly associated with ambulatory clinical points (b = 3.84, total model R(2) = 0.14). Further, number of patients evaluated was significantly associated with clinical points (b = 0.19, total model R(2) = 0.22), but only for students who undertook first-quarter clerkships, who reported higher numbers of patients., Conclusions: Notwithstanding a few positive (but small) associations, the results from this study suggest that clinical exposure is, at best, weakly associated with internal medicine clerkship performance., (© Blackwell Publishing Ltd 2012.)

Context: Performance-based workplace assessments are increasingly important in clinical training. Given the inaccuracy of self-assessment, the provision of external feedback to residents about their clinical skills is necessary for the development of expertise. However, little is known about the processes used by faculty members in giving feedback to residents after observing them with patients. This study explores the factors that underpin faculty members' decisions regarding the feedback they give to residents after directly observing them with patients and the factors that influence how feedback is delivered., Methods: In 2009, 44 general internal medicine faculty staff responsible for out-patient resident teaching from 16 internal medicine residency programmes watched four videotaped scenarios and two live scenarios of standardised residents (SRs) with standardised patients and rated the SRs using the mini-clinical evaluation exercise (mini-CEX) format. Faculty staff also provided feedback to the SRs after the live encounters. After each encounter, faculty staff were individually interviewed using a semi-structured interview. Interviews were videotaped, transcribed and analysed using grounded theory methods., Results: Two broad themes were identified in faculty members' descriptions of the feedback process: variability in feedback techniques, and the factors that influence how faculty staff think and feel about delivering feedback. Multiple approaches to feedback delivery were observed. Faculty members' tensions in balancing positive and negative feedback, their own perceived self-efficacy, their perceptions of the resident's insight, receptivity, skill and potential, the faculty member-resident relationship and contextual factors impacted the feedback process., Conclusions: The provision of feedback by faculty staff to residents after observing resident-patient interactions is a complex and dynamic process and is influenced by many factors. Understanding these cognitive and affective factors may provide insight into potential new approaches to faculty development to improve faculty staff's feedback skills and the effectiveness of their feedback., (© Blackwell Publishing Ltd 2012.)

Context: Medical school admissions committees attempt to select the most qualified applicants. In addition to traditional performance measures, committees often look favourably upon applicants who report previous clinical experience., Objectives: This study aimed to determine if self-reported clinical experience is a valid indicator of future performance in medical school and internship., Methods: We collected data for seven year groups (1993-1999; n = 1112) and operationalised trainee performance in terms of five outcomes: cumulative medical school grade point average (GPA); US Medical Licensing Examination (USMLE) Step 1 and 2 scores, and scores on a validated programme director's evaluation measuring intern expertise and professionalism. We then conducted a series of analyses of covariance to compare outcomes in applicants who self-reported previous clinical experience with outcomes in those who did not. In these analyses, the independent variable was self-reported clinical experience (yes/no), the covariate was undergraduate GPA, and the dependent variables were the five performance outcomes., Results: In four of five analyses, we found no differences in the performance of the two groups (clinical experience versus no clinical experience). However, on the cumulative medical school GPA outcome, applicants who reported previous clinical experience had statistically significantly lower cumulative GPAs upon graduation than those who did not report such experience (F(1,940) = 9.35, p = 0.002, partial η(2) = 0.01 [small effect size])., Conclusions: Our results suggest that applicants who self-report previous clinical experience may not be better candidates. In fact, on some measures of performance, these applicants may actually perform worse than those who report no clinical experience., (© Blackwell Publishing Ltd 2012.)

Objectives: This study aimed to investigate the relationship between the authenticity of instructional formats and outcome measures within a pre-clerkship clinical reasoning course., Methods: We conducted a randomised, prospective, crossover study with Year 2 medical students taking a pre-clerkship clinical reasoning course. Students were randomised to small groups and exposed to three formats of differing instructional authenticity (paper case, DVD presentation, standardised patient [SP] presentation) across three subject areas (abdominal pain, anaemia, polyuria). Three student cohorts were taught using one instructional format per subject area so that each cohort received a different instructional format for each of the three subject areas. Outcome measures (objective structured clinical examination, video quiz, written examination) were selected to determine the effect of each instructional format on the clinical reasoning of students., Results: Increasingly authentic instructional formats did not significantly improve clinical reasoning performance across all outcome measures and subject areas. However, the results of the video quiz showed significant differences in the anaemia subject area between students who had been instructed using the paper case and live SP-based formats (scores of 47.4 and 57.6, respectively; p = 0.01) and in the abdominal pain subject area, in which students instructed using the DVD format scored higher than students instructed using either the paper case or SP-based formats (scores of 41.6, 34.9 and 31.2, respectively; p=0.002)., Conclusions: Increasing the authenticity of instructional formats does not appear to significantly improve clinical reasoning performance in a pre-clerkship course. Medical educators should balance increases in authenticity with factors such as cognitive load, subject area and learner experience when designing new instructional formats., (© Blackwell Publishing Ltd 2011.)

Context: The practice of medicine involves many stakeholders (or participant groups such as patients, doctors and trainees). Based on their respective goals, perceptions and understandings, and on what is being measured, these stakeholders may have dramatically different viewpoints of the same event. There are many ways to characterise what occurred in a clinical encounter; these include an oral presentation (faculty perspective), a written note (trainee perspective), and the patient's perspective. In the present study, we employed two established theories as frameworks with the purpose of assessing the extent to which different views of the same clinical encounter (a three-component, Year 2 medical student objective structured clinical examination [OSCE] station) are similar to or differ from one another., Methods: We performed univariate comparisons between the individual items on each of the three components of the OSCE: the standardised patient (SP) checklist (patient perspective); the post-encounter form (trainee perspective), and the oral presentation rating form (faculty perspective). Confirmatory factor analysis (CFA) of the three-component station was used to assess the fit of the three-factor (three-viewpoint) model. We also compared tercile performance across these three views as a form of extreme groups analysis., Results: Results from the CFA yielded a measurement model with reasonable fit. Moderate correlations between the three components of the station were observed. Individual trainee performance, as measured by tercile score, varied across components of the station., Conclusions: Our work builds on research in fields outside medicine, with results yielding small to moderate correlations between different perspectives (and measurements) of the same event (SP checklist, post-encounter form and oral presentation rating form). We believe obtaining multiple perspectives of the same encounter provides a more valid measure of a student's clinical performance., (© Blackwell Publishing Ltd 2010.)