Search

BACKGROUND: Effective education of clinical skills is essential if doctors are to meet the needs of patients with rheumatic disease, but shrinking faculty numbers has made clinical teaching difficult. A solution to this problem is to utilize patient educators. PURPOSE: This study evaluates the teaching effectiveness of patient educators compared to rheumatology faculty using the musculoskeletal (MSK) examination. METHOD: Sixty-two 2nd-year medical students were randomized to receive instruction from patient educators or faculty. Tutorial groups received instructions during three, 3-hr sessions. Clinical skills were evaluated by a 9 station objective structured clinical examination. Students completed a tutor evaluation form to assess their level of satisfaction with the process. RESULTS: Faculty-taught students received a higher overall mark (66.5% vs. 62.1%,) and fewer failed than patient educator-taught students (5 vs. 0, p = 0.02). Students rated faculty educators higher than patient educators (4.13 vs. 3.58 on a 5-point Likert scale). CONCLUSION: Rheumatology faculty appear to be more effective teachers of the MSK physical exam than patient educators. [ABSTRACT FROM AUTHOR]

Background: Illness presenteeism (IP)-characterized by individuals working despite being sick-is a prevalent and complex phenomenon among physicians and trainees amidst competing priorities within medicine. The COVID-19 pandemic and growing attention to physician and trainee well-being have sparked renewed interest in IP. We conducted a scoping review to explore what is known about IP: more specifically, how IP is perceived, what approaches have been used to study the phenomenon and how it might have changed through the COVID-19 pandemic., Method: The Arksey and O'Malley scoping review framework was used to systematically select and summarize the literature. Searches were conducted across four databases: Medline, Embase, PsycInfo and Web of Science. Quantitative and thematic analyses were conducted., Results: Of 4277 articles screened, 45 were included. Of these, four were published after the onset of the COVID-19 pandemic. All studies framed IP as problematic for physicians, patients and health care systems. Dominant sociocultural drivers of IP included obligations towards patients and colleagues and avoiding the stigma of appearing vulnerable or even temporarily weak. Structural factors included heavy workload, poor access to health services and lack of sick leave policies for physicians. The pandemic does not appear to have affected IP-related causes or behaviours. Proposed solutions included both educational interventions and policy-driven changes., Conclusions: Despite being viewed in the literature as largely negative, IP remains highly prevalent among physicians and trainees. Our review highlights that IP among physicians is fraught with tensions: while IP seemingly contradicts certain priorities such as physician wellbeing, IP may be justified by fulfilling obligations to patients and colleagues. Future work should examine IP through diverse theoretical lenses to further elucidate its complexities and inform nuanced individual and systems-level interventions to minimize the negative consequences of IP., (© 2024 The Author(s). Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Purpose: How to best support self-regulated learning (SRL) skills development and track trainees' progress along their competency-based medical education learning trajectory is unclear. Learning plans (LPs) may be the answer; however, information on their use in undergraduate medical education (UME) is limited. This study summarizes the literature regarding LP use in UME, explores the student's role in LP development and implementation, and identifies additional research areas., Method: MEDLINE, Embase, PsycInfo, Education Source, and Web of Science databases were searched for articles published from database inception to March 6, 2024, and relevant reference lists were manually searched. The review included studies of undergraduate medical students, studies of LP use, and studies of the UME stage in any geographic setting. Data were analyzed using quantitative and qualitative content analyses., Results: The database search found 7,871 titles and abstracts with an additional 25 found from the manual search for a total of 7,896 articles, of which 39 met inclusion criteria. Many LPs lacked a guiding framework. LPs were associated with self-reported improved SRL skill development, learning structure, and learning outcomes. Barriers to their use for students and faculty were time to create and implement LPs, lack of training on LP development and implementation, and lack of engagement. Facilitators included SRL skill development, LP cocreation, and guidance by a trained mentor. Identified research gaps include objective outcome measures, longitudinal impact beyond UME, standardized framework for LP development and quality assessment, and training on SRL skills and LPs., Conclusions: This review demonstrates variability of LP use in UME. LPs appear to have potential to support medical student education and facilitate translation of SRL skills into residency training. Successful use requires training and an experienced mentor. However, more research is required to determine whether benefits of LPs outweigh the resources required for their use., (Copyright © 2024 the Association of American Medical Colleges.)

First impressions can influence rater-based judgments but their contribution to rater bias is unclear. Research suggests raters can overcome first impressions in experimental exam contexts with explicit first impressions, but these findings may not generalize to a workplace context with implicit first impressions. The study had two aims. First, to assess if first impressions affect raters' judgments when workplace performance changes. Second, whether explicitly stating these impressions affects subsequent ratings compared to implicitly-formed first impressions. Physician raters viewed six videos where learner performance either changed (Strong to Weak or Weak to Strong) or remained consistent. Raters were assigned two groups. Group one (n = 23, Explicit) made a first impression global rating (FIGR), then scored learners using the Mini-CEX. Group two (n = 22, Implicit) scored learners at the end of the video solely with the Mini-CEX. For the Explicit group, in the Strong to Weak condition, the FIGR (M = 5.94) was higher than the Mini-CEX Global rating (GR) (M = 3.02, p < .001). In the Weak to Strong condition, the FIGR (M = 2.44) was lower than the Mini-CEX GR (M = 3.96 p < .001). There was no difference between the FIGR and the Mini-CEX GR in the consistent condition (M = 6.61, M = 6.65 respectively, p = .84). There were no statistically significant differences in any of the conditions when comparing both groups' Mini-CEX GR. Therefore, raters adjusted their judgments based on the learners' performances. Furthermore, raters who made their first impressions explicit showed similar rater bias to raters who followed a more naturalistic process., (© 2023. The Author(s), under exclusive licence to Springer Nature B.V.)

Introduction: The Nominal Group Technique (NGT) is a consensus group method used to synthesize expert opinions. Given the global shift to virtual meetings, the extent to which researchers leveraged virtual platforms is unclear. This scoping review explores the use of the vNGT in healthcare research during the COVID-19 pandemic., Methods: Following the Arksey and O'Malley's framework, eight cross-disciplinary databases were searched (January 2020-July 2022). Research articles that reported all four vNGT stages (idea generation, round robin sharing, clarification, voting) were included. Media Synchronicity Theory informed analysis. Corresponding authors were surveyed for additional information., Results: Of 2,589 citations, 32 references were included. Articles covered healthcare (27/32) and healthcare education (4/32). Platforms used most were Zoom, MS Teams and GoTo but was not reported in 44% of studies. Only 22% commented on the benefits/challenges of moving the NGT virtually. Among authors who responded to our survey (16/32), 80% felt that the vNGT was comparable or superior., Conclusions: The vNGT provides several advantages such as the inclusion of geographically dispersed participants, scheduling flexibility and cost savings. It is a promising alternative to the traditional in-person meeting, but researchers should carefully describe modifications, potential limitations, and impact on results., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2024 Lee et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Background: The current paradigm of competency-based medical education and learner-centredness requires learners to take an active role in their training. However, deliberate and planned continual assessment and performance improvement is hindered by the fragmented nature of many medical training programs. Attempts to bridge this continuity gap between supervision and feedback through learner handover have been controversial. Learning plans are an alternate educational tool that helps trainees identify their learning needs and facilitate longitudinal assessment by providing supervisors with a roadmap of their goals. Informed by self-regulated learning theory, learning plans may be the answer to track trainees' progress along their learning trajectory. The purpose of this study is to summarise the literature regarding learning plan use specifically in undergraduate medical education and explore the student's role in all stages of learning plan development and implementation., Methods: Following Arksey and O'Malley's framework, a scoping review will be conducted to explore the use of learning plans in undergraduate medical education. Literature searches will be conducted using multiple databases by a librarian with expertise in scoping reviews. Through an iterative process, inclusion and exclusion criteria will be developed and a data extraction form refined. Data will be analysed using quantitative and qualitative content analyses., Discussion: By summarising the literature on learning plan use in undergraduate medical education, this study aims to better understand how to support self-regulated learning in undergraduate medical education. The results from this project will inform future scholarly work in competency-based medical education at the undergraduate level and have implications for improving feedback and supporting learners at all levels of competence., Scoping Review Registration: Open Science Framework osf.io/wvzbx., (© 2024. The Author(s).)

Background and Objectives:  Improving training and confirming the acquisition of gynecological procedure skills for family physicians (FPs) is crucial for safe health care delivery. The objectives of this study were to (a) develop performance rating instruments for four gynecological procedures, and (b) pilot them to provide preliminary validity evidence using modern validity theory., Methods:  Sixteen academic FPs and gynecologists participated in a modified Delphi technique to develop procedure-specific checklists (PSCs) for four procedures: intrauterine device insertion, endometrial biopsy, punch biopsy of the vulva, and routine pessary care. We modified a previously validated global rating scale (GRS) for ambulatory settings. Using prerecorded videos, 19 academic FPs piloted instruments to rate one first-year and one second-year family medicine resident's performance. They were blinded to the level of training. We compared the mean scores for PSCs and GRS for each procedure using paired samples t tests and Cohen's d to estimate effect sizes., Results:  Consensus on items for the final PSCs was reached after two Delphi rounds. PSC and GRS scores were numerically higher for the second-year resident than the first-year resident for every procedure, with statistically significant differences for six of eight comparisons (P&lt;.05). All comparisons demonstrated large effect sizes (Cohen's d&gt;0.8). Both instruments received high scores for ease of use by raters., Conclusions:  We developed novel performance rating instruments for four gynecological procedures and provided preliminary validity evidence for their use for formative feedback in a simulation setting. This pilot study suggests that these instruments may facilitate the training and documentation of family medicine trainees' skills in gynecological procedures.

Objective: Approximately five years ago, the Royal College emergency medicine programs in Canada implemented a competency-based paradigm and introduced the use of Entrustable Professional Activities (EPAs) for assessment of units of professional activity to assess trainees. Many competency-based medical education (CBME) based curricula, involve assessing for entrustment through observations of EPAs. While EPAs are frequently assessed in clinical settings, simulation is also used. This study aimed to characterize the use of simulation for EPA assessment., Methods: A study interview guide was jointly developed by all study authors and followed best practices for survey development. A national interview was conducted with program directors or assistant program directors across all the Royal College emergency medicine programs across Canada. Interviews were conducted over Microsoft Teams, interviews were recorded and transcribed, using Microsoft Teams transcribing service. Sample transcripts were analyzed for theme development. Themes were then reviewed by co-authors to ensure they were representative of the participants' views., Results: A 64.7% response rate was achieved. Simulation has been widely adopted by EM training programs. All interviewees demonstrated support for the use of simulation for EPA assessment for many reasons, however, PDs acknowledged limitations and thematic analysis revealed certain themes and tensions for using simulation for EPA assessment. Thematic analysis revealed six major themes: widespread support for the use of simulation for EPA assessment, concerns regarding the potential for EPA assessment to become a "tick- box" exercise, logistical barriers limiting the use of simulation for EPA assessment, varied perceptions about the authenticity of using simulation for EPA assessment, the potential for simulation for EPA assessment to compromise learner psychological safety, and suggestions for the optimization of use of simulation for EPA assessment., Conclusions: Our findings offer insight for other programs and specialties on how simulation for EPA assessment can best be utilized. Programs should use these findings when considering using simulation for EPA assessment., (© 2024. The Author(s), under exclusive licence to Canadian Association of Emergency Physicians (CAEP)/ Association Canadienne de Médecine d'Urgence (ACMU).)

Background: Illness presenteeism (IP) is the phenomenon where individuals continue to work despite illness. While it has been a prevalent and longstanding issue in medicine, the recent onset of the COVID-19 pandemic and the growing movement to improve physician wellness brings renewed interest in this topic. However, there have been no comprehensive reviews on the state of literature of this topic., Purpose: The main aim of this scoping review is to explore what is known about presenteeism in physicians, residents, and medical students in order to map and summarize the literature, identify research gaps and inform future research. More specifically: How has illness presenteeism been defined, problematized or perceived? What methods and approaches have been used to study the phenomenon? Has the literature changed since the pandemic?, Method: Using the Arksey and O'Malley framework several databases will be searched by an experienced librarian. Through an iterative process, inclusion and exclusion criteria will be developed and a data extraction form refined. Data will be analyzed using quantitative and qualitative content analyses., Potential Implications of Results: By summarizing the literature on IP, this study will provide a better understanding of the IP phenomena to inform future research and potentially have implications for physician wellness and public health., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2024 Madrazo et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Context: Electronic health records (EHRs) have transformed clinical practice. They are not simply replacements for paper records but integrated systems with the potential to improve patient safety and quality of care. Training physicians in the use of EHR is a highly complex intervention that occurs in a dynamic socio-technical health system. Training in this complex space is considered a wicked problem and would benefit from different analytic approaches to the traditional linear causal relationship analysis. Social Sciences theories see technological change in relation to complex social and institutional processes and provide a useful starting point., Aim: Our aim, therefore, is to introduce the medical education scholar to a selection of theoretical approaches from the Social Studies of Science and Technology (SSST) literatures, to inform educational efforts in training for EHR use., Methods: We suggest a body of theories and frameworks that can expand the epistemological repertoire of medical education scholarship to respond to this wicked problem. Drawing from our work on EHR implementation, we discuss current limitations in framing training for EHRs use as a research problem in medical education. We then present a selection of alternative theories., Results: Unified Theory of Acceptance and Use of Technology (UTAUT) explains the individual adoption of new technologies in the workplace and has four key constructs: performance/effort expectancy, social influence and facilitating conditions. Social Practice Theory (SPT), rather than focusing on individuals or institutions, starts with the activity or practice. The socio-technical model (STM) is a comprehensive theory that offers a multidimensional framework for studying the innovation and application of EHRs. Practical examples are provided., Conclusions: We argue that education for effective utilisation of EHRs requires moving beyond the epistemological monism often present in the field. New theoretical lenses can illuminate the complexity of research to identify the best practices for educating and training physicians., (© 2023 The Authors. Medical Education published by Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Purpose: Learner handover is the sharing of learner-related information between supervisors involved in their education. The practice allows learners to build upon previous assessments and can support the growth-oriented focus of competency-based medical education. However, learner handover also carries the risk of biasing future assessments and breaching learner confidentiality. Little is known about learner handover's educational impact, and what is known is largely informed by faculty and institutional perspectives. The purpose of this study was to explore learner handover from the learner perspective., Method: Constructivist grounded theory was used to explore learners' perspectives and beliefs around learner handover. Twenty-nine semistructured interviews were completed with medical students and residents from the University of Ottawa and University of California, San Francisco. Interviews took place between April and December 2020. Using the constant comparative approach, themes were identified through an iterative process., Results: Learners were generally unaware of specific learner handover practices, although most recognized circumstances where both formal and informal handovers may occur. Learners appreciated the potential for learner handover to tailor education, guide entrustment and supervision decisions, and support patient safety, but worried about its potential to bias future assessments and breach confidentiality. Furthermore, learners were concerned that information-sharing may be more akin to gossip rather than focused on their educational needs and feared unfair scrutiny and irreversible long-term career consequences from one shared mediocre performance. Altogether, these concerns fueled an overwhelming pressure to perform., Conclusions: While learners recognized the rationale for learner handover, they feared the possible inadvertent short- and long-term impact on their training and future careers. Designing policies that support transparency and build awareness around learner handover may mitigate unintended consequences that can threaten learning and the learner-supervisor relationship, ensuring learner handover benefits the learner as intended., (Copyright © 2023 by the Association of American Medical Colleges.)

Medical students often seek educational resources outside of the formal curriculum to support their education. Commercial and student-developed educational resources are readily available, and may supplement or even replace aspects of the formal curriculum. Since this has the potential to impact what students learn and ultimately impact patient care, gaining a better understanding of the prevalence and patterns of use of these resources is of great interest. The purpose of this study, therefore, is to explore the use of non-traditional resources in undergraduate medical education. We surveyed University of Ottawa medical students to determine the usage, rationale, and perceived benefits and drawbacks of these educational resources. The response rate was 57/342 (17%). Of 57 respondents (first year = 21, second year = 34, MD/PhD = 2), 98.2% report using non-traditional resources, with Upper Year Notes, Student Developed Anki decks (a spaced repetition flashcard tool), and Student Developed Question Banks being most common. Although 75% of students reported using official lecture slides and practice tests, they reported spending more of their time (63%) using third-party resources compared to official curriculum offerings. Reported advantages of non-traditional resources listed were faster, more efficient, and easier to understand/search. Disadvantages were difficulty aligning unofficial resources with local exams, determining the level of detail required, and cost. These results suggest a need to examine curriculum design and delivery and further investigate the role of non-traditional resources developed by medical students and the role of medical students as peer educators., Supplementary Information: The online version contains supplementary material available at 10.1007/s40670-023-01899-5., Competing Interests: Conflict of InterestThe authors declare no conflict of interests., (© The Author(s) under exclusive licence to International Association of Medical Science Educators 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.)

Introduction: The Ottawa Conference on the Assessment of Competence in Medicine and the Healthcare Professions was first convened in 1985 in Ottawa. Since then, what has become known as the Ottawa conference has been held in various locations around the world every 2 years. It has become an important conference for the community of assessment - including researchers, educators, administrators and leaders - to share contemporary knowledge and develop international standards for assessment in medical and health professions education., Methods: The Ottawa 2022 conference was held in Lyon, France, in conjunction with the AMEE 2022 conference. A diverse group of international assessment experts were invited to present a symposium at the AMEE conference to summarise key concepts from the Ottawa conference. This paper was developed from that symposium., Results and Discussion: This paper summarises key themes and issues that emerged from the Ottawa 2022 conference. It highlights the importance of the consensus statements and discusses challenges for assessment such as issues of equity, diversity, and inclusion, shifts in emphasis to systems of assessment, implications of 'big data' and analytics, and challenges to ensure published research and practice are based on contemporary theories and concepts.

Background: Headache disorders are the most common neurological disorders worldwide. Despite their widespread prevalence and importance, the topic of headache is inconsistently taught at both the undergraduate and postgraduate levels. The goal of this study is to establish a better picture of the current state of Headache Medicine (HM) training in Neurology postgraduate programs in Canada and describe the impact of the current pandemic on training in this domain., Methods: Online surveys were sent to senior residents of adult Neurology programs in Canada. We also conducted telephone interviews with Neurology Program Directors. Descriptive statistics were analyzed, and thematic analysis was used to review free text., Results: A total of 36 residents, and 3 Program Directors participated in the study. Most of the teaching in HM is done by headache specialists and general neurology faculty. Formal teaching is mainly given during academic half day. Most of the programs expose their residents to Onabotulinum toxin A injections and peripheral nerve blocks, but they don't offer much formal teaching regarding these procedures. Residents consider HM teaching important and they would like to have more. They don't feel comfortable performing interventional headache treatments, despite feeling this should be part of the skillset of a general neurologist., Conclusion: Our study is the first to establish the current state of headache teaching in post-graduate neurology programs as perceived by trainees and program directors in Canada. The current educational offerings leave residents feeling poorly prepared to manage headaches, including procedural interventions. There is a need to diversify the source of teaching, so the educational burden doesn't lie mostly upon Headache specialists who are already in short supply. Neurology Residency programs need to adapt their curriculum to face the current need in HM., (© 2023. BioMed Central Ltd., part of Springer Nature.)

Consensus methods such as the Delphi and nominal group techniques are increasingly utilized within medical education research. This educator's blueprint paper provides practical strategies regarding five key steps for ensuring best practices when using consensus methods. These strategies include deciding which consensus method is best, developing the initial questionnaire, identifying the participants, determining the number of rounds and consensus threshold, and describing and justifying any modifications. These strategies will help guide education researchers on their next study using consensus methods., Competing Interests: The authors declare no conflicts of interest., (© 2023 The Authors. AEM Education and Training published by Wiley Periodicals LLC on behalf of Society for Academic Emergency Medicine.)

Background/purpose: Despite widespread use of Electronic Health Records (EHR), the promise of benefits has not been clearly realised due, in part, to inadequate physician training. Training for EHR use is a highly complex intervention that occurs in a dynamic socio-technical health system. The purpose of this study was to describe and critically assess the interplay between educational activities and organisational factors that influenced EHR training and implementation across two different hospitals., Methods: Based in a socio-technical framework, a comparative qualitative case study was undertaken as well suited to real-world processes. Semi-structured interviews were completed (n = 43), representing administrative leaders, staff physicians, residents and EHR trainers from two Canadian academic hospitals. Thematic analysis was employed for analysis., Results: Similar findings were noted at both hospitals despite different implementation strategies. Despite mandatory training, physicians described limited transferability of training to the workplace. Factors contributing to this included standardised vendor modules (lacking specificity for their clinical context); variable EHR trainer expertise; limited post-launch training; and insufficient preparation for changes to workflow. They described learning while caring for patients and using workarounds. Strong emotional responses were described, including anger, frustration, anxiety and fear of harming patients., Conclusions: Training physicians for effective EHR utilisation requires organisational culture transformation as EHRs impacts all aspects of clinical workflows. Analytic thinking to consider workflows, ongoing post-launch training and the recognition of the interdependency of multiple factors are critical to preparing physicians to provide effective clinical care, and potentially reducing burnout. A list of key considerations is provided for educational leaders., (© 2022 Association for the Study of Medical Education and John Wiley & Sons Ltd.)

Introduction: Consensus group methods such as the Nominal Group Technique (NGT) and Delphi method are commonly used in research to elicit and synthesize expert opinions when evidence is lacking. Traditionally, the NGT involves a face-to-face interaction. However, due to the COVID-19 pandemic, many in-person meetings have moved to online settings. It is unclear to what extent the NGT has been undertaken in virtual settings. The overarching aim of this scoping review is to explore the use of the virtual NGT in research. Our specific objectives are to answer the following questions: To what extent has the NGT been used virtually? What modifications were made to accommodate this online format? What advantages and disadvantages were noted by authors in comparison with the face-to-face mode of the technique?, Materials and Methods: This scoping review will follow the steps outlined by Arksey and O'Malley and the PRISMA-ScR guidelines. Several pilot searches were completed to refine inclusion and exclusion criteria. Media Synchronicity Theory will provide a conceptual framework to inform the research, including data extraction and summarizing results. As an additional extension to the literature review, online interviews with corresponding authors will be conducted to gather further information., Competing Interests: The authors have declared that no competing interests exist., (Copyright: © 2023 Humphrey-Murto et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.)

Objective: This study aimed to assess the current state of musculoskeletal point-of-care ultrasonography training among the rheumatology postgraduate programs in Canada and explored the interest in developing a national curriculum., Method: A Canadian survey was developed by academic rheumatologists including point-of-care ultrasonography experts and point-of-care ultrasonography non-users. Across Canada, all 15 adult and 3 pediatric rheumatology English and French postgraduate programs were surveyed via Survey Monkey with a standardized questionnaire., Results: The completed response rates were 27% (24/89) for postgraduate year-4 and -5 rheumatology trainees and 61% (11/18) for program directors. Forty-two percent (10/24) of trainees had access to formal point-of-care ultrasonography training, and 67% (16/24) had some form of informal nonstructured exposure. Of all respondents, 87.5% (21/24) trainees and 82% (9/11) program directors agreed or strongly agreed that point-of-care ultrasonography is an important clinical tool in rheumatology. Eighty-nine percent (8/9) of program directors felt that point-of-care ultrasonography should be a formal part of rheumatology training., Conclusion: This national survey demonstrates that while musculoskeletal point-of-care ultrasonography is considered an important component of clinical practice, significant training barriers exist. The majority of both trainees and program directors felt that point-of-care ultrasonography should be a formal part of training and would be interested in a national standardized point-of-care ultrasonography curriculum in Canada.

The aim was to evaluate patient satisfaction with virtual care, and identify factors associated with level of satisfaction. Surveys were mailed to all patients who had a phone visit at The Ottawa Hospital Rheumatology division. Patients' satisfaction with various aspects of the phone visits was assessed on a 5-point scale and analyzed according to demographic variables using chi-square and regression analyses. Of 2423 surveys mailed, we received 742 responses (31%). Eighty-nine percent of patients were satisfied overall with the phone visit. Statistically significant less satisfaction was seen in patients who spoke to a resident compared to their rheumatologist (p < 0.001), were not called on time (p < 0.001), had difficulty using a telephone (p < 0.001), needed assistance of a second person (p < 0.01), or had new consultations (versus routine follow-up, p = 0.01), the former 3 factors being significant in a multivariate regression analysis. Rheumatology patients expressed a high level of satisfaction with virtual care; however, areas of improvement were identified. Patients' satisfaction will be important to inform future decisions regarding the sustainability of virtual care. Further research is required to understand the impacts of virtual care on patients' Key Points • Patients in rheumatology practice were satisfied with phone visits and preferred this method to in-person visits during the pandemic. • Speaking directly to the rheumatologist, being phoned on time, and the capability of using the telephone were the major determinants of high patient satisfaction. • Based on the identified factors, further improvement of the quality of and satisfaction with phone visits can be pursued given that virtual care may continue longer, beyond the pandemic., (© 2022. The Author(s), under exclusive licence to International League of Associations for Rheumatology (ILAR).)

High-quality correspondence between healthcare providers is critical for effective patient care. We developed an assessment tool to measure the quality of specialist correspondence to primary care providers (PCPs) via electronic consultation (eConsult), where specialists provide advice without specialist-patient interactions. We incorporated fourteen previously described features of high-quality eConsult correspondence into an assessment tool named the eConsult Specialist Quality of Response (eSQUARE). Six PCPs and two specialists applied the 10-item eSQUARE tool to 30 eConsults of varying quality as informed by PCP survey data. Content, response process, and internal structure validity evidence was gathered. Psychometric properties were calculated using descriptive statistics and generalizability analyses. Mean total score for low-quality eConsults (M = 24 ± 5.6) was significantly lower than moderate-quality eConsults (M = 38 ± 4.7; p<0.001) which was significantly lower than high-quality eConsults (M = 46 ± 3.0; p = 0.002). Reliability measures were high, including generalizability coefficient (0.96), inter-item (≥0.55) and item-total correlations (≥0.68). A decision study demonstrated that a single rater was adequate to achieve a reliability measure of ≥0.70. This study demonstrates initial validity evidence including multiple reliability measures for the eSQUARE. A single rater is adequate to achieve reliability measures for formative feedback. Future studies can apply the eSQUARE when planning educational initiatives aiming to improve specialist-to-PCP correspondence via eConsult.

Objectives: Understanding of patient experiences and adaptations to hybrid closed-loop (HCL) pumps beyond the confines of short-term clinical trials is needed to inform best practices surrounding this emerging technology. We investigated long-term, real-world patient experiences with HCL technology., Methods: In semistructured interviews, 21 adults with type 1 diabetes at a single Canadian tertiary diabetes centre discussed their transition to use of Medtronic MiniMed 670G auto-mode. Interviews were audio-recorded, transcribed and analyzed iteratively to identify emerging themes., Results: Participants' mean age was 50±13 years, 12 of the 21 participants were female, baseline glycated hemoglobin (A1C) was 7.9±1.0% and auto-mode duration was 9.3±4.6 months. Three had discontinued auto-mode. Most participants praised auto-mode for reducing hypoglycemia, stabilizing glucose overnight and improving A1C, while also reporting frustration with frequency of alarms and user input, sensor quality and inadequate response to hyperglycemia. Participants with the highest baseline A1Cs (8.8% to 9.8%) tended to report immense satisfaction and trust in auto-mode, meeting their primary expectations of improved glycemic control. In contrast, participants with controlled diabetes (A1C <7.5%) had hoped to offload active management but experienced significant cognitive and emotional labour associated with relinquishing control during suboptimal auto-mode performance. Participants were commonly aware of workarounds to "trick" the pump, and almost all participants with A1C <7.5% tried at least 1 workaround., Conclusions: In the real-world setting, patients' goals and satisfaction with auto-mode appeared to vary considerably with their baseline diabetes control. Patients with the most suboptimal glycemic control described the greatest benefits and easiest adaptation process, challenging commonly held assumptions for patient selection for pump therapy., (Copyright © 2021 Canadian Diabetes Association. All rights reserved.)

Understanding which factors can impact rater judgments in assessments is important to ensure quality ratings. One such factor is whether prior performance information (PPI) about learners influences subsequent decision making. The information can be acquired directly, when the rater sees the same learner, or different learners over multiple performances, or indirectly, when the rater is provided with external information about the same learner prior to rating a performance (i.e., learner handover). The purpose of this narrative review was to summarize and highlight key concepts from multiple disciplines regarding the influence of PPI on subsequent ratings, discuss implications for assessment and provide a common conceptualization to inform research. Key findings include (a) assimilation (rater judgments are biased towards the PPI) occurs with indirect PPI and contrast (rater judgments are biased away from the PPI) with direct PPI; (b) negative PPI appears to have a greater effect than positive PPI; (c) when viewing multiple performances, context effects of indirect PPI appear to diminish over time; and (d) context effects may occur with any level of target performance. Furthermore, some raters are not susceptible to context effects, but it is unclear what factors are predictive. Rater expertise and training do not consistently reduce effects. Making raters more accountable, providing specific standards and reducing rater cognitive load may reduce context effects. Theoretical explanations for these findings will be discussed., (© 2021. The Author(s), under exclusive licence to Springer Nature B.V. part of Springer Nature.)

Background: Local grants programs are important since funding for medical education research is limited. Understanding which factors predict successful outcomes is highly relevant to administrators. The purpose of this project was to identify factors that contribute to the publication of local medical education grants in a Canadian context., Methods: Surveys were distributed to previous Department of Innovation in Medical Education (DIME) and Department of Medicine (DOM) grant recipients ( n = 115) to gather information pertaining to PI demographics and research outcomes. A backward logistic regression was used to determine the effects several variables on publication success., Results: The overall publication rate was 64/115 (56%). Due to missing data, 91 grants were included in the logistic regression. Variables associated with a higher rate of publication; cross departmental compared to single department OR = 2.82 ( p = 0.04), being presented OR = 3.30 ( p = 0.01), and multiple grant acquisition OR = 3.85 ( p = 0.005)., Conclusion: Although preliminary, our data suggest that increasing research publications from local grants may be facilitated by pooling funds across departments, making research presentations mandatory, and allowing successful researchers to re-apply., Competing Interests: Conflicts of Interest: None., (© 2021 Humphrey-Murto, Walker, Aggarwal, Preet Kaur Dhillon, Rauscher, Wood; licensee Synergies Partners.)

Purpose: Learner handover is the sharing of information about learners between faculty supervisors. Learner handover can support longitudinal assessment in rotation-based systems, but there are concerns that the practice could bias future assessments or stigmatize struggling learners. Because successful implementation relies on an understanding of existing practices and beliefs, the purpose of this study was to explore how faculty perceive and enact learner handover in the workplace., Method: Using constructivist grounded theory, 23 semistructured interviews were conducted with faculty from 2 Canadian universities between August and December 2018. Participants were asked to describe their learner handover practices, including learner handover delivered or received about resident and student trainees either within or between clinical rotations. The authors probed to understand why faculty used learner handover and their perceptions of its benefits and risks., Results: Learner handover occurs both formally and informally and serves multiple purposes for learners and faculty. While participants reported that learner handover was motivated by both learner benefit and patient safety, they primarily described motivations focused on their own needs. Learner handover was used to improve faculty efficiency by focusing teaching and feedback and was perceived as a "self-defense mechanism" when faculty were uncertain about a learner's competence and trustworthiness. Informal learner handover also served social or therapeutic purposes when faculty used these conversations to gossip, vent, or manage insecurities about their assessment of learner performance. Because of its multiple, sometimes unsanctioned purposes, participants recommended being reflective about motivations behind learner handover conversations., Conclusions: Learners are not the only potential beneficiaries of learner handover; faculty use learner handover to lessen insecurities surrounding entrustment and assessment of learners and to openly share their frustrations. The latter created tensions for faculty needing to share stresses but wanting to act professionally. Formal education policies regarding learner handover should consider faculty perspectives., (Copyright © 2021 by the Association of American Medical Colleges.)

Introduction: Poor communication between health professionals can compromise patient safety, yet specialists rarely receive feedback on their written communication. Although worldwide implementation of electronic consultation (eConsult) services is rising rapidly, little is known about the features of effective communication when specialists provide online advice to primary care providers (PCP). To inform efforts to ensure and maintain high-quality communication via eConsult, we aim to identify features of high-quality eConsult advice to incorporate into an assessment tool that can provide specialists with feedback on their correspondence., Methods: Initial items for the tool were generated by PCPs and specialists using the nominal group technique (NGT). Invited PCPs were above-median eConsult users between July 2016 and June 2017. Specialists were purposively recruited to represent the range of available specialties. Participants individually wrote down items they felt should be included in the tool. A moderator with consensus group expertise then led a round-robin discussion for each item. Items were ranked anonymously and included if highly-ranked by over 70% of participants., Results: Eight PCPs (six family physicians, two nurse practitioners) and three specialists (dermatology, hematology, pediatric orthopedics) produced 49 items that were refined to 14 after group discussion and two rounds of ranking. Highly-ranked items encompassed specific, up-to-date, patient-individualized, and practical advice that the PCP could implement., Discussion: Features of high-quality eConsult correspondence derived from consensus methods highlight similarities and differences between face-to-face consultation letters and eConsult. Our findings could be used to inform feedback and education for eConsult specialists on their advice to PCPs.

Purpose: Internationally, health professions education scholarship units (HPESUs) are often developed to promote engagement in educational scholarship, yet little is known about how HPESUs change over time or what factors support their longevity. In hopes of helping HPESUs thrive, this study explored factors that shaped the evolution of 8 HPESUs over the past 14 years., Method: This study involved retrospective case-study analysis of the 8 American, Canadian, and Dutch HPESUs profiled in a 2004 publication. First, the research team summarized key elements of HPESUs from the 2004 articles, then conducted semistructured interviews with the current unit directors. In the first set of questions, directors were asked to reflect on how the unit had changed over time, what successes the unit enjoyed, what enabled these successes, what challenges the unit encountered, and how these challenges were managed. In the second set of questions, questions were tailored to each unit, following up on unique elements from the original article. The team used Braun and Clarke's 6-phase approach to thematic analysis to identify, analyze, and report themes., Results: The histories of the units varied widely-some had grown by following their original mandates, some had significant mission shifts, and others had nearly disappeared. Current HPESU directors identified 3 key factors that shaped their HPESU's longitudinal development: the people working within and overseeing the HPESU (the need for a critical mass of scholars, a pipeline for developing scholars, and effective leadership), institutional structures (issues of centralization, unit priorities, and clear messaging), and funding (the need for multiple funding sources)., Conclusions: Study findings offer insights that may help current HPESU directors to strategically plan for their unit's continued development. Tactically harnessing the factors identified could help directors ensure their HPESU's growth and contend with the challenges that threaten the unit's success.

Background: Medical school admissions committees are seeking alternatives to traditional academic measures when selecting students; one potential measure being emotional intelligence (EI). If EI is to be used as an admissions criterion, it should predict future performance. The purpose of this study is to determine if EI scores at admissions predicts performance on a medical licensure examination., Methods: All medical school applicants to the University of Ottawa in 2006 and 2007 were invited to complete the Mayer-Salovey-Caruso Emotional Intelligence Test (MSCEIT v2.0) after their interview. Students were tracked through medical school into licensure and EI scores were correlated to their scores on the Medical Council of Canada Qualifying Examination (MCCQE) attempted between 2010 and 2014., Results: The correlation between the MSCEIT and the MCCQE Part I was r (200) = .01 p =. 90 The covariates of age and gender accounted for a significant amount of variance in MCCQE Part I scores ( R 2 = .10, p <.001, n=202) but the addition of the MSCEIT scores was not statistically significant ( R 2 change = .002, p =.56). The correlation between the MSCEIT and the MCCQE Part II was r (197) = .06, p = .41. The covariates of age and gender accounted for some variance in MCCQE Part II scores ( R 2 = .05, p = .007, n=199) but the addition of the MSCEIT did not ( R 2 change = .002 p =.55)., Conclusion: The low correlations between EI and licensure scores replicates other studies that have found weak correlations between EI scores and tests administered at admissions and during medical school. These results suggest caution if one were to use EI as part of their admissions process., Competing Interests: Conflict of interest: The authors of this manuscript do not have any conflicts of interest due to financial or personal relationships that could potentially bias this work., (© 2020 Wood, Humphrey-Murto, Moineau,Forgie,Puddester,Leddy; licensee Synergies Partners.)

Objective: Developing international consensus on outcome measures for clinical trials is challenging. The following paper will review consensus building in Outcome Measures in Rheumatology (OMERACT), with a focus on the Delphi., Methods: Based on the literature and feedback from delegates at OMERACT 2018, a set of recommendations is provided in the form of the OMERACT Delphi Consensus Checklist., Results: The OMERACT delegates generally supported the use of the checklist as a guide. The checklist provides guidance for clearly outlining the multiple aspects of the Delphi process., Conclusion: OMERACT is deeply committed to consensus building and these recommendations should be considered a work in progress.

Purpose: Learner handover (LH) is the sharing of information about trainees between faculty supervisors. This scoping review aimed to summarize key concepts across disciplines surrounding the influence of prior performance information (PPI) on current performance ratings and implications for LH in medical education., Method: The authors used the Arksey and O'Malley framework to systematically select and summarize the literature. Cross-disciplinary searches were conducted in six databases in 2017-2018 for articles published after 1969. To represent PPI relevant to LH in medical education, eligible studies included within-subject indirect PPI for work-type performance and rating of an individual current performance. Quantitative and thematic analyses were conducted., Results: Of 24,442 records identified through database searches and 807 through other searches, 23 articles containing 24 studies were included. Twenty-two studies (92%) reported an assimilation effect (current ratings were biased toward the direction of the PPI). Factors modifying the effect of PPI were observed, with larger effects for highly polarized PPI, negative (vs positive) PPI, and early (vs subsequent) performances. Specific standards, rater motivation, and certain rater characteristics mitigated context effects, whereas increased rater processing demands heightened them. Mixed effects were seen with nature of the performance and with rater expertise and training., Conclusions: PPI appears likely to influence ratings of current performance, and an assimilation effect is seen with indirect PPI. Whether these findings generalize to medical education is unknown, but they should be considered by educators wanting to implement LH. Future studies should explore PPI in medical education contexts and real-world settings.

Background Challenges in bedside teaching may be overcome by the use of high-fidelity simulators for teaching the cardiac physical exam. The purpose of this study is to compare the ability of first-year medical students (MS1) to perform a cardiac physical exam and make the correct diagnosis after instruction using standardized patients (SPs) as compared to a cardiac simulator (Harvey, Laerdal Medical Corporation, NY, US). Methods Thirty-two MS1 were randomized to a teaching module on either SPs or Harvey. Their performance and ability to make the correct diagnosis were evaluated during a posttest objective structured clinical examination (OSCE) on real patients. Results No difference in the mean OSCE score was observed (SP: M=62.2% vs. Harvey: M=57.2%, p=0.32). The SP group obtained a higher frequency of correct diagnoses (M=61.5% SP vs. M=21.0% Harvey, p=0.03). Student feedback revealed that Harvey offered superior clinical findings; however, 34.4% of students requested a combination of teaching modalities as opposed to either method alone. Conclusions Performance in examination skills did not differ between the SP and Harvey groups but the SP group demonstrated an improved ability to arrive at a unifying diagnosis. A combined teaching program may be ideal for transferability to patients., Competing Interests: The authors have declared that no competing interests exist.

There is an increasing focus on factors that influence the variability of rater-based judgments. First impressions are one such factor. First impressions are judgments about people that are made quickly and are based on little information. Under some circumstances, these judgments can be predictive of subsequent decisions. A concern for both examinees and test administrators is whether the relationship remains stable when the performance of the examinee changes. That is, once a first impression is formed, to what degree will an examiner be willing to modify it? The purpose of this study is to determine the degree that first impressions influence final ratings when the performance of examinees changes within the context of an objective structured clinical examination (OSCE). Physician examiners (n = 29) viewed seven videos of examinees (i.e., actors) performing a physical exam on a single OSCE station. They rated the examinees' clinical abilities on a six-point global rating scale after 60 s (first impression or FIGR). They then observed the examinee for the remainder of the station and provided a final global rating (GRS). For three of the videos, the examinees' performance remained consistent throughout the videos. For two videos, examinee performance changed from initially strong to weak and for two videos, performance changed from initially weak to strong. The mean FIGR rating for the Consistent condition (M = 4.80) and the Strong to Weak condition (M = 4.87) were higher compared to their respective GRS ratings (M = 3.93, M = 2.73) with a greater decline for the Strong to Weak condition. The mean FIGR rating for the Weak to Strong condition was lower (3.60) than the corresponding mean GRS (4.81). This pattern of findings suggests that raters were willing to change their judgments based on examinee performance. Future work should explore the impact of making a first impression judgment explicit versus implicit and the role of context on the relationship between a first impression and a subsequent judgment.

Construct: The purpose of this study was to provide validity evidence for the mini-clinical evaluation exercise (mini-CEX) as an assessment tool for clinical skills in the workplace., Background: Previous research has demonstrated validity evidence for the mini-CEX, but most studies were carried out in internal medicine or single disciplines, therefore limiting generalizability of the findings. If the mini-CEX is to be used in multidisciplinary contexts, then validity evidence should be gathered in similar settings. The purpose of this study was to gather further validity evidence for the mini-CEX but in a broader context. Specifically we sought to explore the effects of discipline and rater type on mini-CEX scores, internal structure, and the relationship between mini-CEXs and OSCEs in a multidisciplinary context., Approach: During clerkship, medical students completed eight different rotations (family medicine, internal medicine, surgery, psychiatry, pediatrics, emergency, anesthesiology and obstetrics and gynecology). During each rotation, mini-CEX forms and a written examination were completed. Two multidisciplinary OSCEs (in Clerkship Year 3 and start of Year 4) assessed clinical skills. The reliability of the mini-CEX was assessed using Generalizability analyses. To assess the influence of discipline and rater type, mean scores were analyzed using a factorial analysis of variance. The total mini-CEX score was correlated to scores from the students' respective OSCEs and corresponding written exams., Results: Eighty-two students met inclusion criteria for a total of 781 ratings (average of 9.82 mini-CEX forms per student). There was a significant effect of discipline (p < .001, = .16), and faculty provided lower scores than nonfaculty raters (7.12 vs. 7.41; p = .002, = .02). The g-coefficient was .53 when discipline was included as a facet and .23 when rater type was a facet. There were low, but statistically significant correlations between the mini-CEX and scores for the 4th-year OSCE Total Score and the OSCE communication scores, r(80) = .40, p < .001 and r(80) = .29, p = .009. The mini-CEX was not correlated with the written examination scores for any of the disciplines., Conclusions: Our results provide conflicting findings for validity evidence for the mini-CEX. Mini-CEX ratings were correlated to multidisciplinary OSCEs but not written examinations, supporting the validity argument. However, reliability of the mini-CEX was low to moderate, and error accounted for the greatest amount of variability in scores. There was variation in scores due to discipline and resident raters gave higher scores than faculty. These results should be considered when considering the use of the mini-CEX in different contexts.

Purpose: Consensus group methods, such as the Delphi method and nominal group technique (NGT), are used to synthesize expert opinions when evidence is lacking. Despite their extensive use, these methods are inconsistently applied. Their use in medical education research has not been well studied. The authors set out to describe the use of consensus methods in medical education research and to assess the reporting quality of these methods and results., Method: Using scoping review methods, the authors searched the Medline, Embase, PsycInfo, PubMed, Scopus, and ERIC databases for 2009-2016. Full-text articles that focused on medical education and the keywords Delphi, RAND, NGT, or other consensus group methods were included. A standardized extraction form was used to collect article demographic data and features reflecting methodological rigor., Results: Of the articles reviewed, 257 met the inclusion criteria. The Modified Delphi (105/257; 40.8%), Delphi (91/257; 35.4%), and NGT (23/257; 8.9%) methods were most often used. The most common study purpose was curriculum development or reform (68/257; 26.5%), assessment tool development (55/257; 21.4%), and defining competencies (43/257; 16.7%). The reporting quality varied, with 70.0% (180/257) of articles reporting a literature review, 27.2% (70/257) reporting what background information was provided to participants, 66.1% (170/257) describing the number of participants, 40.1% (103/257) reporting if private decisions were collected, 37.7% (97/257) reporting if formal feedback of group ratings was shared, and 43.2% (111/257) defining consensus a priori., Conclusions: Consensus methods are poorly standardized and inconsistently used in medical education research. Improved criteria for reporting are needed.

Competency-based assessment is placing increasing emphasis on the direct observation of learners. For this process to produce valid results, it is important that raters provide quality judgments that are accurate. Unfortunately, the quality of these judgments is variable and the roles of factors that influence the accuracy of those judgments are not clearly understood. One such factor is first impressions: that is, judgments about people we do not know, made quickly and based on very little information. This study explores the influence of first impressions in an OSCE. Specifically, the purpose is to begin to examine the accuracy of a first impression and its influence on subsequent ratings. We created six videotapes of history-taking performance. Each video was scripted from a real performance by six examinee residents within a single OSCE station. Each performance was re-enacted with six different actors playing the role of the examinees and one actor playing the role of the patient and videotaped. A total of 23 raters (i.e., physician examiners) reviewed each video and were asked to make a global judgment of the examinee's clinical abilities after 60 s (First Impression GR) by providing a rating on a six-point global rating scale and then to rate their confidence in the accuracy of that judgment by providing a rating on a five-point rating scale (Confidence GR). After making these ratings, raters then watched the remainder of the examinee's performance and made another global rating of performance (Final GR) before moving on to the next video. First impression ratings of ability varied across examinees and were moderately correlated to expert ratings (r = .59, 95% CI [-.13, .90]). There were significant differences in mean ratings for three examinees. Correlations ranged from .05 to .56 but were only significant for three examinees. Rater confidence in their first impression was not related to the likelihood of a rater changing their rating between the first impression and a subsequent rating. The findings suggest that first impressions could play a role in explaining variability in judgments, but their importance was determined by the videotaped performance of the examinees. More work is needed to clarify conditions that support or discourage the use of first impressions.