Search

Abstract Background Medical education is a multifarious endeavour integrating a range of pedagogies and philosophies. Complexity as a science or theory (‘complexity’) signals a move away from a reductionist paradigm to one which appreciates that interactions in multi-component systems, such as healthcare systems, can result in adaptive and emergent outcomes. This examination of the nexus between medical education and complexity theory aims to discover ways that complexity theory can inform medical education and medical education research. Methods A structured literature review was conducted to examine the nexus between medical education and complexity; 5 databases were searched using relevant terms. Papers were included if they engaged fully with complexity as a science or theory and were significantly focused on medical education. All types of papers were included, including conceptual papers (e.g. opinion and theoretical discussions), case studies, program evaluations and empirical research. A narrative and thematic synthesis was undertaken to create a deep understanding of the use of complexity in medical education. Results Eighty-three papers were included; the majority were conceptual papers. The context and theoretical underpinnings of complexity as a relevant theory for medical education were identified. Bibliographic and temporal observations were noted regarding the entry of complexity into medical education. Complexity was relied upon as a theoretical framework for empirical studies covering a variety of elements within medical education including: knowledge and learning theories; curricular, program and faculty development; program evaluation and medical education research; assessment and admissions; professionalism and leadership; and learning for systems, about systems and in systems. Discussion There is a call for greater use of theory by medical educators. Complexity within medical education is established, although not widespread. Individualistic cultures of medicine and comfort with reductionist epistemologies challenges its introduction. However, complexity was found to be a useful theory across a range of areas by a limited number of authors and is increasingly used by medical educators and medical education researchers. This review has further conceptualized how complexity is being used to support medical education and medical education research. Conclusion This literature review can assist in understanding how complexity can be useful in medical educationalists' practice.

Abstract Objectives To evaluate the impact a novel education programme - to improve research engagement, awareness, understanding and confidence - had on a diverse health and social care workforce. Barriers and facilitators to engagement were explored together with research capacity-building opportunities and ways to embed a research culture. The programme is entitled ‘Supporting The Advancement of Research Skills’ (STARS programme); the paper reports findings from a health and social care setting in England, UK. Methods A four-level outcome framework guided the approach to evaluation and was further informed by key principles of research capacity development and relevant theory. Quantitative data were collected from learners before and after engagement; these were analysed descriptively. Semi-structured online interviews were conducted with learners and analysed thematically. A purposive sample was achieved to include a diversity in age, gender, health and social care profession, and level of attendance (regular attendees, moderate attendees and non-attenders). Results The evaluation spanned 18 half-day workshops and 11 seminars delivered by expert educators. 165 (2% of total staff at Midlands Partnership University NHS Foundation Trust (MPFT)) staffs booked one or more education sessions; 128 (77%) including Allied Health Professionals (AHPs), psychologists, nursing and midwifery, and social workers attended one or more session. Key themes of engagement with teaching sessions, relevance and impact of training and promoting a research active environment were identified with relevant sub-themes. Positive impacts of training were described in terms of research confidence, intentions, career planning and application of research skills as a direct result of training. Lack of dedicated time for research engagement, work pressures and time commitments required for the programme were key barriers. Facilitators that facilitated engagement are also described. Conclusions Findings demonstrate the impact that a free, virtual and high-quality research education programme had at individual and organisational levels. The programme is the product of a successful collaboration between health and social care and academic organisations; this provides a useful framework for others to adapt and adopt. Key barriers to attendance and engagement spoke to system-wide challenges that an education programme could not address in the short-term. Potential solutions are discussed in relation to protecting staff time, achieving management buy-in, recognising research champions, and having a clear communication strategy.

Abstract Background The COVID-19 pandemic changed the way we work, spend, live, and learn. The impact was felt in the health sector where hospitals cancelled elective surgery, put on hold outpatient services, and implemented new social distancing procedures and telehealth systems, to enable hospitals to increase bed capacity. For medical students, these factors meant significant disruption to their clinical placements, remote delivery of their education, cessation of international and interstate placements, complicated by significant travel restrictions and border closures. There were concerns that final year students might be unable to graduate that year due to this lack of clinical exposure. Innovation As a result of this disruption in late March 2020 we developed an innovative 6 week ‘COVID-19 e-lective’ rotation, consisting of online modules, virtual clinical tutorials and a COVID project totalling the equivalent of 200 h of work. Results An evaluation was undertaken that found it to be remarkably successful in meeting the students’ learning needs and alleviating concerns about disrupted placements. It was also conducted during 2021 for all Year 4 students to help expand clinical placement opportunities. Outcomes This paper describes the e-lective, its innovations, its challenges, and its evaluation findings, for others to learn from.

Abstract Background Scientometric studies are one of the most important and useful tools to assess the research performance and knowledge impact of researchers. The aim of this study was to map out the scientific performance of the Iranian medical academics with respect to a detailed range of scientometric indicators. Methods Using scientometric approach, individual and scientific performance data of medical academic staff were extracted from the Iranian Scientometric Information Database (ISID). Total number of publications, total number of citations, citation per paper, h-index, international collaboration, self-citation, SJR decile, i10-Index, Quartile distribution were the studied scientometric variables. Out of the registered 19,023 academic staff, 746 were included in the study through simple random sampling method using random sample extraction function in STATA. Data were analyzed using STATA 14 statistical software package. Results Most of the included academicians were men (60%). A total of 13,682 articles were published by them until 2018, being cited 114,928 times with a mean of 5.77 citation per paper. H-index median was three and about 90% of the staff had an H-index below 10. Number of published papers, cite per paper and H-index metrics were significantly different with respect to gender, academic position/degree, and general field of study (p

Abstract Background Transition into higher education has been identified as one of the most stressful periods for learners. Interventions targeting the transition phase such as near- peer mentoring might help address some of these challenges. We were however unable to identify a published systematic review of the literature describing outcomes of near-peer mentoring of medical students during the transition phase into medical school. The aim of this paper is to review the literature and describe the outcomes of near-peer mentoring schemes for first-year medical students in the transition phase. Methods A search of different electronic databases was carried out, using the search terms peer, buddy, mentor*, counsel*, advise*, tutor*, student, medical, school. 1861 articles were identified, however only 5 studies met the inclusion criteria- primary mentees should be first-years, and mentors must be inclusive of second-years but not limited to them. In reporting this paper, the PRISMA guidelines were followed. Results Published material on near-peer mentoring for medical students is scarce. Three outcomes for peer mentoring were identified- professional and personal development, stress reduction, and ease of transitioning. Incidentally, peer-mentoring was also found to have facilitated the development of personal and professional attitudes in the mentors. The quality of the evaluation methods in the studies was however low to moderate. Conclusion Near-peer-mentoring is a way of promoting professional and personal development. It is also promising to aid transition and maintain well-being of first-year medical students. However, larger, better quality longitudinal studies, are needed to ascertain its true value for these students.

Abstract Introduction The last two decades have seen a shift in former Soviet countries from highly specialized to more family medicine-focused systems. Medical education has slowly adjusted to these reforms, although the region is still at risk to have a chronic shortage of family doctors. This paper presents the evaluation of a new post-graduate family medicine program in Tajikistan, focused on competency-based training. The findings are relevant for policy makers, international organizations and practitioners participating in similar medical education reform programs. Methods We employed a quasi-experimental control group design and compared intervention residents, control group residents with traditional training, and 1st year residents with no training in two outcomes, clinical knowledge and competencies. We employed two objective measures, a written multiple-choice question test (MCQT) and an Objective Structured Clinical Examination (OSCE), respectively. We report reliability and validity of the measures along with ANOVA, planned contrasts and effect size estimates to examine differences across groups. Results We found statistically significant differences in both clinical knowledge and competencies between intervention and control groups. We also detected a large intervention effect size. Participants in the intervention outperformed control group participants in the two measures. Our analysis suggests that intervention and control group participants are comparable in terms of initial knowledge and competencies, strengthening the argument that the intervention caused the improvement in the program outcomes. Discussion Receiving tailored training and structured opportunities to practice knowledge and competencies in clinical settings have a positive effect on the education of family medicine doctors in Tajikistan. Our results support curriculum reform and investment in medical education in the form of longer and supervised on-the-job preparation designed to be more in line with international standards. We discuss suggestions for future studies and potential requirements to inform replicability in other countries. Conclusion Family medicine is well recognized as central to health systems throughout the world, but high quality residency training lags behind in some countries. Our study showed that investing in family medicine residency programs and structured training is effective in increasing critical clinical competencies. We encourage promoting comprehensive post graduate family medicine doctor training so that the goals of a family medicine centered health system are attainable.

Abstract Background Interpersonal and communication skills (ICS) are important core competencies in medical education and certification. In this study, we identified self- and simulated patient (SP)-reported ratings of US first-year medical students’ ICS and the influence of age and gender on performance appraisal during the Objective-Structured Clinical Examination (OSCE). Methods OSCE participants, including 172 first-year medical students and 15 SPs were asked to evaluate the students’ ICS using the American Board of Internal Medicine–Patient-Satisfaction Questionnaire (ABIM–PSQ), electronically and via paper, respectively. Self- and SP-reported ratings of students’ ICS were presented as the median on a 5-point Likert-scale and as three categories defined as “good,” “very good,” and “inadequate.” Results SPs assessed all 172 students in the OSCE, while 43.6% of students assessed their own performance. The majority of students and SPs evaluated the students’ ICS as very good. 23.3% of SPs and 5.3% of students rated the medical students’ ability to encourage patient question-asking and answer questions as inadequate (P

Abstract Background In this research paper we report on the quality of feedback provided in the logbooks of pre-clinical undergraduate students based on a model of ‘actionable feedback’. Feedback to clinical learners about their performance is crucial to their learning, which ultimately impacts on their development into competent clinicians. Due to students’ concerns regarding the inconsistency and quality of feedback provided by clinicians, a structured feedback improvement strategy to move feedback forward was added to the clinical skills logbook. The instrument was also extended for peer assessment. This study aims to assess the quality of feedback using the deliberate practice framework. Methods A feedback scoring system was used to retrospectively assess the quality of tutor and peer logbook feedback provided to second and third year medical students to identify deliberate practice components i.e. task, performance gap and action plan. The sample consisted of 425 second year and 600 third year feedback responses over a year. Results All three deliberate practice components were observed in the majority of the written feedback for both classes. The frequency was higher in peer (83%, 89%) than tutor logbook assessments (51%, 67%) in both classes respectively. Average tutor and peer task, gap and action feedback scores ranged from 1.84–2.07 and 1.93–2.21 respectively. The overall quality of feedback provided by the tutor and peer was moderate and less specific (average score

Abstract Background Interprofessional learning is gaining momentum in revolutionizing healthcare education. During the academic year 2015/16, seven undergraduate-entry health and social care programs from two universities in Hong Kong took part in an interprofessional education program. Based on considerations such as the large number of students involved and the need to incorporate adult learning principles, team-based learning was adopted as the pedagogy for the program, which was therefore called the interprofessional team-based learning program (IPTBL). The authors describe the development and implementation of the IPTBL program and evaluate the effectiveness of the program implementation. Methods Eight hundred and one students, who are predominantly Chinese, participated in the IPTBL. The quantitative design (a pretest-posttest experimental design) was utilized to examine the students’ gains on their readiness to engage in interprofessional education (IPE). Results Three instructional units (IUs) were implemented, each around a clinical area which could engage students from complementary health and social care disciplines. Each IU followed a team-based learning (TBL) process: pre-class study, individual readiness assurance test, team readiness assurance test, appeal, feedback, and application exercise. An electronic platform was developed and was progressively introduced in the three IUs. The students’ self-perceived attainment of the IPE learning outcomes was high. Across all four subscales of RIPLS, there was significant improvement in student’s readiness to engage in interprofessional learning after the IPTBL. A number of challenges were identified: significant time involvement of the teachers, difficulty in matching students from different programs, difficulty in making IPTBL count towards a summative assessment score, difficulty in developing the LAMS platform, logistics difficulty in managing paper TBL, and inappropriateness of the venue. Conclusions Despite some challenges in developing and implementing the IPTBL program, our experience showed that TBL is a viable pedagogy to be used in interprofessional education involving hundreds of students. The significant improvement in all four subscales of RIPLS showed the effects of the IPTBL program in preparing students for collaborative practice. Factors that contributed to the success of the use of TBL for IPE are discussed.

Abstract Background The seven categories of the Stanford Faculty Development Program (SFDP) represent a framework for planning and assessing medical teaching. Nevertheless, so far there is no specific evaluation tool for large-group lectures that is based on these categories. This paper reports the development and psychometric validation of a short German evaluation tool for large-group lectures in medical education (SETMED-L: ‘Student Evaluation of Teaching in MEDical Lectures’) based on the SFDP-categories. Methods Data were collected at two German medical schools. In Study 1, a full information factor analysis of the new 14-item questionnaire was performed. In Study 2, following cognitive debriefings and adjustments, a confirmatory factor analysis was performed. The model was tested for invariance across medical schools and student gender. Convergent validity was assessed by comparison with results of the FEVOR questionnaire. Results Study 1 (n = 922) yielded a three-factor solution with one major (10 items) and two minor factors (2 items each). In Study 2 (n = 2740), this factor structure was confirmed. Scale reliability ranged between α = 0.71 and α = 0.88. Measurement invariance was given across student gender but not across medical schools. Convergent validity in the subsample tested (n = 246) yielded acceptable results. Conclusion The SETMED-L showed satisfactory to very good psychometric characteristics. The main advantages are its short yet comprehensive form, the integration of SFDP-categories and its focus on medical education.

Abstract Background An innovative program, the Practice Support Program (PSP), for full-service family physicians and their medical office assistants in primary care practices was recently introduced in British Columbia, Canada. The PSP was jointly approved by both government and physician groups, and is a dynamic, interactive, educational and supportive program that offers peer-to-peer training to physicians and their office staff. Topic areas range from clinical tools/skills to office management relevant to General Practitioner (GP) practices and “doable in real GP time”. PSP learning modules consist of three half-day learning sessions interspersed with 6–8 week action periods. At the end of the third learning session, all participants were asked to complete a pen-and-paper survey that asked them to rate (a) their satisfaction with the learning module components, including the content and (b) the perceived impact the learning has had on their practices and patients. Methods A total of 887 GPs (response rates ranging from 26.0% to 60.2% across three years) and 405 MOAs (response rates from 21.3% to 49.8%) provided responses on a pen-and-paper survey administered at the last learning session of the learning module. The survey asked respondents to rate (a) their satisfaction with the learning module components, including the content and (b) the perceived impact the learning has had on their practices and patients. The psychometric properties (Chronbach’s alphas) of the satisfaction and impact scales ranged from .82 to .94. Results Evaluation findings from the first three years of the PSP indicated consistently high satisfaction ratings and perceived impact on GP practices and patients, regardless of physician characteristics (gender, age group) or work-related variables (e.g., time worked in family practice). The Advanced Access Learning Module, which offers tools to improve office efficiencies, decreased wait times for urgent, regular and third next available appointments by an average of 1.2, 3.3, and by 3.4 days across all physicians. For the Chronic Disease Management module, over 87% of all GP respondents developed a CDM patient registry and reported being able to take better care of their patients. After attending the Adult Mental Health module: 94.1% of GPs agreed that they felt more comfortable helping patients who required mental health care; over 82% agreed that their skills and their confidence in diagnosing and treating mental health conditions had improved; and 41.0% agreed that their frequency of prescribing medications, if appropriate, had decreased. Additionally for the Adult Mental Health module, a 3–6 month follow-up survey of the GPs indicated that the implemented changes were sustained over time. Conclusion GP and medical office assistant participant ratings show that the PSP learning modules were consistently successful in providing GPs and their staff with new learning that was relevant and could be implemented and used in “real-GP-time”.

Abstract Background Evaluation is an integral part of medical education. Despite a wide use of various evaluation tools, little is known about student perceptions regarding the purpose and desired consequences of evaluation. Such knowledge is important to facilitate interpretation of evaluation results. The aims of this study were to elicit student views on the purpose of evaluation, indicators of teaching quality, evaluation tools and possible consequences drawn from evaluation data. Methods This qualitative study involved 17 undergraduate medical students in Years 3 and 4 participating in 3 focus group interviews. Content analysis was conducted by two different researchers. Results Evaluation was viewed as a means to facilitate improvements within medical education. Teaching quality was believed to be dependent on content, process, teacher and student characteristics as well as learning outcome, with an emphasis on the latter. Students preferred online evaluations over paper-and-pencil forms and suggested circulating results among all faculty and students. Students strongly favoured the allocation of rewards and incentives for good teaching to individual teachers. Conclusions In addition to assessing structural aspects of teaching, evaluation tools need to adequately address learning outcome. The use of reliable and valid evaluation methods is a prerequisite for resource allocation to individual teachers based on evaluation results.