Search

The Ottawa Conference on the Assessment of Competence in Medicine and the Healthcare Professions was first convened in 1985 in Ottawa. Since then, what has become known as the Ottawa conference has been held in various locations around the world every 2 years. It has become an important conference for the community of assessment – including researchers, educators, administrators and leaders – to share contemporary knowledge and develop international standards for assessment in medical and health professions education. The Ottawa 2022 conference was held in Lyon, France, in conjunction with the AMEE 2022 conference. A diverse group of international assessment experts were invited to present a symposium at the AMEE conference to summarise key concepts from the Ottawa conference. This paper was developed from that symposium. This paper summarises key themes and issues that emerged from the Ottawa 2022 conference. It highlights the importance of the consensus statements and discusses challenges for assessment such as issues of equity, diversity, and inclusion, shifts in emphasis to systems of assessment, implications of 'big data' and analytics, and challenges to ensure published research and practice are based on contemporary theories and concepts. [ABSTRACT FROM AUTHOR]

In an arts integrated interdisciplinary study set to investigate ways to improve social accountability (SA) in medical education, our research team has established a renewed understanding of compassion in the current SA movement. This paper explores the co-evolution of compassion and SA. The study used an arts integrated approach to investigate people's perceptions of SA in four medical schools across Australia, Canada, and the USA. Each school engaged approximately 25 participants who partook in workshops and in-depth interviews. We began with a study of SA and the topic of compassion emerged out of our qualitative data and biweekly meetings within the research team. Content analysis of the data and pedagogical discussion brought us to realize the importance of compassion in the practice of SA. The cultivation of compassion needs to play a significant role in a socially accountable medical educational system. Medical schools as educational institutions may operate themselves with compassion as a driving force in engaging partnership with students and communities. Social accountability without compassion is not SA; compassion humanizes institutional policy by engaging sympathy and care. [ABSTRACT FROM AUTHOR]

A social accountability mandate for Canadian medical schools formally emerged in Canada with changes to accreditation standards in 2015. However, how social accountability is defined and operationalized within medical schools has transpired independently. Key enablers of social accountability in Canadian medical schools have been largely unexplored. This paper is the first of a two part series that seeks to explore drivers of social accountability in a sample of Canadian medical schools. Nine key drivers of social accountability emerged from the data including a unified vision, committed leadership, accreditation standards, champions of social accountability, authentic community engagement, community-based learning opportunities, a supportive organizational and governance structure, diversity within medical schools, and measurement of progress and outcomes. This is the first study of its kind to examine what is driving social accountability across Canadian medical schools. An appreciative inquiry approach highlights areas of progress for future work to focus and build upon. This paper presents the findings from part one of the study – exploring the themes emerging from key informant interviews with senior leaders. A second paper will dive into the broader perspectives of faculty, staff and students, to explore more fully the varying perspectives of social accountability within colleges. [ABSTRACT FROM AUTHOR]

In 2011 the Consensus Statement on Performance Assessment was published in Medical Teacher. That paper was commissioned by AMEE (Association for Medical Education in Europe) as part of the series of Consensus Statements following the 2010 Ottawa Conference. In 2019, it was recommended that a working group be reconvened to review and consider developments in performance assessment since the 2011 publication. Following review of the original recommendations in the 2011 paper and shifts in the field across the past 10 years, the group identified areas of consensus and yet to be resolved issues for performance assessment. This paper addresses developments in performance assessment since 2011, reiterates relevant aspects of the 2011 paper, and summarises contemporary best practice recommendations for OSCEs and WBAs, fit-for-purpose methods for performance assessment in the health professions. [ABSTRACT FROM AUTHOR]

Indigenous Peoples across Turtle Island (North America) experience ongoing health disparities tied to the effects of colonization and persistent racism toward Indigenous Peoples. Educating future clinicians to develop a critical consciousness is an important way to work toward cultural safety and improve the health care experiences of Indigenous patients. The present study evaluated the ability of the KAIROS Blanket Exercise (KBE) to foster critical consciousness. Two hundred thirteen medical students at the University of Toronto participated in the KBE. Subsequently, 174 students completed a paper evaluation, designed to capture concepts of cultural safety and critical consciousness. Data were analyzed using quantitative and qualitative methods to identify shifts in perspectives. The majority of students reported the exercise altered the way they viewed those from backgrounds different from their own, and comments regarding bias, power and privilege were highlighted throughout the responses. Engaging in critical reflection through dialogue and revealing the complex sociopolitical context of Indigenous Peoples' history were emphasized as central to this transformation. Following participation in the KBE, medical students demonstrated a shift in their perspectives. This suggests that creating curricular space for critical pedagogy may be effective in fostering critical consciousness, ultimately encouraging reflexive practice and social action. [ABSTRACT FROM AUTHOR]

In response to the numerous challenges resident trainees currently face in their ability to competently acquire the requisite skills, knowledge and attitudes upon graduation, medical educators have looked to a competency-based medical education (CBME) approach as a possible solution. As CBME has already been implemented in many jurisdictions around the world, certain challenges in implementation have been experienced. One important challenge identified relates to how regulatory bodies can either assist or unintentionally hinder implementation. By examining the varied experiences from Canada, the USA and the Netherlands in implementing CBME, this paper identifies how regulatory bodies can support and advance worldwide efforts of furthering its implementation. If regulatory bodies restructure accreditation and regulatory criteria to align with CBME principles, work together in a coordinated fashion to ensure alignment of vital regulatory meaures throughout the training and practice continuum of a physician, and allow for (if not incentivize) individuals and programs to be innovative in adapting CBME to meet their local environments, it is likely that the worldwide implementation of CBME will occur successfully. [ABSTRACT FROM AUTHOR]

This paper presents perspectives and controversies surrounding the use of milestones to assess competency in outcomes-based medical education. Global perspectives (Canada, Europe, and the United States) and developments supporting their rationales are discussed. In Canada, there is a significant movement away from conceptualizing competency based on time, and a move toward demonstration of specific competencies. The success of this movement may require complex (rather than reductionist) milestones that reflect students' progression through complexity and context and a method to narrate their journey. European countries (United Kingdom, France, and Germany) have stressed the complexity associated with time and milestones for medical students to truly achieve competence. To meet the changing demands of medicine, they view time as actually providing students with knowledge and exposure to achieve various milestones. In the United States, milestones are based on sampling throughout professional development to initiate lifelong learning. However, the use of milestones may not imply overall competence (reductionism). Milestones must be developed alongside outcomes-based curriculum with use of faculty and competency committees. The perspectives outlined in this paper underscore emerging challenges for implementing outcomes-based medical education and call for new conceptualizations of competence. [ABSTRACT FROM AUTHOR]

Background: The recognition of medical professionalism as a complex social construct makes context, geographical location and culture important considerations in any discussion of professional behaviour. Medical students, medical educators and practitioners are now much more on the move globally, exposing them to cultural and social attitudes, values and beliefs that may differ from their own traditional perceptions of professionalism. Aims and Methods: This paper uses the model of the intercultural development continuum and the concept of 'cultural fit' to discuss what might transpire when a student, teacher or doctor is faced with a new cultural environment. Using our own experiences as medical educators working abroad and supported by evidence in the literature, we have developed four anecdotal scenarios to highlight some of the challenges that different cultural contexts bring to our current (Western) understanding of professionalism. Results and Conclusions: The scenarios highlight some of the potentially different regional and/or cultural perspectives and nuances of professional behaviours, attitudes or values that many of us either take for granted or find difficult, depending on our training and socio-cultural upbringing. With this paper, we hope to start a long overdue conversation about global professionalism amongst medical educators, identify potential areas for research and highlight a need for medical schools to embrace a 'global' approach to how professionalism is embedded in their curricula. [ABSTRACT FROM AUTHOR]

Rationale: Public health and preventive medicine (PHPM) has been recognized internationally as a physician specialty, but national parallels and differences exist between training contexts. This paper reviews PHPM training and employment in Canada, France, Italy, Japan, the United Kingdom, and the USA. Methods: Information gathered from relevant accreditation bodies and literature searches was used to create descriptive profiles of national training demographics and structure and a narrative outlining trends and challenges facing the specialty. Results: Notable similarities and differences exist between national contexts. Key themes were differences in training strategies and practice scope, specialty stakeholders, certification structure, and funding. Recognition challenges faced the specialty across all six countries. Other challenges included unclear competencies and training strategies and a need for PHPM specialists to highlight their role in combating population health threats. Additional differences existed between comparator countries on the structure of training, funding sources for training programs, availability of training posts, and linkages with other physician specialties. Conclusion: Highlighting these themes is a first step to fostering training collaborations between PHPM specialist physicians to augment transnational action on global public health challenges and also supports PHPM physician educators with innovative solutions from abroad that might address domestic specialty challenges. [ABSTRACT FROM AUTHOR]

Purpose: Changing the current geographical maldistribution of the medical workforce is important for global health. Research regarding programs that train doctors for work with disadvantaged, rural populations is needed. This paper explores one approach of remote supervision of registrars in isolated rural practice. Researching how learning occurs without on-site supervision may also reveal other key elements of postgraduate education. Methods: Thematic analysis of in-depth interviews exploring 11 respondents’ experiences of learning via remote supervision. Results: Remote supervision created distinctive learning environments. Respondents’ attributes interacted with external supports to influence whether and how their learning was promoted or impeded. Registrars with clinical and/or life experience, who were insightful and motivated to direct their learning, turned the challenges of isolated practice into opportunities that accelerated their professional development. Discussion: Remote supervision was not necessarily problematic but instead provided rich learning for doctors training in and for the context where they were needed. Registrars learnt through clinical responsibility for defined populations and longitudinal, supportive supervisory relationships. Responsibility and continuity may be as important as supervisory proximity for experienced registrars. [ABSTRACT FROM PUBLISHER]

Background: Throughout their careers, doctors and other healthcare professionals experience numerous transitions. When supporting transitions, opportunities for development and learning should be maximized, while stressors having negative impacts on well-being should be minimized. Building on our international data, this study aimed to develop a conceptual model of the trainee-trained transition (i.e. the significant transitions experienced by doctors as they complete postgraduate training moving from trainee/resident status to medical specialist roles). Methods: Employing Multiple and Multidimensional Transitions (MMT) theory and current conceptualizations of clinical context, this study undertook secondary analysis of 55 interviews with doctors from three countries (Netherlands, Cananda and the UK) undergoing trainee-trained transitions. Results: Through this analysis, the Transition-To-Trained-Doctor (T3D) conceptual model has been developed. This model takes into consideration the multiple contexts and multiple domains in which transitions take place. Discussion: This model is significant in that it has several uses and is applicable across countries: to remind doctors, managers and medical educators of the complexity of transitions; to frame and facilitate supportive conversations; and as a basis to teach about transitions. [ABSTRACT FROM AUTHOR]

In 2019, the American Association of Medical Colleges (AAMC) identified the discipline of medical humanities as a priority in medical education. Although medical humanities programs have existed in medical and osteopathic schools in the U.S. and Canada since the late 1960's, this interdisciplinary field remains difficult to define. We studied the mission statements of medical humanities programs to identify core themes and priorities. We conducted a content analysis of U.S. and Canada medical humanities MD and DO mission statements and associated descriptions (n = 56). We compared themes across programs whose directors had a clinical degree versus a terminal research degree, conducted comparisons between medical humanities programs housed in medical schools ranked in Top 20 U.S. News and World Report for Research or Primary Care, and conducted a word frequency analysis. Content analysis revealed five themes: improving patient care, improving the provider experience, generating scholarship, cultivating community relationships, and promoting diversity/sociocultural awareness. 70% of programs emphasized patient care and provider experience. Only 34% included the promotion of diversity/sociocultural awareness as a theme. Word frequency analysis corroborated our findings. U.S. and Canada medical humanities programs focus primarily on improving patient care and provider wellness. [ABSTRACT FROM AUTHOR]

Bias pervades every aspect of healthcare including admissions, perpetuating the lack of diversity in the healthcare workforce. Admissions interviews may be a time when applicants to health profession education programs experience discrimination. Between January and June 2021 we invited US and Canadian applicants to health profession education programs to complete a survey including the Everyday Discrimination Scale, adapted to ascertain experiences of discrimination during admissions interviews. We used chi-square tests and multivariable logistic regression to determine associations between identity factors and positive responses. Of 1115 respondents, 281 (25.2%) reported discrimination in the interview process. Individuals with lower socioeconomic status (OR: 1.78, 95% CI [1.26, 2.52], p = 0.001) and non-native English speakers (OR: 1.76, 95% CI [1.08, 2.87], p = 0.02) were significantly more likely to experience discrimination. Half of those experiencing discrimination (139, or 49.6%) did nothing in response, though 44 (15.7%) reported the incident anonymously and 10 (3.6%) reported directly to the institution where it happened. Reports of discrimination are common among HPE applicants. Reforms at the interviewer- (e.g. avoiding questions about family planning) and institution-level (e.g. presenting institutional efforts to promote health equity) are needed to decrease the incidence and mitigate the impact of such events. [ABSTRACT FROM AUTHOR]

The authors convey their views on Consensus Statements and Recommendations relating to assessment in the healthcare professions in several areas. The Consensus Statements offered an opportunity to identify areas of weakness to further advance the field of assessment. An additional Consensus Statement was produced in 2016 that addressed best assessment practice in interprofessional education. Information on the 2018 Ottawa Consensus Framework for Good Assessment is presented.

The article presents news briefs regarding medical education and the Association for Medical Education In Europe (AMEE), including previews of events for the pending September 4-9, 2015 AMEE conference in Glasgow, Scotland, details regarding the AMEE Medical Education Fellowship Awards, and trivia questions and answers regarding medical education.

Each spring, thousands of Canadian medical students travel across the country to interview for residency positions, a process known as the CaRMS tour. Despite the large scale of travel, the CaRMS tour has received little environmental scrutiny. To estimate the national carbon footprint of flights associated with the CaRMS tour, as well as reductions in emissions achievable by transitioning to alternative models. We developed a three-question online commuter survey to collect the unique travel itineraries of applicants in the 2020 CaRMS tour. We calculated the emissions associated with all flights and modelled expected emissions for two alternative in-person interview models, and two virtual interview models. We collected 960 responses out of 2943 applicants across all 17 Canadian medical schools. We calculated the carbon footprint of flights for the 2020 CaRMS as 4239 tCO2e (tonnes of carbon dioxide equivalents), averaging 1.44 tCO2e per applicant. The average applicant's tour emissions represent 35.1% of the average Canadian's annual household carbon footprint, and the emissions of 26.7% of respondents exceeded their entire annual '2050 carbon budget.' Centralized in-person interviews could reduce emissions by 13.7% to 74.7%, and virtual interviews by at least 98.4% to 99.9%. Mandatory in-person residency interviews in Canada contribute significant emissions and reflect a culture of emissions-intensive practices. Considerable decarbonization of the CaRMS tour is possible, and transitioning to virtual interviews could eliminate the footprint almost entirely. [ABSTRACT FROM AUTHOR]

Programmatic assessment is a longitudinal, developmental approach that fosters and harnesses the learning function of assessment. Yet the implementation, a critical step to translate theory into practice, can be challenging. As part of the Ottawa 2020 consensus statement on programmatic assessment, we sought to provide descriptions of the implementation of the 12 principles of programmatic assessment and to gain insight into enablers and barriers across different institutions and contexts. After the 2020 Ottawa conference, we surveyed 15 Health Profession Education programmes from six different countries about the implementation of the 12 principles of programmatic assessment. Survey responses were analysed using a deductive thematic analysis. A wide range of implementations were reported although the principles remained, for the most part, faithful to the original enunciation and rationale. Enablers included strong leadership support, ongoing faculty development, providing students with clear expectations about assessment, simultaneous curriculum renewal and organisational commitment to change. Most barriers were related to the need for a paradigm shift in the culture of assessment. Descriptions of implementations in relation to the theoretical principles, across multiple educational contexts, coupled with explanations of enablers and barriers, provided new insights and a clearer understanding of the strategic and operational considerations in the implementation of programmatic assessment. Future research is needed to further explore how contextual and cultural factors affect implementation. [ABSTRACT FROM AUTHOR]

Given barriers of patient-centred care (PCC) among physicians and trainees, this study assessed how medical schools addressed PCC in curriculum. The authors used content analysis to describe PCC in publicly-available curriculum documents of Canadian medical schools guided by McCormack's PCC Framework, and reported results using summary statistics and text examples. The authors retrieved 1459 documents from 16 medical schools (median 49.5, range 16–301). Few mentioned PCC (301, 21.2%), and even fewer thoroughly or accurately described PCC. Significantly more clerkship versus pre-clerkship (24.0% vs 12.6%, p < 0.00001), and elective compared with core course descriptions (24.7% vs 14.9%, p < 0.00001) mentioned PCC. The domain of foster a healing relationship was common (79.0%) compared with other domains: address concerns (16.5%), exchange information (14.9%), enable self-care (10.4%), share decisions (4.5%), and manage uncertainty (1.3%). Overall, few documents mentioned or described PCC or related concepts. This varied by school, and was more frequent in clerkship and elective courses, suggesting that student exposure may be brief and variable. Thus, it remains unclear if medical students are fully exposed to what PCC means and how to implement it. Future research is needed to confirm if PCC content in medical curriculum is lacking. [ABSTRACT FROM AUTHOR]

Faculty Development (FD) plays a key role in supporting education, especially during times of change. The effectiveness of FD often depends upon organizational factors, indicating a need for a deeper appreciation of the role of institutional context. How do organizational factors constrain or enhance the capacity of faculty developers to fulfil their mandates? Using survey research methodology, data from a survey of FD leaders at Canadian medical schools were analyzed using Bolman and Deal's four frames: Symbolic, Political, Structural, and Human Resource (HR). In the Symbolic frame, FD leaders reported lack of identity as a FD unit, which was seen as a constraining factor. Within the Political frame, developing visibility was seen as an enhancing factor, though it did not always ensure being valued. In the Structural frame, expanding scope of practice was seen as an enhancing factor, though it could also be a constraining factor if not accompanied by increased resources. In the HR frame, a sense of instability due to changing leadership and uncertainty about human resources was seen as a constraining factor. While broadening the mandate of FD can generally be considered as positive, it is imperative that it is appropriately resourced and accompanied by recognition of FD as a valued contributor to the educational mission. [ABSTRACT FROM AUTHOR]

Involving patients in medical education as teachers is not a novel approach, yet it has not been widely adopted by undergraduate surgical curricula in Canada. The Patients as Teachers initiative in surgery (PAT) program, with an arts-based reflection assignment, was developed for surgical clerks with the goals of emphasizing patient-centredness in surgical practice, humanistic aspects of medicine, and to counterbalance the commonplace emphasis on technical competency in surgery. Qualitative data was collected exploring the question: What was the experience and impact of the PAT program on patient teachers and students? Patient teachers (n = 5) were invited to participate in one-on-one interviews and students (n = 46) were invited to participate in focus groups at the end of the program. Findings converged around two main themes: what students/patient teachers valued about the PAT program and what they perceived was learned. While patient teachers felt a sense of emotional healing and appreciated a chance to contribute to medical education, students valued having protected time to learn in depth from the patient teachers. Students also begrudgingly came to appreciate the arts-based reflection assignment. By bringing patient voice to the forefront and encouraging reflection, the PAT program emphasized to students the compassionate and humanistic side of surgical care. Future studies could examine the mechanisms by which learning occurs and long-term impacts. [ABSTRACT FROM AUTHOR]

The Royal College of Physicians and Surgeons of Canada (RCPSC) has begun the transition to Competency by Design (CBD), a new curricular model for residency education that 'ensure[s] competence, but teaches for excellence'. By 2022, all Canadian specialty programs are anticipated to have completed the CBD cohort process which includes workshops facilitated by a Royal College Clinician Educator. Queen's University in Ontario, Canada, was granted approval by the RCPSC to embark upon an accelerated path to competency-based medical education (CBME) for all our postgraduate specialties. This accelerated path allowed us to take an institutional approach for CBME implementation and ensure that all specialities were part of a system-wide change. Our unique institution-wide approach to CBD is the first of its kind across Canada. From both a theoretical and practical perspective we undertook CBME using a systems approach that allowed us to build the foundations for CBME, implement the change, and plan for sustainability. This has created opportunities to bridge and connect the various programs involved in the implementation of CBME on Queen's campus. The systems approach was an essential part of our strategy to develop a community dedicated to ensuring a successful CBME implementation. [ABSTRACT FROM AUTHOR]

Purpose: Medical schools are expected to engage in ongoing reflection to maintain the quality of the education they deliver, that is, to cultivate a Quality Culture. Quality Culture integrates the culture of an organization with its structure and management processes. The culture of medical schools has not been previously studied. Organizational cultures can be identified using the Competing Value Questionnaire, and classified into four types, based on organizations' climate, leader style, reward systems, and strategic emphasis. Clan and Open cultures are typically positively associated with quality improvement. This study identifies the dominant organizational cultures of Canadian medical schools. Method: Sixteen of the 17 Canadian medical schools were invited to participate; one school was excluded due to ongoing accreditation activities. Faculty members of participating schools were surveyed. Results: Eleven (69%) schools participated. Nine had a dominant Hierarchical culture; two had a dominant Clan culture. Conclusions: Only two schools had a Clan culture, which might better support ongoing reflections on quality improvement. Schools leaders should examine the staff climate, leadership style, rewards system, and strategic emphasis in place at their school; these will provide clues to the existing culture and help prioritize changes required to support the implementation of a Quality Culture. [ABSTRACT FROM AUTHOR]

Background: In 2009, an International Working Group (IWG) on the Assessment of Professionalism began collaborating and published recommendations in 2011. Nearly a decade later the IWG reconvened to take stock of the state of practice and research in professionalism and the impact of the 2011 report. Method: A bibliometric study identified all publications on assessment of professionalism since 2011, noting those that cited the original report. Articles were coded to identify the reason for citation and new trends in assessment. Bibliometric data were supplemented by discussion groups held at key international education meetings. Results: Six-hundred publications on the assessment of professionalism were found in Google Scholar and 164 in Web of Science since 2011, of which 177 (30%) and 84 (50%) respectively cited the original IWG publication. English language publications were most common (83%), but there were articles in 13 other languages by authors from 40 countries. The report was cited commonly to justify attention to professionalism in general (41%), assessment of professionalism (38%) and to explore professionalism in different countries and professions (25%). A thematic analysis showed that of 9 research areas recommended in 2011, 7 of 9 categories were represented with a large increase in research across languages and cultures. Conclusions: Though the assessment of professionalism remains a challenge the research base continues to grow, especially related to professionalism across cultures and languages, and a large percentage of publications cite the IWG recommendations. There remains a gap in research and writing about patients' perspectives. [ABSTRACT FROM AUTHOR]

Background: Policies to guide remediation in postgraduate medical education exist in all Canadian medical schools. This study examines concordance between these policies and processes, and published "best practices" in remediation. Method: We conducted a literature review to identify best practices in the area of remediation. We then reviewed remediation policies from all 13 English medical schools in Canada other than our own and conducted interviews with key informants from each institution. Each policy and interview transcript pair was then reviewed for evidence of pre-defined "best practices." Team members also noted additional potential policy or process enablers of successful remediation. Results: Most policies and processes aligned with some but not all published best practices. For instance, all participating schools tailored remediation strategies to individual resident needs, and a majority encouraged faculty-student relationships during remediation. Conversely, few required the teaching of goal-setting, strategic planning, self-monitoring, and self-awareness. In addition, we identified avoidance of automatic training extension and the use of an educational review board to support the remediation process as enablers for success. Discussion: Remediation policies and practices in Canada align well with published best practices in this area. Based on key informant opinions, flexibility to avoid training extension and use of an educational review board may also support optimal remediation outcomes. [ABSTRACT FROM AUTHOR]

This literature review describes the impact of health professional schools with a social accountability mandate by identifying characteristics of medical education found to impact positively on medical students, health workforce, and health outcomes of disadvantaged communities. A critical appraisal tool was used to identify the strengths and weaknesses of the published articles. Data are presented as a narrative synthesis due to the variety of methodologies in the studies, and characterized using a logic model. Health professional schools aiming to improve health outcomes for their disadvantaged local communities described collaborative partnerships with communities, equitable selection criteria, and community-engaged placements in underserved areas as positively impacting the learning and attitudes of students. Students of socially accountable schools were more likely to stay in rural areas and serve disadvantaged communities, and were often more skilled than students from more traditional schools to meet the needs of underserved communities. However, published literature on the impact of socially accountable health professional education on communities and health outcomes is limited, with only one study investigating health outcomes. The findings of this literature review guide schools on the inputs likely to maximize their socially accountability outputs and increase their impact on students, local health workforce and local communities. [ABSTRACT FROM PUBLISHER]

Objectives:Most medical schools using progress tests (PTs) provide feedback by utilizing a traffic-light system of green (satisfactory), yellow (borderline) and red (unsatisfactory) categories. There is little research assessing students’ perceptions or usage of this feedback. Therefore this study proposed to determine the effectiveness of formative PTs at informing and supporting student progress. Methods:A mixed methods study was performed, involving a retrospective analysis of a results database to establish the predictive validity of PT categories and 11 semi-structured interviews to explore students’ perceptions of PT feedback in a graduate entry medical programme. Results:Quantitative analysis revealed that students who always scored green performed better in their summative exams and graduated with a higher final degree than those who received a yellow or red category at least once. Qualitative analysis revealed that just over half of the interviewed students perceived the PT as having informed their progress. Most participants agreed that the current feedback is insufficient and doesn’t guide their on-going learning. Conclusion:While this study demonstrated that the PT is a useful predictive tool for informing student progress, in its current format it’s not fulfilling a truly formative role and supporting student progress sufficiently. [ABSTRACT FROM PUBLISHER]

Background: Simulated office orals (SOOs) are used by the College of Family Physicians of Canada as a method to evaluate family medicine resident readiness for clinical practice. The use of SOOs as a progress test would provide residency programs with useful information to determine resident readiness for challenging the certification exam. The data from a progress test could then be easily manipulated to generate a risk assessment plot. Methods: During a prospective cohort study conducted at the University of Ottawa, the feasibility of using practice SOO sessions, a structured clinical exam, as a progress test was explored. Twenty-three residents participated in all four practice SOO sessions and their results were entered into a risk assessment plot. Results: Repeated measures analysis of the data using ANOVA demonstrated that the residents’ scores at each time point were statistically different from each other, generating anF(3, 66) = 27.52,p < 0.001,η2 = 0.55.and that the relationship over time was linear with anF(1, 22) = 123.80,p < 0.001,η2 = 0.85. At the final time point, a risk assessment resulted in no learners mapping to quadrants III or IV. Conclusions: Our results demonstrate the feasibility of utilizing a SOO exam, a clinical exam, as a progress test. In addition, we propose generating a risk assessment plot, using the data from the Fall 2013 and Spring 2014 practice SOO sessions, as a means of identifying residents at risk. Further studies will be needed to confirm the utility of this analysis. Combined with other measures acquired during in-training evaluation, the utilization of practice SOOs as a progress test will provide program directors with valuable information on resident progression. [ABSTRACT FROM AUTHOR]

Objective: The purpose of this study is to investigate whether webcast lectures are comparable to live lectures as a teaching tool in medical school. Methods: Three Otolaryngology-Head&Neck Surgery (OTO-HNS) lectures were given to third year medical students through their regular academic curriculum with one group receiving lectures in a live lecture format and the other group in a webcast format. All lectures (live or webcast) were given by the same lecturer and contained identical material. Three outcome measures were used: a student satisfaction survey, performance on the OTO-HNS component of their written examination, and performance on an OTO-HNS OSCE station in the general end of year OSCE examination session. Results: Students performance on the written examination was equal between the two groups. The webcast group outperformed the live lecture group in the OSCE station. The majority of students in the webcast group felt it was an effective learning tool for them. Most viewed the lectures more than once, and felt that this was beneficial to their learning. Conclusion: Webcasts appear equally effective to live lectures as a teaching tool. [ABSTRACT FROM PUBLISHER]

Background: Medical schools are confronted with the challenge of teaching professionalism during medical training. The aim of this study was to examine medical students’ perceptions of using video clips as a beneficial teaching tool to learn professionalism and other aspects of physicianship. Methods: As part of the longitudinal Physician Apprenticeship course at McGill University, first year medical students viewed video clips from the television seriesER. The study used qualitative description and thematic analysis to interpret responses to questionnaires, which explored the educational merits of this exercise. Results: Completed questionnaires were submitted by 112 students from 21 small groups. A major theme concerned the students’ perceptions of the utility of video clips as a teaching tool, and consisted of comments organized into 10 categories: “authenticity and believability”, “thought provoking”, “skills and approaches”, “setting”, “medium”, “level of training”, “mentorship”, “experiential learning”, “effectiveness” and “relevance to practice”. Another major theme reflected the qualities of physicianship portrayed in video clips, and included seven categories: “patient-centeredness”, “communication”, “physician-patient relationship”, “professionalism”, “ethical behavior”, “interprofessional practice” and “mentorship”. Conclusions: This study demonstrated that students perceived the value of using video clips from a television series as a means of teaching professionalism and other aspects of physicianship. [ABSTRACT FROM PUBLISHER]

Several influential national/international bodies including The Bologna Accord, The Carnegie Foundation and The Future of Medical Education in Canada (FMEC) have called for increased coordination across the medical education continuum. FMEC recognizes accreditation as a 'powerful lever' and encourages the alignment of undergraduate and postgraduate standards. The Carnegie Foundation includes a similar call for the creation of a more coherent accreditation system. As a first step, using the Canadian context, we present a methodological approach that assesses the example of how well LCME/CACMS undergraduate accreditation standards align with the Royal College of Physician and Surgeons of Canada (RCPSC) postgraduate training standards. We analyzed how closely the 132 LCME/CACMS Medical School accreditation standards aligned with the 155 post-graduate standards from the RCPSC accreditation General Standards (A and B). This comparative evaluation demonstrates that the standards do not align closely. Gaps, redundancies and key differences are highlighted. These results are the first step in understanding how accreditation needs to be adapted and re-aligned across the education continuum to provide consistent and coordinated training and these methods could easily be applied to other contexts and jurisdictions. [ABSTRACT FROM AUTHOR]