Search

The Ottawa Conference on the Assessment of Competence in Medicine and the Healthcare Professions was first convened in 1985 in Ottawa. Since then, what has become known as the Ottawa conference has been held in various locations around the world every 2 years. It has become an important conference for the community of assessment – including researchers, educators, administrators and leaders – to share contemporary knowledge and develop international standards for assessment in medical and health professions education. The Ottawa 2022 conference was held in Lyon, France, in conjunction with the AMEE 2022 conference. A diverse group of international assessment experts were invited to present a symposium at the AMEE conference to summarise key concepts from the Ottawa conference. This paper was developed from that symposium. This paper summarises key themes and issues that emerged from the Ottawa 2022 conference. It highlights the importance of the consensus statements and discusses challenges for assessment such as issues of equity, diversity, and inclusion, shifts in emphasis to systems of assessment, implications of 'big data' and analytics, and challenges to ensure published research and practice are based on contemporary theories and concepts. [ABSTRACT FROM AUTHOR]

In an arts integrated interdisciplinary study set to investigate ways to improve social accountability (SA) in medical education, our research team has established a renewed understanding of compassion in the current SA movement. This paper explores the co-evolution of compassion and SA. The study used an arts integrated approach to investigate people's perceptions of SA in four medical schools across Australia, Canada, and the USA. Each school engaged approximately 25 participants who partook in workshops and in-depth interviews. We began with a study of SA and the topic of compassion emerged out of our qualitative data and biweekly meetings within the research team. Content analysis of the data and pedagogical discussion brought us to realize the importance of compassion in the practice of SA. The cultivation of compassion needs to play a significant role in a socially accountable medical educational system. Medical schools as educational institutions may operate themselves with compassion as a driving force in engaging partnership with students and communities. Social accountability without compassion is not SA; compassion humanizes institutional policy by engaging sympathy and care. [ABSTRACT FROM AUTHOR]

A social accountability mandate for Canadian medical schools formally emerged in Canada with changes to accreditation standards in 2015. However, how social accountability is defined and operationalized within medical schools has transpired independently. Key enablers of social accountability in Canadian medical schools have been largely unexplored. This paper is the first of a two part series that seeks to explore drivers of social accountability in a sample of Canadian medical schools. Nine key drivers of social accountability emerged from the data including a unified vision, committed leadership, accreditation standards, champions of social accountability, authentic community engagement, community-based learning opportunities, a supportive organizational and governance structure, diversity within medical schools, and measurement of progress and outcomes. This is the first study of its kind to examine what is driving social accountability across Canadian medical schools. An appreciative inquiry approach highlights areas of progress for future work to focus and build upon. This paper presents the findings from part one of the study – exploring the themes emerging from key informant interviews with senior leaders. A second paper will dive into the broader perspectives of faculty, staff and students, to explore more fully the varying perspectives of social accountability within colleges. [ABSTRACT FROM AUTHOR]

In 2011 the Consensus Statement on Performance Assessment was published in Medical Teacher. That paper was commissioned by AMEE (Association for Medical Education in Europe) as part of the series of Consensus Statements following the 2010 Ottawa Conference. In 2019, it was recommended that a working group be reconvened to review and consider developments in performance assessment since the 2011 publication. Following review of the original recommendations in the 2011 paper and shifts in the field across the past 10 years, the group identified areas of consensus and yet to be resolved issues for performance assessment. This paper addresses developments in performance assessment since 2011, reiterates relevant aspects of the 2011 paper, and summarises contemporary best practice recommendations for OSCEs and WBAs, fit-for-purpose methods for performance assessment in the health professions. [ABSTRACT FROM AUTHOR]

Indigenous Peoples across Turtle Island (North America) experience ongoing health disparities tied to the effects of colonization and persistent racism toward Indigenous Peoples. Educating future clinicians to develop a critical consciousness is an important way to work toward cultural safety and improve the health care experiences of Indigenous patients. The present study evaluated the ability of the KAIROS Blanket Exercise (KBE) to foster critical consciousness. Two hundred thirteen medical students at the University of Toronto participated in the KBE. Subsequently, 174 students completed a paper evaluation, designed to capture concepts of cultural safety and critical consciousness. Data were analyzed using quantitative and qualitative methods to identify shifts in perspectives. The majority of students reported the exercise altered the way they viewed those from backgrounds different from their own, and comments regarding bias, power and privilege were highlighted throughout the responses. Engaging in critical reflection through dialogue and revealing the complex sociopolitical context of Indigenous Peoples' history were emphasized as central to this transformation. Following participation in the KBE, medical students demonstrated a shift in their perspectives. This suggests that creating curricular space for critical pedagogy may be effective in fostering critical consciousness, ultimately encouraging reflexive practice and social action. [ABSTRACT FROM AUTHOR]

In response to the numerous challenges resident trainees currently face in their ability to competently acquire the requisite skills, knowledge and attitudes upon graduation, medical educators have looked to a competency-based medical education (CBME) approach as a possible solution. As CBME has already been implemented in many jurisdictions around the world, certain challenges in implementation have been experienced. One important challenge identified relates to how regulatory bodies can either assist or unintentionally hinder implementation. By examining the varied experiences from Canada, the USA and the Netherlands in implementing CBME, this paper identifies how regulatory bodies can support and advance worldwide efforts of furthering its implementation. If regulatory bodies restructure accreditation and regulatory criteria to align with CBME principles, work together in a coordinated fashion to ensure alignment of vital regulatory meaures throughout the training and practice continuum of a physician, and allow for (if not incentivize) individuals and programs to be innovative in adapting CBME to meet their local environments, it is likely that the worldwide implementation of CBME will occur successfully. [ABSTRACT FROM AUTHOR]

This paper presents perspectives and controversies surrounding the use of milestones to assess competency in outcomes-based medical education. Global perspectives (Canada, Europe, and the United States) and developments supporting their rationales are discussed. In Canada, there is a significant movement away from conceptualizing competency based on time, and a move toward demonstration of specific competencies. The success of this movement may require complex (rather than reductionist) milestones that reflect students' progression through complexity and context and a method to narrate their journey. European countries (United Kingdom, France, and Germany) have stressed the complexity associated with time and milestones for medical students to truly achieve competence. To meet the changing demands of medicine, they view time as actually providing students with knowledge and exposure to achieve various milestones. In the United States, milestones are based on sampling throughout professional development to initiate lifelong learning. However, the use of milestones may not imply overall competence (reductionism). Milestones must be developed alongside outcomes-based curriculum with use of faculty and competency committees. The perspectives outlined in this paper underscore emerging challenges for implementing outcomes-based medical education and call for new conceptualizations of competence. [ABSTRACT FROM AUTHOR]

Background: The recognition of medical professionalism as a complex social construct makes context, geographical location and culture important considerations in any discussion of professional behaviour. Medical students, medical educators and practitioners are now much more on the move globally, exposing them to cultural and social attitudes, values and beliefs that may differ from their own traditional perceptions of professionalism. Aims and Methods: This paper uses the model of the intercultural development continuum and the concept of 'cultural fit' to discuss what might transpire when a student, teacher or doctor is faced with a new cultural environment. Using our own experiences as medical educators working abroad and supported by evidence in the literature, we have developed four anecdotal scenarios to highlight some of the challenges that different cultural contexts bring to our current (Western) understanding of professionalism. Results and Conclusions: The scenarios highlight some of the potentially different regional and/or cultural perspectives and nuances of professional behaviours, attitudes or values that many of us either take for granted or find difficult, depending on our training and socio-cultural upbringing. With this paper, we hope to start a long overdue conversation about global professionalism amongst medical educators, identify potential areas for research and highlight a need for medical schools to embrace a 'global' approach to how professionalism is embedded in their curricula. [ABSTRACT FROM AUTHOR]

Rationale: Public health and preventive medicine (PHPM) has been recognized internationally as a physician specialty, but national parallels and differences exist between training contexts. This paper reviews PHPM training and employment in Canada, France, Italy, Japan, the United Kingdom, and the USA. Methods: Information gathered from relevant accreditation bodies and literature searches was used to create descriptive profiles of national training demographics and structure and a narrative outlining trends and challenges facing the specialty. Results: Notable similarities and differences exist between national contexts. Key themes were differences in training strategies and practice scope, specialty stakeholders, certification structure, and funding. Recognition challenges faced the specialty across all six countries. Other challenges included unclear competencies and training strategies and a need for PHPM specialists to highlight their role in combating population health threats. Additional differences existed between comparator countries on the structure of training, funding sources for training programs, availability of training posts, and linkages with other physician specialties. Conclusion: Highlighting these themes is a first step to fostering training collaborations between PHPM specialist physicians to augment transnational action on global public health challenges and also supports PHPM physician educators with innovative solutions from abroad that might address domestic specialty challenges. [ABSTRACT FROM AUTHOR]

Purpose: Changing the current geographical maldistribution of the medical workforce is important for global health. Research regarding programs that train doctors for work with disadvantaged, rural populations is needed. This paper explores one approach of remote supervision of registrars in isolated rural practice. Researching how learning occurs without on-site supervision may also reveal other key elements of postgraduate education. Methods: Thematic analysis of in-depth interviews exploring 11 respondents’ experiences of learning via remote supervision. Results: Remote supervision created distinctive learning environments. Respondents’ attributes interacted with external supports to influence whether and how their learning was promoted or impeded. Registrars with clinical and/or life experience, who were insightful and motivated to direct their learning, turned the challenges of isolated practice into opportunities that accelerated their professional development. Discussion: Remote supervision was not necessarily problematic but instead provided rich learning for doctors training in and for the context where they were needed. Registrars learnt through clinical responsibility for defined populations and longitudinal, supportive supervisory relationships. Responsibility and continuity may be as important as supervisory proximity for experienced registrars. [ABSTRACT FROM PUBLISHER]

Background: Needs assessment should be the starting point for curriculum development. In medical education, expert opinion and consensus methods are commonly employed. Aim: This paper showcases a more practice-grounded needs assessment approach. Methods: A mixed-methods approach, incorporating a national survey, practice audit, and expert consensus, was developed and piloted in thrombosis medicine; Phase 1: National survey of practicing consultants, Phase 2: Practice audit of consult service at a large academic centre and Phase 3: Focus group and modified Delphi techniques vetting Phase 1 and 2 findings. Results: Phase 1 provided information on active curricula, training and practice patterns of consultants, and volume and variety of thrombosis consults. Phase 2's practice audit provided empirical data on the characteristics of thrombosis consults and their associated learning issues. Phase 3 generated consensus on a final curricular topic list and explored issues regarding curriculum delivery and accreditation. Conclusions: This approach offered a means of validating expert and consensus derived curricular content by incorporating a novel practice audit. By using this approach we were able to identify gaps in training programs and barriers to curriculum development. This approach to curriculum development can be applied to other postgraduate programs. [ABSTRACT FROM AUTHOR]

Background: Medical education has traditionally been compartmentalized into basic and clinical sciences, with the latter being viewed as the skillful application of the former. Over time, the relevance of basic sciences has become defined by their role in supporting clinical problem solving rather than being, of themselves, a defining knowledge base of physicians. Methods: As part of the national Future of Medical Education in Canada (FMEC MD) project, a comprehensive empirical environmental scan identified the timing and integration of basic sciences as a key pressing issue for medical education. Using the literature review, key informant interviews, stakeholder meetings, and subsequent consultation forums from the FMEC project, this paper details the empirical basis for focusing on the role of basic science, the evidentiary foundations for current practices, and the implications for medical education. Findings: Despite a dearth of definitive relevant studies, opinions about how best to integrate the sciences remain strong. Resource allocation, political power, educational philosophy, and the shift from a knowledge-based to a problem-solving profession all influence the debate. There was little disagreement that both sciences are important, that many traditional models emphasized deep understanding of limited basic science disciplines at the expense of other relevant content such as social sciences, or that teaching the sciences contemporaneously rather than sequentially has theoretical and practical merit. Innovations in integrated curriculum design have occurred internationally. Less clear are the appropriate balance of the sciences, the best integration model, and solutions to the political and practical challenges of integrated curricula. Discussion: New curricula tend to emphasize integration, development of more diverse physician competencies, and preparation of physicians to adapt to evolving technology and patients' expectations. Refocusing the basic/clinical dichotomy to a foundational/applied model may yield benefits in training widely competent future physicians. [ABSTRACT FROM AUTHOR]

In response to the competitive examination culture that pervaded medical education in the 1940s and 1950s the founders of McMaster University's new MD Programme created an assessment system based on group functioning within the tutorial. While the tutorial has served the educational process well, 30 years of experience has highlighted its deficiencies as an assessment tool. This paper describes the accumulation of evidence that led to the awareness of the weakness of tutorial assessment and the attempts to provide reliable assessment by the reintroduction of examinations, but in novel formats which would not alter the goals of the curriculum. [ABSTRACT FROM AUTHOR]

Although the health care community expects its members to make effective presentations, presentation strategies are seldom explicitly taught.Those who do attempt to systematically teach or learn these skills soon realize that 'how to' guides for making effective presentations contain useful, but not sufficient, information. To become an effective presenter, it is necessary to understand not only the generic strategies that characterize effective presentations, but also the context-specific presentation strategies of a particular practice community.The framework for making effective presentations proposed in this paper is grounded in the knowledge of how experts acquire and use strategy knowledge, and takes into account not only the 'how to' of making presentations, but the circumstances and belief systems that determine effective presentation strategies in varying contexts.The framework is designed to make presentation strategy knowledge more transparent, and to permit presenters to learn from every presentation they give and attend. [ABSTRACT FROM AUTHOR]

Background: Educational programs dedicated to pediatric trauma are either not available or comprehensive. Pediatric trauma is thus managed by a range of specialists with training in a variety of related fields. Post-certification fellowships in pediatric medicine all mandate education in the assessment and management of the injured child. The purpose of this study was to develop a blueprint for a national pediatric trauma training curriculum. Methods: A team of four experts developed content for a national pediatric trauma curriculum and disseminated it to 11 pediatric trauma sites across Canada. The objectives contained both knowledge and skill sets related to the management of the pediatric trauma patients. A multi-tiered Delphi process was used to develop the final content. Results: All the 11 pediatric teaching centers across the country participated. A final list, representing a consensus of views, was developed in 10 domains through the iterative process of the Delphi technique. The domains for the curriculum included introduction to pediatric trauma and epidemiology, initial management, pediatric airway, shock, thoracic injuries, abdominal and pelvic injuries, spinal and neurological injuries, pediatric head injuries, burns and electrical injuries, and orthopedic injuries. Conclusion: The Delphi process is an invaluable tool in developing curricula. The pediatric trauma curriculum can be used in teaching hospitals for house staff education and meeting core competencies. The blueprint can be validated further in the future. [ABSTRACT FROM AUTHOR]