Search

PurposeThe authors previously developed and tested a reflective model for facilitating performance feedback for practice improvement, the R2C2 model. It consists of four phases: relationship building, exploring reactions, exploring content, and coaching. This research studied the use and effectiveness of the model across different residency programs and the factors that influenced its effectiveness and use.MethodFrom July 2014-October 2016, case study methodology was used to study R2C2 model use and the influence of context on use within and across five cases. Five residency programs (family medicine, psychiatry, internal medicine, surgery, and anesthesia) from three countries (Canada, the United States, and the Netherlands) were recruited. Data collection included audiotaped site assessment interviews, feedback sessions, and debriefing interviews with residents and supervisors, and completed learning change plans (LCPs). Content, thematic, template, and cross-case analysis were conducted.ResultsAn average of nine resident-supervisor dyads per site were recruited. The R2C2 feedback model, used with an LCP, was reported to be effective in engaging residents in a reflective, goal-oriented discussion about performance data, supporting coaching, and enabling collaborative development of a change plan. Use varied across cases, influenced by six general factors: supervisor characteristics, resident characteristics, qualities of the resident-supervisor relationship, assessment approaches, program culture and context, and supports provided by the authors.ConclusionsThe R2C2 model was reported to be effective in fostering a productive, reflective feedback conversation focused on resident development and in facilitating collaborative development of a change plan. Factors contributing to successful use were identified.

Background Feedback is increasingly seen as a collaborative conversation between supervisors and learners, where learners are actively and reflectively engaged with feedback and use it to improve. Based on this, and through earlier research, we developed an evidence- and theory-informed, 4-phase model for facilitating feedback and practice improvement—the R2C2 model (relationship, reaction, content, coaching). Objective Our goal was to explore the utility and acceptability of the R2C2 model in residency education, specifically for engaging residents in their feedback and in using it to improve, as well as the factors influencing its use. Methods This qualitative study used the principles of design research. We recruited residents and their supervisors in 2 programs, internal medicine and pediatrics. We prepared supervisors to use the R2C2 model during their regular midrotation and/or end-of-rotation feedback sessions with participating residents to discuss their progress and assessment reports. We conducted debriefing interviews with supervisors and residents after each session. We analyzed transcripts as a team using template and content analysis. Results Of 61 residents, 7 residents (11%) participated with their supervisors (n = 5). Schedules and sensitivity to feedback prevented broader enrollment. Supervisors found the structured R2C2 format useful. Residents and supervisors reported that the coaching phase was novel and helpful, and that the R2C2 model engaged both groups in collaborative, reflective, goal-oriented feedback discussions. Conclusions Participants found that using the R2C2 model enabled meaningful feedback conversations, identification of goals for improvement, and development of strategies to meet those goals.

This Conversation Starters article presents a selected research abstract from the 2016 Association of American Medical Colleges Southern Region Group on Educational Affairs annual spring meeting. The abstract is paired with the integrative commentary of three experts who shared their thoughts stimulated by the pilot study. These thoughts probe the concept of patient "ownership" and suggest an alternative way of conceptualizing physicians' total dedication to patient care.

Findings from the science of learning have clear implications for those responsible for teaching and curricular design. However, this data has been historically siloed from educators in practice, including those in health professions education. In this article, we aim to bring practical tips from the science of learning to health professions educators. We have chosen to organize the tips into six themes, highlighting strategies for 1) improving the processing of information, 2) promoting effortful learning for greater retention of knowledge over time, 3) applying learned information to new and varied contexts, 4) promoting the development of expertise, 5) harnessing the power of emotion for learning, and 6) teaching and learning in social contexts. We conclude with the importance of attending to metacognition in our learners and ourselves. Health professions education can be strengthened by incorporating these evidence-based techniques.

PurposeTo explore resident and faculty perspectives on what constitutes feedback culture, their perceptions of how institutional feedback culture (including politeness concepts) might influence the quality and impact of feedback, feedback seeking, receptivity, and readiness to engage in bidirectional feedback.MethodUsing a constructivist grounded theory approach, five focus group discussions with internal medicine residents, three focus group discussions with general medicine faculty, and eight individual interviews with subspecialist faculty were conducted at Brigham and Women's Hospital between April and December 2016. Discussions and interviews were audiotaped and transcribed verbatim; concurrent data collection and analysis were performed using the constant comparative approach. Analysis was considered through the lens of politeness theory and organizational culture.ResultsTwenty-nine residents and twenty-two general medicine faculty participated in focus group discussions, and eight subspecialty faculty participated in interviews. The institutional feedback culture was described by participants as (1) a culture of politeness, in which language potentially damaging to residents' self-esteem was discouraged; and (2) a culture of excellence, in which the institution's outstanding reputation and pedigree of trainees inhibited constructive feedback. Three key themes situated within this broader cultural context were discovered: normalizing constructive feedback to promote a culture of growth, overcoming the mental block to feedback seeking, and hierarchical culture impeding bidirectional feedback.ConclusionsAn institutional feedback culture of excellence and politeness may impede honest, meaningful feedback and may impact feedback seeking, receptivity, and bidirectional feedback exchanges. It is essential to understand the institutional feedback culture before it can be successfully changed.

Purpose To develop and conduct feasibility testing of an evidence-based and theory-informed model for facilitating performance feedback for physicians so as to enhance their acceptance and use of the feedback. Method To develop the feedback model (2011-2013), the authors drew on earlier research which highlights not only the factors that influence giving, receiving, accepting, and using feedback but also the theoretical perspectives which enable the understanding of these influences. The authors undertook an iterative, multistage, qualitative study guided by two recognized research frameworks: the UK Medical Research Council guidelines for studying complex interventions and realist evaluation. Using these frameworks, they conducted the research in four stages: (1) modeling, (2) facilitator preparation, (3) model feasibility testing, and (4) model refinement. They analyzed data, using content and thematic analysis, and used the findings from each stage to inform the subsequent stage. Results Findings support the facilitated feedback model, its four phasesbuild relationship, explore reactions, explore content, coach for performance change (R2C2)and the theoretical perspectives informing them. The findings contribute to understanding elements that enhance recipients' engagement with, acceptance of, and productive use of feedback. Facilitators reported that the model made sense and the phases generally flowed logically. Recipients reported that the feedback process was helpful and that they appreciated the reflection stimulated by the model and the coaching. Conclusions The theory- and evidence-based reflective R2C2 Facilitated Feedback Model appears stable and helpful for physicians in facilitating their reflection on and use of formal performance assessment feedback.

Distributed medical education (DME) is a type of distance learning in which students participate in medical education from diverse geographic locations using Web conferencing, videoconferencing, e-learning, and similar tools. DME is becoming increasingly widespread in North America and around the world. Although relatively new to medical education, distance learning has a long history in the broader field of education and a related body of literature that speaks to the importance of engaging in rigorous and theoretically informed studies of distance learning. The existing DME literature is helpful, but it has been largely descriptive and lacks a critical "lens"-that is, a theoretical perspective from which to rigorously conceptualize and interrogate DME's social (relationships, people) and material (technologies, tools) aspects. The authors describe DME and theories about distance learning and show that such theories focus on social, pedagogical, and cognitive considerations without adequately taking into account material factors. They address this gap by proposing sociomateriality as a theoretical framework allowing researchers and educators to study DME and (1) understand and consider previously obscured actors, infrastructure, and other factors that, on the surface, seem unrelated and even unimportant; (2) see clearly how the social and material components of learning are intertwined in fluid, messy, and often uncertain ways; and (3) perhaps think differently, even in ways that disrupt traditional approaches, as they explore DME. The authors conclude that DME brings with it substantial investments of social and material resources, and therefore needs careful study, using approaches that embrace its complexity.

Item does not contain fulltext

Item does not contain fulltext AIM: Self-assessment and reflection are essential for meaningful feedback. We aimed to explore whether the well-known Johari window model of self-awareness could guide feedback conversations between faculty and residents and enhance the institutional feedback culture. METHODS: We had previously explored perceptions of residents and faculty regarding sociocultural factors impacting feedback. We re-analyzed data targeting themes related to self-assessment, reflection, feedback seeking and acceptance, aiming to generate individual and institutional feedback strategies applicable to each quadrant of the window. RESULTS: We identified the following themes for each quadrant: (1) Behaviors known to self and others - Validating the known; (2) Behaviors unknown to self but known to others - Accepting the blind; (3) Behaviors known to self and unknown to others - Disclosure of hidden; and (4) Behaviors unknown to self and others - Uncovering the unknown. Normalizing self-disclosure of limitations, encouraging feedback seeking, training in nonjudgmental feedback and providing opportunities for longitudinal relationships could promote self-awareness, ultimately expanding the "open" quadrant of the Johari window. CONCLUSIONS: The Johari window, a model of self-awareness in interpersonal communications, could provide a robust framework for individuals to improve their feedback conversations and institutions to design feedback initiatives that enhance its quality and impact.

Health systems are in the midst of a transformation that is being driven by a variety of forces. This has important implications for medical educators because clinical practice environments play a key role in learning and professional development, and evolving health systems are beginning to demand that providers have "systems-ready" knowledge, attitudes, and skills. Such implications provide a clear mandate for medical schools to modify their goals and prepare physicians to practice flexibly within teams and effectively contribute to the improvement of health care delivery. In this context, the concepts of value-added medical education, authentic student roles, and health systems science are emerging as increasingly important. In this Article, the authors use a lens informed by communities of practice theory to explore these three concepts, examining the implications that the communities of practice theory has in the constructive reframing of educational practices-particularly common student roles and experiences-and charting future directions for medical education that better align with the needs of the health care system. The authors apply several key features of the communities of practice theory to current experiential roles for students, then propose a new approach to students' clinical experiences-value-added clinical systems learning roles-that provides students with opportunities to make meaningful contributions to patient care while learning health systems science at the patient and population level. Finally, the authors discuss implications for professional role formation and anticipated challenges to the design and implementation of value-added clinical systems learning roles.

SummaryBackground Communicating with adolescent patients can be challenging. Our study assessed the effect of structured feedback following a standardised patient (SP) encounter on postgraduate year-1 (PGY1) residents’ adolescent-specific communication skills. Communicating with adolescent patients can be challenging Methods A two-group, prospective, double-blind randomised control study design was employed. Measures were taken before and after the intervention. PGY1 residents conducted a 30-minute interview with an SP adolescent–mother pair, who then individually scored the resident's performance using the validated Structured Communication Adolescent Guide (SCAG). PGY1s were randomised to receive either structured feedback following the interview (feedback group) or no feedback (no feedback group). All residents completed a second interview 4–6 weeks later. Scores were analysed using unpaired t-tests. Results Thirty-eight residents completed both interviews. The mean total-item and mean global scores for the first interview did not differ significantly between the feedback (n = 21) and no-feedback group (n = 17). The mean total-item scores for the feedback group [first interview: 34.19 ± 10.19 (adolescent); 36.33 ± 9.77 (mother)] improved significantly for the second interview [45.17 ± 6.22 (adolescent); 44.71 ± 6.72 (mother); p = 0.002 and 0.003, respectively]. The mean global scores also improved significantly from the first interview [27.00 ± 6.49 (adolescent); 27.47 ± 6.50 (mother)] to the second interview [34.05 ± 3.30 (adolescent); 31.19 ± 3.85 (mother); p = 0.001 and 0.03, respectively]. No significant improvement in the mean total-item or mean global rating was observed in the no feedback group. Conclusions Structured feedback following a single adolescent and mother SP encounter resulted in significant improvement in the adolescent-specific communication skills of PGY1s in performing an adolescent interview.

Clerkship education has been called a 'black box' because so little is known about what, how, and under which conditions students learn. Our aim was to develop a blueprint for education in ambulatory and inpatient settings, and in single encounters, traditional rotations, or longitudinal experiences. We identified 548 causal links between conditions, processes, and outcomes of clerkship education in 168 empirical papers published over 7 years and synthesised a theory of how students learn. They do so when they are given affective, pedagogic, and organisational support. Affective support comes from doctors' and many other health workers' interactions with students. Pedagogic support comes from informal interactions and modelling as well as doctors' teaching, supervision, and precepting. Organisational support comes from every tier of a curriculum. Core learning processes of observing, rehearsing, and contributing to authentic clinical activities take place within triadic relationships between students, patients, and practitioners. The phrase 'supported participation in practice' best describes the educational process. Much of the learning that results is too tacit, complex, contextualised, and individual to be defined as a set of competencies. We conclude that clerkship education takes place within relationships between students, patients, and doctors, supported by informal, individual, contextualised, and affective elements of the learned curriculum, alongside formal, standardised elements of the taught and assessed curriculum. This research provides a blueprint for designing and evaluating clerkship curricula as well as helping patients, students, and practitioners collaborate in educating tomorrow's doctors.

Item does not contain fulltext Phenomenon: Competency-based medical education requires ongoing performance-based feedback for professional growth. In several studies, medical trainees report that the quality of faculty feedback is inadequate. Sociocultural barriers to feedback exchanges are further amplified in graduate and postgraduate medical education settings, where trainees serve as frontline providers of patient care. Factors that affect institutional feedback culture, enhance feedback seeking, acceptance, and bidirectional feedback warrant further exploration in these settings. APPROACH: Using a constructivist grounded theory approach, we sought to examine residents' perspectives on institutional factors that affect the quality of feedback, factors that influence receptivity to feedback, and quality and impact of faculty feedback. Four focus group discussions were conducted, with two investigators present at each. One facilitated the discussion, and the other observed the interactions and took field notes. We audiotaped and transcribed the discussions, and performed a thematic analysis. Measures to ensure rigor included thick descriptions, independent coding by two investigators, and attention to reflexivity. FINDINGS: We identified five key themes, dominated by resident perceptions regarding the influence of institutional feedback culture. The theme labels are taken from direct participant quotes: (a) the cultural norm lacks clear expectations and messages around feedback, (b) the prevailing culture of niceness does not facilitate honest feedback, (c) bidirectional feedback is not part of the culture, (d) faculty-resident relationships impact credibility and receptivity to feedback, and (e) there is a need to establish a culture of longitudinal professional growth. Insights: Institutional culture could play a key role in influencing the quality, credibility, and acceptability of feedback. A polite culture promotes a positive learning environment but can be a barrier to honest feedback. Feedback initiatives focusing solely on techniques of feedback giving may not enhance meaningful feedback. Further research on factors that promote feedback seeking, receptivity to constructive feedback, and bidirectional feedback would provide valuable insights.

Item does not contain fulltext Background: Residents learn by working in a multidisciplinary context, in different locations, with many clinical teachers. Although clinical teachers are collectively responsible for residency training, little is known about the way teaching teams function. Aim: We conducted a qualitative study to explore clinical teachers' views on how teaching teams deliver residency training. Method: Data were collected during six focus group interviews in 2010. Results: The analysis revealed seven teamwork themes: (1) clinical teachers were more passionate about clinical expertise than about knowledge of teaching and teamwork; (2) residents needed to be informed about clinical teachers' shared expectations; (3) the role of the programme director in the teaching team needed further clarification; (4) the main topics of discussion in teaching teams were resident performance and the division of teaching tasks; (5) the structural elements of the organisation of residency training were clear; (6) clinical teachers had difficulty giving and receiving feedback and (7) clinical teachers felt under pressure to be accountable for team performance to external parties. Conclusion: The clinical teachers did not consider teamwork to be of any great significance to residency training. Teachers' views of professionalism and their own experiences as residents may explain their non-teamwork directed attitude. Efforts to strengthen teamwork within teaching teams may impact positively on the quality of residency training.

Effective adolescent (10 to 19 years) interviewing by physicians is an essential skill that many trainees can find challenging.Background We assessed whether structured adolescent interviewing using standardized patients (SPs) and feedback in undergraduate medical education (UME) has a sustained effect on residents' skills.Objective Postgraduate year (PGY) 1 residents conducted interviews with a SP adolescent–mother pair. The SPs independently scored each PGY-1 interview using the structured communication adolescent guide (SCAG). Unpaired t tests were conducted comparing “Total-Item” and “Global” scores of PGY-1s who received structured SP adolescent interviewing with feedback in UME (“structured training” group) to those who had not (“no structured training” group).Methods PGY-1s in the structured training group (n = 23) received significantly higher mean Total-Item scores from both the SP adolescent (40.78 ± 7.04 and 32.41 ± 10.12, respectively; P = .001) and the SP mother (40.48 ± 7.90 and 33.34 ± 10.90, respectively; P = .01) than those without structured training (n = 29). Statistically significant results favoring PGY-1s with prior training were also seen with the SP adolescent and mother total Global SCAG scores.Results Structured training in adolescent interviewing with SPs and feedback in UME appears to have a sustained effect on residents' adolescent interviewing skills. PGY-1s will interview adolescents and may benefit from structured adolescent SP interviewing with feedback, especially individuals who did not have this experience during their medical school training.Conclusions

Distributed medical education (DME) is becoming increasingly prevalent. Much of the published literature on DME has focused on the experiences of learners in distributed programs; however, our empirical work leads us to believe that DME changes the context significantly, not only for learners, but also for other important members of the educational community including audiovisual professionals, administrative professionals and faculty teachers. Based on a three-year ethnographic study, we provide a detailed account of how alliances between various workers involved in DME develop to produce and deliver an undergraduate medical curriculum across geographically separate campuses. We explore the question 'What is the work involved in the delivery of a DME program?' and cast a critical gaze on the essential but invisible, and therefore potentially unrecognized and underappreciated, contributions of AV professionals, administrative professionals, and faculty teachers. Our goal is to make visible the complexity of DME, including the essential contributions of these workers. The study was theoretically framed in sociomateriality and conceptually framed in Star and Strauss' notion of articulation work.

This AMEE Guide provides a framework to guide medical educators engaged in the design and implementation of "Resident as Teacher" programs. The suggested approaches are based on established models of program development: the Program Logic model to guide program design, the Dundee three-circle model to inform a systematic approach to planning educational content and the Kirkpatrick pyramid, which forms the backbone of program evaluation. The Guide provides an overview of Resident as Teacher curricula, their benefits and impact, from existing literature supplemented by insights from the authors' own experiences, all of whom are engaged in teaching initiatives at their own institutions. A conceptual description of the Program Logic model is provided, a model that highlights an outcomes-based curricular design. Examples of activities under each step of this model are described, which would allow educational leaders to structure their own program based on the scope, context, institutional needs and resources available. Emphasis is placed on a modular curricular format to not only enhance the teaching skills of residents, but also enable development of future career educators, scholars and leaders. Application of the Dundee three-circle model is illustrated to allow for a flexible curricular design that can cater to varying levels of educational needs and interests. In addition, practical advice is provided on robust assessment of outcomes, both assessment of participants and program evaluation. Finally, the authors highlight the need for congruence between the formal and hidden curriculum through explicit recognition of the value of teaching by institutions, support for development of teaching programs, encouragement of evidence-based approach to education and rewards for all levels of teachers.

Background: Dalhousie University’s MD Programme faced a one-year timeline for renewal of its undergraduate curriculum. Aim: Key goals were renewed faculty engagement for ongoing quality improvement and increased collaboration across disciplines for an integrated curriculum, with the goal of preparing physicians for practice in the twenty-first century. Methods: We engaged approximately 600 faculty members, students, staff and stakeholders external to the faculty of medicine in a process described by Harris (1993) as ‘deliberative curriculum inquiry’. Temporally overlapping and networked intraprofessional and interprofessional teams developed programme outcomes, completed environment scans of emerging content and best practices, and designed curricular units. Results: The resulting curriculum is the product of new collaborations among faculty and exemplifies distinct forms of integration. Innovations include content and cases shared by concurrent units, foundations courses at the beginning of each year and integrative experiences at the end, and an interprofessional community health mentors programme. Conclusion: The use of deliberative inquiry for pre-med curriculum renewal on a one-year time frame is feasible, in part through the use of technology. Ongoing structures for integration remain challenging. Although faculty collaboration fosters integration, a learner-centred lens must guide its design.

PURPOSE: Doctors will increasingly encounter opportunities to support obese patients in lifestyle change efforts, but the extent to which medical schools prepare their students for this challenge is unknown. Further, despite evidence indicating theory-based techniques are effective in facilitating patients' behavioral changes, the methods taught to medical students and the means of content delivery are unclear. The authors reviewed the literature to investigate how effective educational interventions are in preparing medical students to facilitate lifestyle changes with obese patients. METHOD: The authors systematically searched Excerpta Medica (EMBASE), PsycINFO, MEDLINE, and Scopus for educational interventions on obesity management for medical students published in English between January 1990 and November 2010 and matching PICOS (Population, Interventions, Comparators, Outcomes, Study design) inclusion criteria. RESULTS: Results of a narrative synthesis are presented. Of 1,680 studies initially identified, 36 (2%) full-text articles were reviewed, and 12 (1%) were included in the final dataset. Eleven (92%) of these studies had quantitative designs; of these, 7 (64%) did not include control groups. Nine (75%) of the 12 studies were atheoretical, and 4 (33%) described behavior management strategies. Despite positive reported outcomes regarding intervention evaluations, procedures to control for bias were infrequently reported, and conclusions were often unsupported by evidence. CONCLUSIONS: Evidence from this systematic review revealed data highly susceptible to bias; thus, intervention efficacy could not be determined. Additionally, evidence-based strategies to support patients' obesity-related behavior changes were not applied to these studies, and thus it remains unknown how best to equip medical students for this task.

Background Due to the increasing complexity of medical education and practice, the preparation of healthcare professionals for leadership roles and responsibilities has become increasingly important. To date, the literature on faculty development designed to promote leadership in medical education has not been reviewed in a systematic fashion. Aim The objective of this review is to synthesize the existing evidence that addresses the following question: 'What are the effects of faculty development interventions designed to improve leadership abilities on the knowledge, attitudes, and skills of faculty members in medicine and on the institutions in which they work?' Search strategy The search, which covered the period 1980-2009, included six databases (Medline, EMBASE, CINAHL, Web of Science, ERIC, and ABI/Inform) and used the following keywords: faculty development; in-service training; doctor; medic; physician; faculty; leadership; management; administration; executive; and change agent. Hand searches were also conducted, and expert recommendations were solicited. Inclusion and exclusion criteria Articles with a focus on faculty development to improve leadership, targeting basic science and clinical faculty members, were reviewed. All study designs that included outcome data beyond participant satisfaction were examined. From an initial 687 unique records, 48 articles met the review criteria in three broad categories: (1) reports in which leadership was the primary focus of the intervention; (2) reports in which leadership was a component of a broader focus on educational development; and (3) reports in which leadership was a component of a broader focus on academic career development. Data extraction Data were extracted by three coders using the standardized Best Evidence Medical Education coding sheet adapted for our use. One reviewer coded all of the articles, and two reviewers each coded half of the dataset. Coding differences were resolved through discussion. Data synthesis Data were synthesized using Kirkpatrick's four levels of educational outcomes. Findings were grouped by intervention type and level of outcome. Results Forty-eight articles described 41 studies of 35 different interventions. The majority of the interventions targeted clinical faculty members and included workshops, short courses, fellowships, and other longitudinal programs. The majority of studies were quantitative in nature, though five studies used a qualitative design, and 12 studies used mixed methods. All quantitative studies were quasi-experimental and most employed a single group design; only two studies had a comparison group. Qualitative study designs were typically not specified. The majority of evaluation data, primarily collected post-intervention, consisted of participants' responses to questionnaires and interviews. KEY POINTS AND SUMMARY OF OUTCOMES: Despite methodological limitations, the faculty development literature tends to support the following outcomes: ▪ High satisfaction with faculty development programs. Participants consistently found programs to be useful and of both personal and professional benefit. They also valued the practical relevance and applicability of the instructional methods used. ▪ A change in attitudes toward organizational contexts and leadership roles. Participants reported positive changes in attitudes toward their own organizations as well as their leadership capabilities. Some reported an increased awareness of--and commitment to--their institution's vision and challenges, whereas others reported greater self-awareness of personal strengths and limitations, increased motivation, and confidence in their leadership roles. A greater sense of community and appreciation of the benefits of networking were also identified. ▪ Gains in knowledge and skills. Participants reported increased knowledge of leadership concepts, principles, and strategies (e.g., leadership styles and strategic planning), gains in specific leadership skills (e.g., personal effectiveness and conflict resolution), and increased awareness of leadership roles in academic settings. ▪ Changes in leadership behavior. Self-perceived changes in leadership behavior were consistently reported and included a change in leadership styles, the application of new skills to the workplace (e.g., departmental reorganization and team building), the adoption of new leadership roles and responsibilities, and the creation of new collaborations and networks. Observed changes primarily suggested new leadership positions. ▪ Limited changes in organizational practice. Although not frequently examined, changes in organizational practice included the implementation of specific educational innovations, an increased emphasis on educational scholarship, and the establishment of collegial networks. ▪ Key features of faculty development. Features contributing to positive outcomes included the use of: multiple instructional methods within single interventions; experiential learning and reflective practice; individual and group projects; peer support and the development of communities of practice; mentorship; and institutional support. ▪ Avenues for future development: Moving forward, faculty development programs should: ground their work in a theoretical framework; articulate their definition of leadership; consider the role of context; explore the value of extended programs and follow-up sessions; and promote the use of alternative practices including narrative approaches, peer coaching, and team development. METHODOLOGICAL ISSUES: More rigorous and diverse research designs are needed to capture the complexity of interventions in this area. Varied methods of assessment, utilizing multiple data sources to tap changes at the interpersonal and organizational level should be explored, as should the maintenance of change over time. Process-oriented studies, comparing different faculty development strategies and clarifying the process of change through faculty development, should also become a priority. Conclusion Participants value leadership development activities and report changes in attitudes, knowledge, skills and behavior. Moreover, despite methodological limitations, certain program characteristics seem to be associated with positive outcomes. Further research is required to explore these associations and document changes at both the individual and organizational level.

CONTEXT Conceptualisations of self-assessment are changing as its role in professional development comes to be viewed more broadly as needing to be both externally and internally informed through activities that enable access to and the interpretation and integration of data from external sources. Education programmes use various activities to promote learners' reflection and self-direction, yet we know little about how effective these activities are in 'informing' learners' self-assessments. OBJECTIVES This study aimed to increase understanding of the specific ways in which undergraduate and postgraduate learners used learning and assessment activities to inform self-assessments of their clinical performance. METHODS We conducted an international qualitative study using focus groups and drawing on principles of grounded theory. We recruited volunteer participants from three undergraduate and two postgraduate programmes using structured self-assessment activities (e.g. portfolios). We asked learners to describe their perceptions of and experiences with formal and informal activities intended to inform self-assessment. We conducted analysis as a team using a constant comparative process. RESULTS Eighty-five learners (53 undergraduate, 32 postgraduate) participated in 10 focus groups. Two main findings emerged. Firstly, the perceived effectiveness of formal and informal assessment activities in informing self-assessment appeared to be both person- and context-specific. No curricular activities were considered to be generally effective or ineffective. However, the availability of high-quality performance data and standards was thought to increase the effectiveness of an activity in informing self-assessment. Secondly, the fostering and informing of self-assessment was believed to require credible and engaged supervisors. CONCLUSIONS Several contextual and personal conditions consistently influenced learners' perceptions of the extent to which assessment activities were useful in informing self-assessments of performance. Although learners are not guaranteed to be accurate in their perceptions of which factors influence their efforts to improve performance, their perceptions must be taken into account; assessment strategies that are perceived as providing untrustworthy information can be anticipated to have negligible impact.

Self-assessment is a process of interpreting data about one's performance and comparing it to explicit or implicit standards.To examine the external data sources physicians used to monitor themselves.Focus groups were conducted with physicians who participated in three practice improvement activities: a multisource feedback program; a program providing patient and chart audit data; and practice-based learning groups. We used grounded theory strategies to understand the external sources that stimulated self-assessment and how they worked.Data from seven focus groups (49 physicians) were analyzed. Physicians used information from structured programs, other educational activities, professional colleagues, and patients. Data were of varying quality, often from non-formal sources with implicit (not explicit) standards. Mandatory programs elicited variable responses, whereas data and activities the physicians selected themselves were more likely to be accepted. Physicians used the information to create a reference point against which they could weigh their performance using it variably depending on their personal interpretation of its accuracy, application, and utility.Physicians use and interpret data and standards of varying quality to inform self-assessment. Physicians may benefit from regular and routine feedback and guidance on how to seek out data for self-assessment.

Item does not contain fulltext PURPOSE: Informed self-assessment describes the set of processes through which individuals use external and internal data to generate an appraisal of their own abilities. The purpose of this project was to explore the tensions described by learners and professionals when informing their self-assessments of clinical performance. METHOD: This 2008 qualitative study was guided by principles of grounded theory. Eight programs in five countries across undergraduate, postgraduate, and continuing medical education were purposively sampled. Seventeen focus groups were held (134 participants). Detailed analyses were conducted iteratively to understand themes and relationships. RESULTS: Participants experienced multiple tensions in informed self-assessment. Three categories of tensions emerged: within people (e.g., wanting feedback, yet fearing disconfirming feedback), between people (e.g., providing genuine feedback yet wanting to preserve relationships), and in the learning/practice environment (e.g., engaging in authentic self-assessment activities versus "playing the evaluation game"). Tensions were ongoing, contextual, and dynamic; they prevailed across participant groups, infusing all components of informed self-assessment. They also were present in varied contexts and at all levels of learners and practicing physicians. CONCLUSIONS: Multiple tensions, requiring ongoing negotiation and renegotiation, are inherent in informed self-assessment. Tensions are both intraindividual and interindividual and they are culturally situated, reflecting both professional and institutional influences. Social learning theories (social cognitive theory) and sociocultural theories of learning (situated learning and communities of practice) may inform our understanding and interpretation of the study findings. The findings suggest that educational interventions should be directed at individual, collective, and institutional cultural levels. Implications for practice are presented. 01 september 2011

CONTEXT Pedagogical practices reflect theoretical perspectives and beliefs that people hold about learning. Perspectives on learning are important because they influence almost all decisions about curriculum, teaching and assessment. Since Flexner's 1910 report on medical education, significant changes in perspective have been evident. Yet calls for major reform of medical education may require a broader conceptualisation of the educational process. PAST AND CURRENT PERSPECTIVES Medical education has emerged as a complex transformative process of socialisation into the culture and profession of medicine. Theory and research, in medical education and other fields, have contributed important understanding. Learning theories arising from behaviourist, cognitivist, humanist and social learning traditions have guided improvements in curriculum design and instruction, understanding of memory, expertise and clinical decision making, and self-directed learning approaches. Although these remain useful, additional perspectives which recognise the complexity of education that effectively fosters the development of knowledge, skills and professional identity are needed. FUTURE PERSPECTIVES Socio-cultural learning theories, particularly situated learning, and communities of practice offer a useful theoretical perspective. They view learning as intimately tied to context and occurring through participation and active engagement in the activities of the community. Legitimate peripheral participation describes learners' entry into the community. As learners gain skill, they assume more responsibility and move more centrally. The community, and the people and artefacts within it, are all resources for learning. Learning is both collective and individual. Social cognitive theory offers a complementary perspective on individual learning. Situated learning allows the incorporation of other learning perspectives and includes workplace learning and experiential learning. Viewing medical education through the lens of situated learning suggests teaching and learning approaches that maximise participation and build on community processes to enhance both collective and individual learning.

To determine how learners and physicians engaged in various structured interventions to inform self-assessment, how they perceived and used self-assessment in clinical learning and practice, and the components and processes comprising informed self-assessment and factors that influence these.This was a qualitative study guided by principles of grounded theory. Using purposive sampling, eight programs were selected in Canada, the United States, the United Kingdom, the Netherlands, and Belgium, representing low, medium, and high degrees of structure/rigor in self-assessment activities. In 2008, 17 focus groups were conducted with 134 participants (53 undergraduate learners, 32 postgraduate learners, 49 physicians). Focus-group transcripts were analyzed interactively and iteratively by the research team to identify themes and compare and confirm findings.Informed self-assessment appeared as a flexible, dynamic process of accessing, interpreting, and responding to varied external and internal data. It was characterized by multiple tensions arising from complex interactions among competing internal and external data and multiple influencing conditions. The complex process was evident across the continuum of medical education and practice. A conceptual model of informed self-assessment emerged.Central challenges to informing self-assessment are the dynamic interrelationships and underlying tensions among the components comprising self-assessment. Realizing this increases understanding of why self-assessment accuracy seems frequently unreliable. Findings suggest the need for attention to the varied influencing conditions and inherent tensions to progress in understanding self-assessment, how it is informed, and its role in self-directed learning and professional self-regulation. Informed self-assessment is a multidimensional, complex construct requiring further research.

Although education about culture, race and ethnicity has increasingly been viewed as an important addition to the medical undergraduate curriculum, internationally the evidence of its effectiveness is mixed. Research to date fails to show why. We chose to explore how contrasting approaches to learning about cultural diversity impacted on medical students. The views of second year students towards teaching about cultural diversity at two UK medical schools, with differently structured curricula, were explored using a series of focus groups (7). The findings, using a methodology based on a combination of grounded theory and thematic analysis identified two potentially competing views espoused by the students at both sites. First, they claimed that although cultural diversity was important, their medical schools marginalised and failed to adequately support effective teaching. Second, in contrast, they claimed that the medical school was an 'inappropriate' setting for successful teaching about cultural diversity. Students did not consider the subject matter to be of central relevance to biomedicine. They felt it should be learnt experientially in the workplace and socially among peers. These narratives represent two potentially conflicting standpoints, which might be understood through the sociological concept of 'habitus', where students conform to the institution's dominant values in order to succeed. The tensions identified in this study cannot be ignored if effective learning about race, ethnicity and culture is to be achieved. Early introduction to understanding the delivery of health care to diverse populations is needed. This should be accompanied by more open collaborative debate between tutors and students on the issues raised.

Background: This review, which focused on faculty development initiatives designed to improve teaching effectiveness, synthesized findings related to intervention types, study characteristics, individual and organizational outcomes, key features, and community building.Methods: This review included 111 studies (between 2002 and 2012) that met the review criteria.Findings: Overall satisfaction with faculty development programs was high. Participants reported increased confidence, enthusiasm, and awareness of effective educational practices. Gains in knowledge and skills, and self-reported changes in teaching behaviors, were frequently noted. Observed behavior changes included enhanced teaching practices, new educational initiatives, new leadership positions, and increased academic output. Organizational changes were infrequently explored. Key features included evidence-informed educational design, relevant content, experiential learning, feedback and reflection, educational projects, intentional community building, longitudinal program design, and institutional support.Conclusion: This review holds implications for practice and research. Moving forward, we should build on current success, broaden the focus beyond individual teaching effectiveness, develop programs that extend over time, promote workplace learning, foster community development, and secure institutional support. We should also embed studies in a theoretical framework, conduct more qualitative and mixed methods studies, assess behavioral and organizational change, evaluate transfer to practice, analyse key features, and explore the role of faculty development within the larger organizational context.

The importance of reflection and reflective practice are frequently noted in the literature; indeed, reflective capacity is regarded by many as an essential characteristic for professional competence. Educators assert that the emergence of reflective practice is part of a change that acknowledges the need for students to act and to think professionally as an integral part of learning throughout their courses of study, integrating theory and practice from the outset. Activities to promote reflection are now being incorporated into undergraduate, postgraduate and continuing medical education, and across a variety of health professions. The evidence to support and inform these curricular interventions and innovations remains largely theoretical. Further, the literature is dispersed across several fields, and it is unclear which approaches may have efficacy or impact. We, therefore, designed a literature review to evaluate the existing evidence about reflection and reflective practice and their utility in health professional education. Our aim was to understand the key variables influencing this educational process, identify gaps in the evidence, and to explore any implications for educational practice and research.

Background: Residents are frequently identified by medical students as their most frequent and memorable teachers; residents also teach their peers, junior and senior colleagues, other health professionals, and their patients. Many will teach in their future practice. Developing the skills to become a teacher is an important part of postgraduate education, and warrants a systematic, planned approach that may include many complementary learning opportunities. Aims: Our purpose is to describe one such approach: a 4-week elective experience in medical education offered to postgraduate learners. Method: The paper describes the background and goals for the elective, and the various steps in planning, implementing, and evaluating such a course, drawing on the literature and mining our own experience for examples. Specifically, we address the following: needs assessment; the determination and selection of content, sequence, and teaching and learning methods; the experiential learning opportunities offered; and the emphasis on the participants’ developing self-awareness of themselves as teachers, and as part of a community of teachers. Results: The program implementation, program evaluation, and response to feedback received are described. Conclusion: A 4-week elective experience in medical education was positively received by participants.

Many research questions posed by medical educators could be answered more effectively by the application of carefully selected qualitative research design than traditional quantitative research methods. Indeed, in many cases using mixed methods research would expand the scope of a study and yield meaningful qualitative data in addition to quantitative data. Qualitative research seeks to understand people's experiences, the meanings they assign to those experiences, the psychosocial aspects of and language used in interpersonal interactions, and the factors that influence perspectives and interactions. This understanding is vital in exploring learning and teaching styles, learners' experiences and perceptions, implementing and studying the impact of educational interventions and faculty development. This article aims to advance medical educators' understanding and application of qualitative research principles in educational scholarship by summarising and consolidating the fundamental principles of research in medical education described in recent AMEE guides. The 12 tips below offer a systematic, yet practical approach to designing a qualitative research study, particularly targeting educators new to this arena.

Preparing healthcare professionals for teaching is regarded as essential to enhancing teaching effectiveness. Although many reports describe various faculty development interventions, there is a paucity of research demonstrating their effectiveness.To synthesize the existing evidence that addresses the question: "What are the effects of faculty development interventions on the knowledge, attitudes and skills of teachers in medical education, and on the institutions in which they work?"The search, covering the period 1980-2002, included three databases (Medline, ERIC and EMBASE) and used the keywords: staff development; in-service training; medical faculty; faculty training/development; continuing medical education. Manual searches were also conducted. Articles with a focus on faculty development to improve teaching effectiveness, targeting basic and clinical scientists, were reviewed. All study designs that included outcome data beyond participant satisfaction were accepted. From an initial 2777 abstracts, 53 papers met the review criteria. Data were extracted by six coders, using the standardized BEME coding sheet, adapted for our use. Two reviewers coded each study and coding differences were resolved through discussion. Data were synthesized using Kirkpatrick's four levels of educational outcomes. Findings were grouped by type of intervention and described according to levels of outcome. In addition, 8 high-quality studies were analysed in a 'focused picture'.The majority of the interventions targeted practicing clinicians. All of the reports focused on teaching improvement and the interventions included workshops, seminar series, short courses, longitudinal programs and 'other interventions'. The study designs included 6 randomized controlled trials and 47 quasi-experimental studies, of which 31 used a pre-test-post-test design.Despite methodological limitations, the faculty development literature tends to support the following outcomes: Overall satisfaction with faculty development programs was high. Participants consistently found programs acceptable, useful and relevant to their objectives. Participants reported positive changes in attitudes toward faculty development and teaching. Participants reported increased knowledge of educational principles and gains in teaching skills. Where formal tests of knowledge were used, significant gains were shown. Changes in teaching behavior were consistently reported by participants and were also detected by students. Changes in organizational practice and student learning were not frequently investigated. However, reported changes included greater educational involvement and establishment of collegiate networks. Key features of effective faculty development contributing to effectiveness included the use of experiential learning, provision of feedback, effective peer and colleague relationships, well-designed interventions following principles of teaching and learning, and the use of a diversity of educational methods within single interventions. Methodological issues: More rigorous designs and a greater use of qualitative and mixed methods are needed to capture the complexity of the interventions. Newer methods of performance-based assessment, utilizing diverse data sources, should be explored, and reliable and valid outcome measures should be developed. The maintenance of change over time should also be considered, as should process-oriented studies comparing different faculty development strategies.Faculty development activities appear highly valued by participants, who also report changes in learning and behavior. Notwithstanding the methodological limitations in the literature, certain program characteristics appear to be consistently associated with effectiveness. Further research to explore these associations and document outcomes, at the individual and organizational level, is required.

PURPOSE To assess the reliability and validity of aStructured Communication Adolescent Guide(SCAG) in an undergraduate medical education set-ting using trained adolescent raters.METHOD The SCAG is a 49-item, 6-section (A–F),protocol derived from the Calgary CambridgeObservation Guide that incorporates adolescent psy-chosocial data collection with the physician’s com-munication skills. Four trained female adolescentsscored 42 videotaped adolescent clinical encountersusing the SCAG; a trained psychologist’s rating foreach videotape was used as the gold standard.RESULTS Agreement among adolescent raters wasdetermined by calculating intraclass correlationcoefficients (ICC). The individual SCAG item scores,combined with the global ratings for each section,resulted in an overall ICC value of 0.93, indicatingvery strong agreement among the 4 raters. Theglobal rating scores for the sections (initiating thesession, initiating separation, once adolescent isalone ) lifestyle and closure) produced an ICCrange of 0.58–0.93. However, the ICC values for the2 remaining sections (how was information collec-ted and gathering information) global rating scoreswere below 0.30, signifying low agreement. Overallagreement between the adolescent raters and thegold standard resulted in an ICC value of 0.78. This isevidence of the SCAG’s criterion validity.CONCLUSION The SCAG is a reasonably valid toolfor use in guiding an encounter with an adolescentpatient. However, 2 sections require modificationsto improve their reliability and thus the SCAG’soverall performance. Our results suggest that theSCAG shows promise as a potentially useful teachingresource in undergraduate medical education inadolescent medical interviewing.KEYWORDS education, medical, undergraduate⁄*methods; *communication; physician–patient rela-tions; data collection; videotape recording⁄ methods;reproducibility of results.Medical Education 2005; 39: 482–491

Purpose Physician performance is comprised of several domains of professional competence. Multisource feedback (MSF) or 360-degree feedback is an approach used to assess these, particularly the humanistic and relational competencies. Research studying responses to performance assessment shows that reactions vary and can influence how performance feedback is used. Improvement does not always result, especially when feedback is perceived as negative. This small qualitative study undertook preliminary exploration of physicians' reactions to MSF, and perceptions influencing these and the acceptance and use of their feedback. Methods We held focus groups with 15 family physicians participating in an MSF pilot study. Qualitative analyses included content and constant comparative analyses. Results Participants agreed that the purpose of MSF assessment should be to enhance practice and generally agreed with their patients' feedback. However, responses to medical colleague and co-worker feedback ranged from positive to negative. Several participants who responded negatively did not agree with their feedback nor were inclined to use it for practice improvement. Reactions were influenced by perceptions of accuracy, credibility and usefulness of feedback. Factors shaping these perceptions included: recruiting credible reviewers, ability of reviewers to make objective assessments, use of the assessment tool and specificity of the feedback. Conclusion Physicians' perceptions of the MSF process and feedback can influence how and if they use the feedback for practice improvement. These findings are important, raising the concern that feedback perceived as negative and not useful will have no or negative results, and highlight questions for further study.

Background Professionalism is increasingly emphasised in medical education. Non-cognitive goals, including values, attitudes and skills, remain challenging to define and measure. The purpose of this study was to better understand these goals and their achievement in the MD programme. Methods Graduating medical students, faculty preceptors, residents and other health professionals (OHPs) completed a systematically developed mailed survey, rating achievement of 25 attribute statements. Following analyses of means and standard deviations, factor analysis of responses was conducted. Responses were compared across respondent groups. Results The overall response rate was 50.1% (191/396), comprising 57.5% of the students, 54.1% of the faculty members, 30.9% of the residents and 50% of the OHPs. Five items received mean ratings over 4/5; none were below 3/5. Five factors explained 65% of variance. They were: ‘Teamwork and interprofessional skills’; ‘Duty and responsibility’; ‘Communication and interpersonal skills’; ‘Professionalism and values’, and ‘Trustworthiness and ethical behaviour’. The groups differed significantly on 2 factors: Teamwork and interprofessional skills (P ≤ 0.0001) and Communication and interpersonal skills (P ≤ 0.001). Conclusions Important curriculum goals received high mean ratings. Ratings differed significantly across groups, suggesting differing perceptions of the extent to which goals were met. More study is needed to understand the basis of these perceptions.

In this article, the authors consider the quality and relevance of current and future medical education research by (1) presenting a framework for medical education research and reviewing basic principles of "good" empirical work, (2) extending the discussion of principles to "best practices," (3) considering the distinctive features of medical education that present challenges to the researcher, and (4) discussing opportunities for expanding the scope and influence of medical education research. Their audience is intended to be clinicians involved in education, deans and associate deans who create and direct educational curricula and processes, and those from offices critical to the educational mission such as admissions, student services and financial aid, as well as medical education researchers. The authors argue that the quality and relevance of current work can be enhanced when research is situated within a general framework and questions are asked that are based on literature and theory and push the field toward new knowledge. Obviously methods and designs must be appropriate and well-executed and sufficient data must be gathered. Multiple studies are highlighted that showcase the rigor and creativity associated with excellent quality work. However, good research is not without its challenges, most notably short timelines and the need to work within an ever-changing real-life educational environment. Most important, the field of medical education research has many opportunities to increase its impact and advance its quest to study important learners' behaviors and patients' outcomes. Programs to train and collaborate with clinical and administrative colleagues, as well as researchers in other fields, have great potential to improve the quality of research in the field.

Forming technically proficient, professional, and humanistic physicians for the 21st century is no easy task. Mountains of biomedical knowledge must be acquired, diagnostic competence achieved, effective communication skills developed, and a solid and applicable understanding of the practice and role of physicians in society today must be reached. The central experience for learners in this complex and challenging terrain is the "modeling of" and "learning how to be" a caregiver and health professional. Role modeling remains one crucial area where standards are elusive and where repeated negative learning experiences may adversely impact the development of professionalism in medical students and residents. The literature is mainly descriptive, defining the attributes of good role models from both learners and practitioners' perspectives. Because physicians are not "playing a role" as an actor might, but "embodying" different types of roles, the cognitive and behavioral processes associated with successfully internalizing roles (e.g., the good doctor/medical educator) are important. In this article, the authors identify foundational questions regarding role models and professional character formation; describe major social and historical reasons for inattention to character formation in new physicians; draw insights about this important area from ethics and education theory (philosophical inquiry, apprenticeship, situated learning, observational learning, reflective practice); and suggest the practical consequences of this work for faculty recruitment, affirmation, and development.

Small-group, practice-based learning is an effective and well-accepted method of continuing medical education (CME). However, one limitation is that many physicians work in communities with fewer than the minimum number recommended for an effective learning group. Videoconferencing has the potential to remove this limitation. The purpose of this study was to evaluate the feasibility, acceptability, effectiveness, and cost of conducting practice-based, small-group CME learning by videoconference.Through a videoconferencing link, 10 learners in three communities were guided through four practice-based learning modules by a trained facilitator at a fourth site. Data were collected through evaluation questionnaires, direct observation by the research team, pre- and post-knowledge tests, a focus group, and an interview.A total of 31 learners participated in the four modules. Videoconferencing was generally well accepted by learners. The facilitator and research team observers noted that muting microphones, video quality, audio quality, and audio lag all somewhat hindered discussion. Overall, the facilitator found moderating by videoconference only slightly more difficult than a face-to-face session. There was evidence of knowledge gain, with post-test scores being 20% higher than pretest scores (p = .006). Learners reported nine practice changes from taking the modules. At commercial rates, telecommunications costs per videoconferenced module were approximately CAN$1,200.Videoconferencing has the potential to bring the benefits of small-group, practice-based learning to many physicians; however, strict attention to videoconferencing techniques is required. Cost is also an important consideration.

Background If continuing professional development is to work and be sensible, an understanding of clinical practice is needed, based on the daily experiences of doctors within the multiple factors that determine the nature and quality of practice. Moreover, there must be a way to link performance and assessment to ensure that ongoing learning and continuing competence are, in reality, connected. Current understanding of learning no longer holds that a doctor enters practice thoroughly trained with a lifetime's storehouse of knowledge. Rather a doctor's ongoing learning is a � journeyacross a practice lifetime, which involves the doctor as a person, interacting with their patients, other health professionals and the larger societal and com- munity issues. Objectives In this paper, we describe a model of learning and practice that proposes how change occurs, and how assessment links practice performance and learning. We describe how doctors define desired performance, compare actual with desired perform- ance, define educational need and initiate educational action. Method To illustrate the model, we describe how doctor performance varies over time for any one condition, and across conditions. We discuss how doctors perceive and respond to these variations in their performance. The model is also used to illustrate different formative and summative approaches to assessment, and to highlight the aspects of performance these can assess. Conclusions We conclude by exploring the implications of this model for integrated medical services, highlight- ing the actions and directions that would be required of doctors, medical and professional organisations, uni- versities and other continuing education providers, credentialling bodies and governments.

Faculty development is often local and international experiences are usually limited to conferences and courses. In 2006, five schools across the globe decided to enhance international faculty experiences through an exciting new collaboration: the International Medical Educators Exchange (IMEX) initiative.Twice a year, one of the five schools in the Netherlands, Canada, Sweden and the UK organizes a week of faculty development activities for experienced medical educators from each school, including group discussions, short presentations, observations and active engagement in local education, one-on-one meetings with local faculty members, and many opportunities for in-depth discussion. We administered a survey to evaluate the impact of this international exchange.By August 2013, 31 IMEX scholars had attended at least one of the 14 site visits held; most of them (29) had attended 3-5 site visits. Responding IMEX alumni (55%, N = 16) felt that their experiences impacted their personal competence and international orientation, and to some extent their career, their daily work and their institution. Most features of the IMEX program were valued as highly important and highly successful.IMEX has established itself as an important additional faculty development opportunity for those medical educators who wish to develop and pursue a career in education.

Physicians are required to maintain and sustain professional roles during their careers, making the Professional Role an important component of postgraduate education. Despite this, this role remains difficult to define, teach and assess.To (a) understand what program directors felt were key elements of the CanMEDS Professional Role and (b) identify the teaching and assessment methods they used.A two-step sequential mixed method design using a survey and semi-structured interviews with Canadian program directors.Forty-six program directors (48% response rate) completed the questionnaire and 10 participated in interviews. Participants rated integrity and honesty as the most important elements of the Role (96%) but most difficult to teach. There was a lack of congruence between elements perceived to be most important and most frequently taught. Role modeling was the most common way of informally teaching professionalism (98%). Assessments were most often through direct feedback from faculty (98%) and feedback from other health professionals and residents (61%). Portfolios (24%) were the least used form of assessment, but they allowed residents to reflect and stimulated self-assessment.Program directors believe elements of the Role are difficult to teach and assess. Providing faculty with skills for teaching/assessing the Role and evaluating effectiveness in changing attitudes/behaviors should be a priority in postgraduate programs.

Background The 1999 Cambridge Conference was held in Northern Queensland, Australia, on the theme of clinical teaching and learning. It provided an opportunity for groups of academic medical educators to consider some of the challenges posed by recent changes to health care delivery and medical education across a number of countries. Purpose This paper describes the issues raised by the practical challenges posed by the current environment and how they might be addressed in ways that could promote more effective learning in clinical settings. Method A SWOT analysis is a tool that can help in forward planning by identifying the strengths, weaknesses, opportunities and threats presented by any situation. Our SWOT analysis was used to generate a list of items, from which we chose those most feasible and most likely to promote positive change. Results Twenty different issues were identified, with four of them chosen by consensus for further elaboration. The discussion gave rise to four main recommended strategies: ensuring that clinical teachers thoroughly understand the purpose and process of learning in clinical settings; equipping learners with 'survival skills'; making the best use of learning resources within different clinical environments and making judicious use of information technology to enhance learning efficiency. Conclusions The four strategies were selected not only because of their inherent importance, but also because of their feasibility. Modest changes can motivate students to feel part of a clinical team and a 'community of practice' and enhance their capacity for self-regulated practice.

Purpose. To compare four standard-setting procedures for an objective structure clinical examination (OSCE). Methods. A 12-station OSCE was administered to 84 students in each of the final (fourth-) year medical classes of 1996 and 1997 at Dalhousie University Faculty of Medicine. Four standard-setting procedures (Angoff, borderline, relative, and holistic) were applied to the data to establish a cutoff score for a pass/fail decision. Results. The procedures yielded highly inconsistent results. The Angoff and borderline procedures gave similar results; however, the relative and holistic methods gave widely divergent results. The Angoff procedure yielded results reliable enough to use in decision making for a high-stakes examination, but would have required more judges or more stations. Conclusions. The Angoff and borderline procedures provide reasonable and defensible approaches to standard setting and are practical to apply by non-psychometricians in medical schools. Further investigation of the other procedures is needed. Acad. Med. 2000;75:267‐271.

This study compared student performance in problem-based (PBL) and conventional curricula on: 1) basic science knowledge following two preclinical years; 2) the Medical Council of Canada Qualifying Examination (MCC) Part I, written upon completion of the four year MD, and 3) Part II of the MCC Qualifying Examination, an assessment of clinical performance after 17 months of postgraduate education. Students in the conventional class of 1995 (n = 81) and the PBL classes of 1996 (n = 84) and 1997 (n = 78) participated. The 1995 conventional class scored significantly higher on the knowledge test than did the 1996 PBL class. The 1997 PBL class performed similarly to the 1995 class. The MCC Part I total examination scores of the three classes were similar. However, the PBL classes of 1996 and 1997 outperformed the class of 1995 in Psychiatry (p = 0.01); also, the PBL class of 1997 outscored the classes of 1995 and 1996 in Preventive Medicine and Community Health (p = 0.001). Two classes have completed the Part II examination. The 1995 and 1996 classes scored similarly in data-gathering, problem-solving and overall. The 1995 class scored significantly higher in communication skills (p = 0.01). We conclude that the performance of PBL and conventional classes is equivalent after medical school, and during postgraduate education, and that knowledge differences found in the first PBL class after two preclinical years have disappeared at the end of fourth year. Basic science knowledge may continue to grow throughout the clinical experience. Differences in communication skills, which favoured the conventional class, require further study.

Guidelines for screening for elevated serum cholesterol have been published in both Canada and the United States. Preventive practices have been difficult to integrate into episodic care. This study was designed to test the impact of an educational intervention to increase physicians' screening for elevated cholesterol in their practices. It was hypothesized that physicians who participated in the intervention would demonstrate higher rates of appropriate screening. A three-group randomized controlled trial of an educational intervention was conducted over 10 months in family physicians' private offices throughout Nova Scotia. Invitation letters were mailed to full-time family physicians with 5 or more years in practice. Fifty-nine (27.2% of 217 eligible) physicians entered and 51 completed the study. The study group physicians attended a half-day workshop emphasizing information regarding, and approaches to, screening. The primary outcome measure was of physician screening in their practice. The baseline preworkshop screening rate averaged 51.7% for all groups. The groups were similar in this regard (p = .14). Physicians in the two study groups who attended the workshop had higher postworkshop screening rates than the control group (p = .08). The lack of strongly statistically significant effects of the intervention may be deceiving when the high base screening rate and the high physician within-group variability are considered. Attempts to evaluate the impact of interventions must take into account the very large amount of information directed at physicians and the public regarding elevated cholesterol.

Questionnaires remain a staple in the continuing education provider's approach to needs assessment. This paper reviews the known advantages in their use, as well as the disadvantages. It also reviews and directs the reader to recent reports of questionnaire use, highlighting a variety of uses, across a variety of professional groups, and use alone and in concert with other needs assessment methods. The paper then turns to an exploration of the considerations that providers must examine when designing effective questionnaires. These include an understanding of how learning and change occur in practice and of the context of the learner. The practical considerations surrounding questionnaire use and development are also addressed. The paper attempts to help providers set a framework within which questionnaires are developed that will provide meaningful information that can be translated into effective educational programs, and that will contribute to lifelong learning in practice.

There is much literature on problem-based learning (PBL), both within and outside medical education. The literature addresses such questions as what is PBL and how does it work, and many examples are given; yet it is often difficult to determine from these descriptions whether the educational approach being described is actually PBL. The goal of this article is to provide planners and/or assessors of PBL curricula with a framework that would facilitate analyses of this educational approach. We propose to categorize educational activities as PBL or non-PBL according to three core principles: (1) the problem acts as a stimulus for learning; (2) it is an educational approach, not an isolated instructional technique, and (3) it is a student-centered approach, and four criteria concerning their effect on student learning: (1) active processing of information; (2) activation of prior knowledge; (3) meaningful context; and (4) opportunities for elaboration/organization of knowledge). Beyond this, PBL curricula v...

Objective To describe the development and validation of a behaviour change communication tool for medical students. Methods Behaviour change techniques (BCTs) were identified within the literature and used to inform a communication tool to support medical students in discussing health-related behaviour change with patients. BCTs were organized into an accessible format for medical students (the ‘Tent Pegs’ booklet) and validated using discriminant content validity methods with 11 expert judges. Results One-sample t -tests showed that judges reliably mapped BCTs onto six of the seven Tent Pegs domains (confidence rating means ranged from 4.0 to 5.1 out of 10, all p ≤ 0.002). Only BCTs within the ‘empowering people to change’ domain were not significantly different from the value zero (mean confidence rating = 1.2, p > 0.05); these BCTs were most frequently allocated to the ‘addressing thoughts and emotions’ domain instead. Conclusion BCTs within the Tent Pegs booklet are reliably allocated to corresponding behaviour change domains with the exception of those within the ‘empowering people to change’ domain. Practice implications The existing evidence-base on BCTs can be used to directly inform development of a communication tool to support medical students facilitate health behaviour change with patients.

SUMMARY The purpose of this study was to compare the attitudes toward basic sciences of students in a preclinical problem-based curriculum and a conventional lecture-based curriculum at the end of their second year of medical school. The results showed that the PBL class had more positive attitudes toward basic sciences than students in the conventional class. These results may reflect a learning environment where students meet many scientist role models as teachers and where basic science is learnt in the context of clinical problems.