Search

At our centre, we introduced a continuous quality improvement (CQI) initiative during academic year 2018-19 targeting for repair multiple choice question (MCQ) items with discrimination index (D) < 0.1. The purpose of this study was to assess the impact of this initiative on reliability/internal consistency of our assessments. Our participants were medical students during academic years 2015-16 to 2020-21 and our data were summative MCQ assessments during this time. Since the goal was to systematically review and improve summative assessments in our undergraduate program on an ongoing basis, we used interrupted time series analysis to assess the impact on reliability. Between 2015-16 and 2017-18 there was a significant negative trend in the mean alpha coefficient for MCQ exams (regression coefficient -0.027 [-0.008, -0.047], p = 0.024). In the academic year following the introduction of our initiative (2018-19) there was a significant increase in the mean alpha coefficient (regression coefficient 0.113 [0.063, 0.163], p = 0.010) which was then followed by a significant positive post-intervention trend (regression coefficient 0.056 [0.037, 0.075], p = 0.006). In conclusion, our CQI intervention resulted in an immediate and progressive improvement reliability of our MCQ assessments.

The authors describe the residency match as a two-step process. The first step, the Choice, is where students use a combination of intuitive and analytic information processing to select the specialty that they believe will provide fulfilment and work-life balance over their entire career. The second step, the Match, uses a “deferred-acceptance” algorithm to optimize pairing of students and their specialty choices. Despite being the rate-limiting step, outcomes of the Choice have typically been eclipsed by the outcomes of the Match. A recently published study found that during their second year of residency training, 1 in 14 physicians reported specialty choice regret, which associates with symptoms of burnout in residents. While the obvious solution is to design interventions that improve the specialty choices of students, this approach faces significant challenges, including the fact that: 1) satisfaction with specialty choice is a difficult-to-define construct; 2) specialty choice regret may be misattributed to a poor choice; and 3) choosing is a more complicated process than matching. The authors end by suggesting that if we hope to improve satisfaction with specialty choice then we should begin by defining this, deciding when to assess it, and then creating assessment tools for which there is validity evidence and that can identify the underlying causes of specialty choice regret.

Background: In 2015, the Medical Council of Canada increased the minimum pass level for the Medical Council of Canada Qualifying Examination Part I, and students had a higher rate of failure than in previous years. The purpose of this study was to predict students at an increased odds of examination failure to allow for early, targeted interventions. Methods: We divided our dataset into a derivation cohort and two validation cohorts and used multiple logistic regression to predict licensing examination failure. We then performed receiver operating characteristics and a sensitivity analysis using different cutoffs for explanatory variables to identify the cutoff threshold with the best predictive value at identifying students at increased odds of failure. Results: After multivariate analysis, only pre-clerkship GPA was a significant independent predictor of failure (OR 0.76, 95% CI [0.66, 0.88], p < 0.001). The probability of failure increased steeply when the pre-clerkship GPA fell below 80% and 76% was found to be the most efficient cutoff for predicting failure (OR 9.37, 95% CI [3.08, 38.41]). Conclusions: Pre-clerkship performance can predict students at increased odds of licensing examination failure. Further studies are needed to explore whether early interventions for at-risk students alter their examination performance.

Background: Physician participation in regularly scheduled series (RSS), also known as grand rounds, was explored with a particular focus on physician perceptions about the elements that affected their engagement in RSS and the unanticipated benefits to RSS. Methods: A qualitative study using semi-structured interviews and thematic analysis examined physicians’ perception of their knowledge and educational needs and the factors that contributed to engagement in their local hospital RSS. Results: Physician engagement in RSS was affected by four major themes: Features that Affect the RSS’ Quality; Collegial Interactions; Perceived Outcomes of RSS; and Barriers to participation in RSS. Features that Affect RSS’ Quality were specific modifiable features that impacted the perceived quality of the RSS. Collegial Interactions were interactions that occurred between colleagues directly or indirectly as a result of attending RSS. Outcomes of RSS were specific outcome measures used in RSS sessions. Barriers were seen as reasons why physicians were unwilling or unable to participate in RSS. All of the elements identified within the four themes contributed to the development of physician engagement. Physicians also identified changes directly and indirectly due to RSS. Discussion: Specific features of RSS result in enhanced physician engagement. There are benefits that may not be accounted for in continuing medical education (CME) outcome study designs

Self-harm and mental health are inter-related issues that substantially contribute to the global burden of disease. However, measurement of these issues at the population level is problematic. Statistics on suicide can be captured in national cause of death data collected as part of the coroner's review process, however, there is a significant time-lag in the availability of such data, and by definition, these sources do not include non-fatal incidents. Although survey, emergency department, and hospitalisation data present alternative information sources to measure self-harm, such data do not include the richness of information available at the point of incident. This paper describes the mental health and self-harm modules within the National Ambulance Surveillance System (NASS), a unique Australian system for monitoring and mapping mental health and self-harm. Data are sourced from paramedic electronic patient care records provided by Australian state and territory-based ambulance services. A team of specialised research assistants use a purpose-built system to manually scrutinise and code these records. Specific details of each incident are coded, including mental health symptoms and relevant risk indicators, as well as the type, intent, and method of self-harm. NASS provides almost 90 output variables related to self-harm (i.e., type of behaviour, self-injurious intent, and method) and mental health (e.g., mental health symptoms) in the 24 hours preceding each attendance, as well as demographics, temporal and geospatial characteristics, clinical outcomes, co-occurring substance use, and self-reported medical and psychiatric history. NASS provides internationally unique data on self-harm and mental health, with direct implications for translational research, public policy, and clinical practice. This methodology could be replicated in other countries with universal ambulance service provision to inform health policy and service planning.

Abstract Background Despite the fact that medical schools spend a considerable effort to rate clinical instructors, there is limited evidence regarding the effect of physical characteristics on instructor ratings. White coats have been shown to alter patients’ perceptions of physicians although it has not been determined if preceptors who wear white coats are rated differently than their colleagues. Methods Second year medical students were administered a questionnaire with four clinical scenarios depicting medical errors accompanied by a picture of a physician of different sexes and ethnicities. The packages were randomized so that the physicians depicted either had or did not have a white coat. Results White coats did not alter the perception of physicians’ ratings by medical students although sex and ethnicity/case were associated with the perception of trustworthiness, physician management, competence, professionalism and the perception of medical error. Conclusions Physical characteristics may alter students’ ratings of physicians.

Clinical uncertainty exists regarding which assay should be designated as the standard monitoring coagulation test for intravenous unfractionated heparin (UFH). Several studies have compared the use of activated partial thromboplastin time (aPTT) and antifactor-Xa (anti-Xa) and have come out with varying results. The correlation between these 2 tests varied, markedly from strong to weak. Some have demonstrated that monitoring with anti-Xa heparin assay leads to fewer dose adjustments, resulting in fewer laboratory tests, while others have not. In the current study, we evaluated the correlation between aPTT and anti-Xa values to guide clinical management of UFH, with the intention to develop a new correlation nomogram.

Background: Research on the predictive validity of the Medical College Admissions Test (MCAT) on licensing examination performance is varied in its conclusions, with only a few studies examining this relationship in a Canadian context. We assessed the predictive validity of the MCAT on successful performance on the Medical Council of Canada Qualifying Examination (MCCQE) Part 1 by students attending the Cumming School of Medicine. Methods: Prospective data were collected on MCAT score and sub-section scores, MCCQE decision, multiple mini interview (MMI) performance, gender, and age. The cohort was divided into a derivation cohort (2013 and 2014) and validation cohort (2015 and 2016). Students were dichotomized into pass or fail on MCCQE. Multiple logistic regression in which our dependent variable was MCCQE Part I examination success at the first attempt was used, and potential explanatory variables were age, gender, MCAT total score, and sub-scores for the biological sciences (MCAT-BS), physical sciences, and verbal reasoning, GPA, and MMI ratings. Results: For the derivation cohort MCAT-BS was associated with success on the MCCQE Part I. The odds ratio for this association of 1.37 (95% confidence interval [1.01, 1.85], p = 0.04). When we applied the MCAT-BS to our validation cohort the odds ratio of MCCQE Part I examination success was 1.42 [1.10, 1.83], p = 0.007) and the area under the ROC curve was 0.66 [0.54, 0.79]). Conclusion: The MCAT-BS predicted successful performance on the MCCQE Part 1 Examination in the Canadian setting.

Background: Physicians often fail to implement clinical practice guidelines. Our aim was to evaluate whether a purposefully sequenced, multifaceted educational intervention would increase physician adherence to a guideline for voiding cystourethrogram (VCUG) use following first urinary tract infection (UTI) in young children. Methods: Using a single centre, pretest-posttest design, we compared the proportion of guideline adherent VCUG orders and the VCUG ordering rate before and after three educational interventions (interactive lecture, clinical pathway, faxed reminder) selected and sequenced according to the PRECEDE (Predisposing, Reinforcing and Enabling Constructs in Educational Diagnosis and Evaluation) health promotion model. Results: One hundred and nine physicians ordered 219 VCUGs for 219 children. Following the interventions, there was an increase in the monthly proportion of adherent VCUGs ordered by pediatricians (analysis of variance (ANOVA) F(2,29) = 3.38, p = .048) and non-pediatricians (ANOVA F(2,28) = 14.71, p < .001). Also, pediatricians decreased their monthly VCUG ordering rate (linear trend incidence rate ratio 0.74, 95% confidence interval (CI) [0.54, 0.99]). Pediatricians were more likely to adhere with the guideline than were non-pediatricians (odds ratio 2.91, 95% CI [1.5, 5.5]). Conclusion: Exposure to purposefully sequenced educational interventions based on the PRECEDE model was associated with increased adherence to guideline recommendations.

In this article, we question if and why the Canadian national medical education organizations have failed to introduce or promote changes that compel or encourage Canadian medical schools to heed the recommendation from the Future of Medical Education in Canada report to "build on the scientific basis of medicine." We end by offering suggestions on how these organizations could help Canadian medical schools build in the scientific basis of medicine.

BACKGROUND: Although workplace workload assessments exist in different fields, an endoscopy-specific workload assessment tool is lacking.

Background: Training in Bayesian reasoning may have limited impact on accuracy of probability estimates. In this study, our goal was to explore whether residents previously exposed to Bayesian reasoning use heuristics rather than Bayesian reasoning to estimate disease probabilities. We predicted that if residents use heuristics then post-test probability estimates would be increased by non-discriminating clinical features or a high anchor for a target condition. Method: We randomized 55 Internal Medicine residents to different versions of four clinical vignettes and asked them to estimate probabilities of target conditions. We manipulated the clinical data for each vignette to be consistent with either 1) using a representative heuristic, by adding non-discriminating prototypical clinical features of the target condition, or 2) using anchoring with adjustment heuristic, by providing a high or low anchor for the target condition. Results: When presented with additional non-discriminating data the odds of diagnosing the target condition were increased (odds ratio (OR) 2.83, 95% confidence interval [1.30, 6.15], p = 0.009). Similarly, the odds of diagnosing the target condition were increased when a high anchor preceded the vignette (OR 2.04, [1.09, 3.81], p = 0.025). Conclusions: Our findings suggest that despite previous exposure to the use of Bayesian reasoning, residents use heuristics, such as the representative heuristic and anchoring with adjustment, to estimate probabilities. Potential reasons for attribute substitution include the relative cognitive ease of heuristics vs. Bayesian reasoning or perhaps residents in their clinical practice use gist traces rather than precise probability estimates when diagnosing.

BACKGROUND: Magnetic endoscopic imaging represents a recent advance in colonoscopy training. This technique provides adjunct information to the endoscopist, specifically with regard to colonoscope loop formation.

Endoscopy instruction has progressed a great deal in recent years, evolving from the age-old dictum of ‘see one, do one’ to the current skillful application of sound educational principles. Some of these educational principles are generic and applicable to the teaching of any content at all levels, while others are quite specific to technical skills training. The present review summarizes these important principles under the following headings: creating a learner-centred curriculum; delivering an achievable learning task; and moving from theory to practice. The present article challenges national gastroenterology organizations to embrace these concepts in structured, outcome-based educational programs.

The flipped classroom model is increasingly being adopted in healthcare education, despite the fact that recent systematic reviews in the nursing and medical education literature suggest that this method of instructional design is not inherently better or worse than the traditional classroom. In this study, we used a sequential, explanatory mixed methods design to assess the impact of flipping the hepatology classroom for preclinical medical students. Compared to students in the traditional classroom, students in the flipped classroom had significantly lower mean (SD) ratings of their learning experiences (3.48 (1.10) vs. 4.50 (0.72), p < 0.001, d = 1.10), but better performance on the hepatology content of the end-of-course examination (78.0% (11.7%) vs. 74.2 (15.1%), respectively, p < 0.01, d = 0.3). Based upon our qualitative data analyses, we propose that the flipped classroom induced a change in the learning process of students by requiring increased preparation for classroom learning and promoting greater learner autonomy, which resulted in better retention of learned material, but reduced enjoyment of the learning experience. This dissonance in outcomes is captured in the words of one flipped classroom student: “…I hated it while I was learning it, but boy did I remember it…”. Based upon our dissonant outcomes and the inconsistent findings in the literature, we feel that there is still equipoise regarding the effectiveness of the flipped classroom, and further studies are needed to describe ways of making the flipped classroom a more effective (±more enjoyable) learning experience.

Background: Ultrasonography is increasingly used for teaching physical examination in medical schools. This study seeks the opinions of educators as to which physical examinations would be most enhanced by the addition of ultrasonography. We also asked when ultrasound-aided physical examination teaching could have deleterious effects if used outside its intended scope. Methods: All of the educators from the University of Calgary Master Teacher Program were invited to complete a 22-item paper-based survey. Survey items were generated independently by two investigators, with input from an expert panel (N = 5). Results: Of the 36 educators, 27 (75%) completed the survey. Examinations identified to be potentially most useful included: measuring the size of the abdominal aorta, identifying the presence/absence of ascites, identifying the presence/absence of pleural effusions, and measuring the size of the bladder. Examinations thought to be potentially most harmful included: identifying the presence/absence of intrauterine pregnancy, measuring the size of the abdominal aorta, and identifying the presence/absence of pericardial effusion. Conclusions: Examinations that are potentially the most useful may also be potentially the most harmful. When initiating an ultrasound curriculum for physical examinations, educators should weigh the risks and benefits of examinations chosen.

Background: Most incorrect diagnoses involve at least one cognitive error, of which premature closure is the most prevalent. While metacognitive strategies can mitigate premature closure in inexperienced learners, these are rarely studied in experienced physicians. Our objective here was to evaluate the effect of analytic information processing on diagnostic performance of nephrologists and nephrology residents. Methods: We asked nine nephrologists and six nephrology residents at the University of Calgary and Glasgow University to diagnose ten nephrology cases. We provided presenting features along with contextual information, after which we asked for an initial diagnosis. We then primed participants to use either hypothetico-deductive reasoning or scheme-inductive reasoning to analyze the remaining case data and generate a final diagnosis. Results: After analyzing initial hypotheses, both nephrologists and residents improved the accuracy of final diagnoses (31.1% vs. 65.6%, p < 0.001, and 40.0% vs. 70.0%, p < 0.001, respectively). We found a significant interaction between experience and analytic processing strategy (p = 0.002): nephrology residents had significantly increased odds of diagnostic success when using scheme-inductive reasoning (odds ratio [95% confidence interval] 5.69 [1.59, 20.33], p = 0.007), whereas the performance of experienced nephrologists did not differ between strategies (odds ratio 0.57 [0.23, 1.39], p = 0.2). Discussion: Experienced nephrologists and nephrology residents can improve their performance by analyzing initial diagnostic hypotheses. The explanation of the interaction between experience and the effect of different reasoning strategies is unclear, but may relate to preferences in reasoning strategy, or the changes in knowledge structure with experience.

Background: This pilot study compared performance of University of Calgary students on internal clerkship examinations with corresponding National Board of Medical Examiners (NBME) subject examinations. Methods: Between April and October 2007, students completed internal and NBME subject examinations following six mandatory rotations. Local faculty within each discipline set the minimum performance level (MPL) for internal examinations. Two methods of standard setting were considered for NBME exams and a sensitivity analysis was performed. Corresponding internal and NBME examination scores were compared using McNemar’s discordant pair analysis. Results: A significant and unexpected difference in failure rate between internal and external examinations was found in all clerkships. 1.4% of students were below the MPL for internal examinations and 27.3% (modified Angoff) or 25.9% (mean Hofstee compromise) (p

Background: Medical students encounter a variety of experiences that have an impact on their emerging professional identity. Clerkship, in particular, presents opportunities for students to consider their career options and decide upon a career path. The process of developing their professional identity begins well before clerkship, however. Anecdotal evidence suggests that interests in medicine begin as early as childhood. This study retrospectively examines the decision-making process clerks make in choosing medicine as a career. Methods: A total of 76 clerks (36 male, 34 female, 6 not reported) responded to four open-ended and two follow-up questions that measure career interests and pursuits. Questions addressed when and how students developed interests in medicine and alternate careers before beginning medical school. An additional eight closed questions drawn from the Ego Status Extended Objective Measure of Ego Identity Status II (EOM-EIS-II) were administered. Content analyses and inter-rater reliability analyses were conducted to classify students according to Marcia’s1 four ego identity statuses. Results: Having obtained high inter-rater consistency (Cohen’s Kappa coefficient of 0.92), responses to the open-ended questions resulted in the classification of three identity statuses. In total, 49.3% of students were in the ‘achieved’ (high exploration and commitment to choices) status and 48.1% were in the ‘foreclosed’ (low exploration but high commitment to choices) status. A small percentage (1.3%) of students were in the ‘moratorium’category (high exploration but low commitment to choices), while none of the students were in the ‘diffused’ (low exploration and low commitment to choices) category. Conclusions: With approximately half of the students demonstrating a ‘foreclosed’ status, this study reveals that despite exposure to a variety of careers when attending university, only half of the students had seriously pursued a career outside of medicine. The majority of students, moreover, developed an interest in medicine before adulthood, and did so independently from parental influence.

Introduction. If physicians apply clinical rather than biomedical knowledge when diagnosing, why do we use the basic sciences as the foundation for clinical teaching? In this study we evaluated the contribution of biomedical knowledge to diagnostic performance when solving electrolyte problems. Method. We asked 13 medical students and 19 nephrologists to solve electrolyte problems while thinking aloud, and determined biomedical knowledge application by protocol analysis. We used logistic regression to study the association between biomedical concepts, clinical experience, and performance. Results. Students and nephrologists applied a similar number of biomedical concepts per case (1.8 (±1.1) vs. 1.8 (±1.2), respectively, p = 0.8), but nephrologists were more successful (86.8% vs. 63.5%, p = 0.003). We found a significant interaction between expertise and applying biomedical concepts (p < 0.05). For students the odds of success increased significantly with applying biomedical concepts (odds ratio 4.66 [2.07, 10.48], p < 0.001), whereas for nephrologists there was only a trend towards improved performance (odds ratio 1.72 [0.94, 3.11], p = 0.07). Conclusions. Our results suggest that improving biomedical knowledge of students should improve their performance on electrolyte problems. The performance of experienced physicians may also be improved, but this requires further study before teaching recommendations can be made.

Background Balloon catheter sinuplasty (BCS)for chronic rhinosinusitis (CRS) was found to be successful in adults. The safety and feasibility of BCS in children has been recently established. The purpose of this study was to study the outcome of this technology in CRS in children. Methods A prospective, multicenter, nonrandomized evaluation was performed on patients with CRS. Thirty-two children between the ages of 2 and 11 years were enrolled. Safety was assessed by rate of adverse events. Effectiveness was assessed using the Sino-Nasal (SN)-5 quality-of-life questionnaire for children with CRS at 52 weeks follow-up. Results Thirty-two children were enrolled of which 24 completed their 52 weeks follow-up. No adverse events were reported because of the procedure. SN-5 score improved from a mean of 4.9 at baseline to a mean of 2.95 at 52 weeks (p < 0.0001). Twelve (50%) children had a significant improvement of their SN-5 (>–1.5), 7 (29%) had moderate improvement (>–1.0 and –0.5 and